The issue with your assertion is that it doesn't account for all the times the polls are right. See most mid-term elections.

I think we have to seriously consider that Trump just breaks things that otherwise would be working within reason.