New York City

Why did progressives outperform the polls?

The lefty candidates in statewide races did better than polling had indicated

A call polling center

A call polling center Shutterstock

All eyes in New York politics were on the Siena College poll when it came out on Sept. 10, just days before the 2018 primary election. On the Democratic side, it told a story of a too-close-to-call attorney general race, a cushy lead for Lt. Gov. Kathy Hochul’s re-election, and a 41-point spread in the gubernatorial race in favor of incumbent Gov. Andrew Cuomo.

The results didn’t exactly match those findings. Letitia James won the attorney general nomination by a 19-point margin. The candidate who came in second, Zephyr Teachout, was in third in the Siena poll. Hochul only bested Jumaane Williams six points, while Cuomo beat opponent Cynthia Nixon by 30 points. While that might sound like the poll was at least right about the governor’s race, a 10-point difference is an unusually large swing for a poll taken so late in the race.

The discrepancy between the poll’s findings and the final results followed a pattern: candidates who lean further left than their opponents did better in the actual results than they had in the poll. So, is there a structural flaw in Siena’s model? And, given the dearth of other statewide polls, might every poll underestimate progressive candidates?

Election or no election, Siena conducts these surveys once a month “as a public service to keep people informed to show where New Yorkers stand.” It’s proven itself a well-respected polling organization, recently named one of the best in the country by political website FiveThirtyEight.com. Siena also managed to accurately call the final outcomes for two out of the three statewide races. (The results only differed on the AG race, putting James in second a point behind U.S. Rep. Sean Patrick Maloney.)

So what happened when it came down to the details? The large number of undecided voters and the tendency of those to break towards challengers may be part of the story. “The poll is not a predictor,” Steven Greenberg a spokesperson for the Siena College Polling Institute told City & State. “It’s a snapshot in time.”

Even so, the reputation of Siena and other polls like it – Quinnipiac University and Monmouth University to name a few – means constituents and candidates alike look to the polls leading up to crucial elections. And it’s not clear what changed in the six days between polling of the 509 “likely voters” and when the ballots were cast.

Perhaps it’s time to update the polling process to reflect modern communication technology. The way polling is conducted today is a bit antiquated. Live callers contact voters by phone to ask them a series of questions about who they’re voting for and how they think candidates stand with regard to things like corruption and policies. The responses are weighted using a point-based system that takes into account things like how many times the person has voted before and how zealous they are about one of the contenders.

The result is often skewed demographically or geographically. Siena said that its own breakdown was fairly close to the actual, but voter turnout wound up being a lot different than anyone could have predicted.

There were more than two times the number of voters on Sept. 13 than there were in 2014’s primary, which was much more than anyone, including pollsters, predicted. That increase was especially prominent downstate. Siena’s poll, for example, was 50 percent New York City residents, but Thursday’s Democratic electorate was 57 percent from the five boroughs. That made all of the difference in the lieutenant governor race. Hochul is an upstate New York resident while her opponent, Jumaane Williams, is a Brooklyn native, and New York City showed up for Williams a lot more than it did for the incumbent.

For the other two races, Greenberg said the difference between the polling results and Thursday’s election results was largely about the undecideds, who “clearly broke in the direction of James,” and probably did the same for Nixon. Historically, if a voter isn’t planning on supporting the incumbent six days before the election, they probably won’t on the day of, but that isn’t necessarily true of the challenger, according to Siena. So probably most of the 18 percent of people it polled who said “I don’t know” or “I don’t have an opinion,” probably went with Nixon.

Pollsters call roughly twice as many landlines as they call cell phones. “We have to move towards cell phones as more and more houses are getting rid of landlines,” said Greenberg. Even so, when the electorate is clearly being reshaped by the influx of tech-savvy younger voters – none of whom should be assumed to use landlines and many of whom don’t even talk on their phones, but use them for communicating only via text message and social media – pollsters should probably find new ways of reaching them.

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.