UW professor: Election polling is ‘both art and science’

Oct 20, 2020, 9:05 AM
Voters fill out their ballots as they vote at the Stephen P. Clark Government Center polling station on Oct. 19, 2020, in Miami, Florida. (Photo by Joe Raedle/Getty Images)
(Photo by Joe Raedle/Getty Images)

In 2016, it seemed to be a done deal that Hillary Clinton would win the presidential election before what was considered a major upset that led to a Donald Trump victory. Much of what was blamed on the media after the election was actually what the media was reporting based on polling.

To explain if the polls were that inaccurate or if it was the reporting, Mark Alan Smith, a political science professor at the University of Washington, joined KIRO Nights with more insight.

MyNorthwest 2020 Voters Guide

“As far as the accurate part, the national polls were actually pretty close [in 2016],” Smith said. “… Even if you just take a simple average, you get to a Hillary Clinton victory in the realm of about 3-4 points, and she actually ends up winning by, I think the exact number was 2.1.”

While the national polls weren’t too far off, they were off by more in some of the crucial battleground states.

“There, the polls were off by about 4-5 points. And because they were off by about 4-5 points, they had Hillary Clinton with a narrow win that, given that error, becomes a narrow Trump win,” Smith explained. “And because those are the decisive states in the Electoral College, therefore, Trump becomes president. So we have two things going on, pretty accurate nationally, a little bit off, but off by more than that in a handful of a very important states.”

This year, Smith says, the pollsters are aware of the errors in those crucial states from 2016. The errors were in part because there just weren’t that many polls in those states, and they weren’t always the best or most reliable.

“But then another part of the story is just Trump had more support in that part of the country than we were expecting based, for example, on previous elections,” Smith said. “Like, say, the 2012 election, how well Republicans and Democrats typically do in different states. … It was partly a polling error and partly just a failure to anticipate Trump’s support.”

“Well now, we’re four years later. And, of course, the very same pollsters who were inaccurate in those states last time, they know that, and so they have adjusted their methods,” he added.

Smith says polling is challenging for a number of different reasons, in part because it’s hard to get people to participate. Additionally, those that do participate are systematically different than those who do not, so adjustments have to be made to take into account “non-response bias.”

“What’s often done are various kinds of weighting techniques where if you have a good sense of what the electorate is going to look like, how many percent of people have different levels of education? How many percent of people are from different races? How many percent of people are from rural versus urban, or other kinds of characteristics? And then, if you’re getting fewer than your expected number of people in the polls, in a sense you kind of upweight those people to make them count more in your poll, to make it more demographically representative of the whole population,” Smith explained.

“And if you get too many people in another category, you down weight those because in the actual electorate they’re not going to be as fully represented as they are in your poll,” he continued.

This may sound simple, but the precise weights of the electorate are not always known. Plus, the electorate can change between elections.

“There’s all of those factors that are themselves changing and the pollsters are trying to keep up with those factors. So it’s a bit of a moving target, and that’s why I like to think of polling as, in a way, kind of both art and science,” Smith said. “There’s certainly a science aspect in terms of collecting data and being systematic and rigorous and being transparent in your techniques and so on. But then there’s this art in that you’re always kind of fighting the last war in a sense, and you’re trying to pick up on things and make some predictions, and … you’re working with incomplete information.”

Looking ahead to current polls

For the upcoming presidential election, Smith says it’s important to take into account that any single poll can be off for a variety of reasons.

“We do have a bunch of polls now, they’re pointing toward something close to a double digit or maybe even in the low double digit lead for Joe Biden nationally, and then a little less than that in some of the close and crucial battleground states from last time,” he said. “And that would seem to point toward, ‘OK, Joe Biden’s doing pretty well where we’re at right now. Donald Trump is not doing as well.’ But this brings us back to what I mentioned before in the art and science of polling in that it’s a projection.”

“It’s partly based on asking people who are you voting for right now? And, of course, that could change,” he added. “We’re still about three weeks out from the election.”

Some people have already voted, and their votes won’t change, but presumably others could still change their mind before they turn in their ballot.

However, Smith says, there’s good reason to believe that there are fewer undecided voters this year.

“The more undecideds you have, the harder the polling is because you’re going to have to make some projections based upon the people you have,” he said. “And you don’t exactly know how the undecideds are going to break. And in 2016, they ended up breaking heavily for Trump, something like 2 to 1.”

“We have good reason to believe now … there are fewer voters out there who haven’t made up their mind,” he said. “I mean, if you kind of think about this by we’re four years into the Trump presidency, if you haven’t figured out by now if you’re a Trump supporter or a Trump opponent, you really haven’t been paying attention.”

Washington voters rush to ballot boxes over first weekend of voting

That said, Smith again said if there are errors in the polls this year, it won’t be the same as 2016, but it could perhaps be due to inaccurate projections in voter turnout, which is especially hard to predict in the middle of a pandemic.

“There could be some people who were afraid to vote in person, depending on the state, or … are mail ballots accessible? In Washington, of course, it’s all mail for everybody. But in other states you have to request them and they’re different procedures, and so turnout could be affected,” Smith said.

“One possible way the polls could be wrong this time,” he added, “and Trump might be in quite a bit of better shape than the polls are indicating if, for some reason, his turnout operation is better than the pollsters are expecting, and Biden’s turnout operation is worse than the pollsters are expecting.”

Listen to KIRO Nights weeknights from 7 – 10 p.m. on KIRO Radio, 97.3 FM. Subscribe to the podcast here.

KIRO Nights on KIRO Radio 97.3 FM
  • listen to kiro nightsTune in to KIRO Radio weekdays at 7 pm for KIRO Nights with Jack Stine.

KIRO Nights

KIRO Nights

Seattle Public Schools...
KIRO Nights

Despite early pushback, Seattle Public Schools reaches ‘fantastic’ vaccine mandate compliance

Of Seattle Public Schools' 7,283 full time employees, 99% have received COVID immunizations. 205 have sought religious or medical exemptions.
13 hours ago
Seattle city attorney...
KIRO Nights

Seattle city attorney candidate defends past inflammatory tweets as ‘satire and sarcasm’

Seattle city attorney candidate Nicole Thomas-Kennedy defends incendiary posts on social media, claims 'Twitter is an inherently satirical and sarcastic.'
20 days ago
vaccination plan, Biden...
Jack Stine

Jack Stine’s six step COVID vaccination plan

KIRO Nights host Jack Stine came up with his own six step plan to get more Americans vaccinated against COVID, focused on a change in messaging.
1 month ago
Vaccine consent, vaccinated protest, lawsuit vaccine mandate...
Jack Stine

Stine: Refusal to get vaccinated is about consent for some

Not wanting to get vaccinated has nothing to do with grand or romantic illusions of a conspiracy, but rather a very basic concept: consent.
2 months ago
Jack Stine

Stine: If I win the COVID vaccine lottery … or any lottery

Lotteries present a tremendous amount of potential for someone to lose themselves from suddenly being endowed with hundreds of thousands or millions of dollars.
4 months ago
cancel rent...
KIRO Nights

Push to ‘cancel the rent,’ extend moratoriums driven by risk of more homelessness

With eviction moratoriums set to expire at the end of June, some local groups are pushing for the state to cancel rent and help people avoid homelessness.
5 months ago

Sponsored Articles


Medicare open enrollment for 2022 starts Oct. 15 and SHIBA can help!

Washington State Office of the Insurance Commissioner SPONSORED — Medicare’s Open Enrollment Period, also called the Annual Election Period, is Oct. 15 to Dec. 7. During this time, people enrolled in Medicare can: Switch from Original Medicare to a Medicare Advantage plan and vice versa. Join, drop or switch a Part D prescription drug plan, […]

How to Have a Stress-Free Real Estate Experience

The real estate industry has adapted and sellers are taking full advantage of new real estate models. One of which is Every Door Real Estate.
IQ Air

How Poor Air Quality Is Affecting Our Future Athletes

You cannot control your child’s breathing environment 100% of the time, but you can make a huge impact.
Swedish Health Services

Special Coverage: National Prostate Cancer Awareness Month

There are a wide variety of treatment options available for men with prostate cancer. The most technologically advanced treatment option in the Northwest is Stereotactic Body Radiation Therapy using the CyberKnife platform.
Marysville Police Department

Police Opportunities in a Growing, Supportive Washington Community

Marysville PD is looking for both lateral and entry level officers. Begin or continue your career in law enforcement for a growing, supportive community.

Small, Minority-Owned Businesses in King County and Pierce County Can Now Apply For $10,000 Relief Grants Through Comcast RISE

Businesses in King County and Pierce County can apply beginning on October 1, 2021, at for a chance to receive a $10,000 relief grant.
UW professor: Election polling is ‘both art and science’