full transcript
From the Ted Talk by Jason Robert Jaffe: Pros and cons of public opinion polls
Unscramble the Blue Letters
We are constantly asked for our opinions. Which team do you think will win the spuer Bowl? Who wore it better on the red carpet? Who are you going to vote for for mayor? Public opinion polls are everywhere. Important decision makers in American government have long relied on public ooniipn polls throughout elections and itrmpnaot lgiieaslton. The problem is pbiluc opinion isn't easy to tacrk and, often times, isn't even right. In 1948, the Chicago dialy Tribune ran a now famous headline: "Dewey Defeats Truman," they cried in big, bold, black and white letters. The problem is that Dewey hadn't defeated tamrun. The Tribune had relied on polls to come to their conclusion. Whoops! This happens all the time because public opinion polls are either inaccurate or misleading. So, why are they wnorg? And why do we keep using them? First, let's start with an important term: spamle. A sample is the group of people that respond to questions during a public opinion poll. A poll's qtulaiy rests llrgeay on its sample, and a sample can be bad in a few key ways. It can be too small, too narrow, or the poll itself can be too dlfiufcit. Polls that are too small are bad for oibovus reasons. And while you can't possibly ask every snigle person in America for their opinion, the more people you ask, the more auctrace your pirotdiecn. Polls that are too narrow, that only ask a certain type of person a question, are bad, too. Consider a poll about whether or not the potato is the best vegetable in America. If you only asked people in Idaho, where the state food is the potato, cneachs are that you would get a much different answer than if you asekd people in the state of New Mexico, where the sttae vegetable is beans. Getting the right kind of diversity in your sample means making sure that your sample has a range of ages, recas, genders, and geographic regions, just to name a few. Finally, polls that are too hard can't tell you much either. If you're asking people for their opinions on things about which they have no prior knowledge, the results will be pointless. You're better off shaking a Magic 8 ball. It's not just the people you're asking that can cause bias, though. The person doing the asking is part of the prbolem, too. That's called interviewer bias. iretievenwr bias is all about the effect that the proesn asking the questions has on the sample. Humans generally don't like confrontation. poeple worry that their answers may make them look bad. Therefore, we find that people tend to give socially desirable responses, not necessarily their honest opinions, because they don't want to come across as heartless, racist, or bigoted. And the way we word our questions matters too. When polls purposely sway the answers one way or the other, it's called a push poll because it pushes people to anwser a certain way. "Would you vote for candidate Smith?" is a prlceftey normal question. "Would you vote for candidate Smith if you knew that he robs senior citizens?" is a push poll. So, if polls are open to all sorts of manipulation and irccniacueas, why are they still so peralvnet? Despite their flaws, public opinion polls provide us with some sense of the thoughts and modos of large groups of people. They offer piiailctnos the chance to pass legislation they think a motairjy of Americans will spuprot. They help fashionistas on TV know which star wore the dress better on the red carpet. Finally, they make us, the people who get polled, feel as though our voice has been heard. So, next time you get a phone call asking your opinion, or if you see a poll online, take some time to think about who is asking and why they're asking. Then, take that poll, and its results, with a grain of salt or a ptatoo.
Open Cloze
We are constantly asked for our opinions. Which team do you think will win the _____ Bowl? Who wore it better on the red carpet? Who are you going to vote for for mayor? Public opinion polls are everywhere. Important decision makers in American government have long relied on public _______ polls throughout elections and _________ ___________. The problem is ______ opinion isn't easy to _____ and, often times, isn't even right. In 1948, the Chicago _____ Tribune ran a now famous headline: "Dewey Defeats Truman," they cried in big, bold, black and white letters. The problem is that Dewey hadn't defeated ______. The Tribune had relied on polls to come to their conclusion. Whoops! This happens all the time because public opinion polls are either inaccurate or misleading. So, why are they _____? And why do we keep using them? First, let's start with an important term: ______. A sample is the group of people that respond to questions during a public opinion poll. A poll's _______ rests _______ on its sample, and a sample can be bad in a few key ways. It can be too small, too narrow, or the poll itself can be too _________. Polls that are too small are bad for _______ reasons. And while you can't possibly ask every ______ person in America for their opinion, the more people you ask, the more ________ your __________. Polls that are too narrow, that only ask a certain type of person a question, are bad, too. Consider a poll about whether or not the potato is the best vegetable in America. If you only asked people in Idaho, where the state food is the potato, _______ are that you would get a much different answer than if you _____ people in the state of New Mexico, where the _____ vegetable is beans. Getting the right kind of diversity in your sample means making sure that your sample has a range of ages, _____, genders, and geographic regions, just to name a few. Finally, polls that are too hard can't tell you much either. If you're asking people for their opinions on things about which they have no prior knowledge, the results will be pointless. You're better off shaking a Magic 8 ball. It's not just the people you're asking that can cause bias, though. The person doing the asking is part of the _______, too. That's called interviewer bias. ___________ bias is all about the effect that the ______ asking the questions has on the sample. Humans generally don't like confrontation. ______ worry that their answers may make them look bad. Therefore, we find that people tend to give socially desirable responses, not necessarily their honest opinions, because they don't want to come across as heartless, racist, or bigoted. And the way we word our questions matters too. When polls purposely sway the answers one way or the other, it's called a push poll because it pushes people to ______ a certain way. "Would you vote for candidate Smith?" is a _________ normal question. "Would you vote for candidate Smith if you knew that he robs senior citizens?" is a push poll. So, if polls are open to all sorts of manipulation and ____________, why are they still so _________? Despite their flaws, public opinion polls provide us with some sense of the thoughts and _____ of large groups of people. They offer ___________ the chance to pass legislation they think a ________ of Americans will _______. They help fashionistas on TV know which star wore the dress better on the red carpet. Finally, they make us, the people who get polled, feel as though our voice has been heard. So, next time you get a phone call asking your opinion, or if you see a poll online, take some time to think about who is asking and why they're asking. Then, take that poll, and its results, with a grain of salt or a ______.
Solution
- majority
- people
- truman
- prediction
- largely
- support
- track
- answer
- races
- state
- politicians
- problem
- chances
- perfectly
- daily
- difficult
- sample
- prevalent
- wrong
- important
- public
- asked
- single
- moods
- interviewer
- inaccuracies
- potato
- obvious
- quality
- super
- accurate
- person
- legislation
- opinion
Original Text
We are constantly asked for our opinions. Which team do you think will win the Super Bowl? Who wore it better on the red carpet? Who are you going to vote for for mayor? Public opinion polls are everywhere. Important decision makers in American government have long relied on public opinion polls throughout elections and important legislation. The problem is public opinion isn't easy to track and, often times, isn't even right. In 1948, the Chicago Daily Tribune ran a now famous headline: "Dewey Defeats Truman," they cried in big, bold, black and white letters. The problem is that Dewey hadn't defeated Truman. The Tribune had relied on polls to come to their conclusion. Whoops! This happens all the time because public opinion polls are either inaccurate or misleading. So, why are they wrong? And why do we keep using them? First, let's start with an important term: sample. A sample is the group of people that respond to questions during a public opinion poll. A poll's quality rests largely on its sample, and a sample can be bad in a few key ways. It can be too small, too narrow, or the poll itself can be too difficult. Polls that are too small are bad for obvious reasons. And while you can't possibly ask every single person in America for their opinion, the more people you ask, the more accurate your prediction. Polls that are too narrow, that only ask a certain type of person a question, are bad, too. Consider a poll about whether or not the potato is the best vegetable in America. If you only asked people in Idaho, where the state food is the potato, chances are that you would get a much different answer than if you asked people in the state of New Mexico, where the state vegetable is beans. Getting the right kind of diversity in your sample means making sure that your sample has a range of ages, races, genders, and geographic regions, just to name a few. Finally, polls that are too hard can't tell you much either. If you're asking people for their opinions on things about which they have no prior knowledge, the results will be pointless. You're better off shaking a Magic 8 ball. It's not just the people you're asking that can cause bias, though. The person doing the asking is part of the problem, too. That's called interviewer bias. Interviewer bias is all about the effect that the person asking the questions has on the sample. Humans generally don't like confrontation. People worry that their answers may make them look bad. Therefore, we find that people tend to give socially desirable responses, not necessarily their honest opinions, because they don't want to come across as heartless, racist, or bigoted. And the way we word our questions matters too. When polls purposely sway the answers one way or the other, it's called a push poll because it pushes people to answer a certain way. "Would you vote for candidate Smith?" is a perfectly normal question. "Would you vote for candidate Smith if you knew that he robs senior citizens?" is a push poll. So, if polls are open to all sorts of manipulation and inaccuracies, why are they still so prevalent? Despite their flaws, public opinion polls provide us with some sense of the thoughts and moods of large groups of people. They offer politicians the chance to pass legislation they think a majority of Americans will support. They help fashionistas on TV know which star wore the dress better on the red carpet. Finally, they make us, the people who get polled, feel as though our voice has been heard. So, next time you get a phone call asking your opinion, or if you see a poll online, take some time to think about who is asking and why they're asking. Then, take that poll, and its results, with a grain of salt or a potato.
Frequently Occurring Word Combinations
ngrams of length 2
collocation |
frequency |
public opinion |
6 |
opinion polls |
4 |
asked people |
2 |
interviewer bias |
2 |
push poll |
2 |
ngrams of length 3
collocation |
frequency |
public opinion polls |
4 |
Important Words
- accurate
- ages
- america
- american
- americans
- answer
- answers
- asked
- bad
- ball
- beans
- bias
- big
- bigoted
- black
- bold
- bowl
- call
- called
- candidate
- carpet
- chance
- chances
- chicago
- citizens
- conclusion
- confrontation
- constantly
- cried
- daily
- decision
- defeated
- defeats
- desirable
- dewey
- difficult
- diversity
- dress
- easy
- effect
- elections
- famous
- fashionistas
- feel
- finally
- find
- flaws
- food
- genders
- generally
- geographic
- give
- government
- grain
- group
- groups
- hard
- heard
- heartless
- honest
- humans
- idaho
- important
- inaccuracies
- inaccurate
- interviewer
- key
- kind
- knew
- knowledge
- large
- largely
- legislation
- letters
- long
- magic
- majority
- makers
- making
- manipulation
- matters
- mayor
- means
- mexico
- misleading
- moods
- narrow
- necessarily
- normal
- obvious
- offer
- online
- open
- opinion
- opinions
- part
- pass
- people
- perfectly
- person
- phone
- pointless
- politicians
- poll
- polled
- polls
- possibly
- potato
- prediction
- prevalent
- prior
- problem
- provide
- public
- purposely
- push
- pushes
- quality
- question
- questions
- races
- racist
- ran
- range
- reasons
- red
- regions
- relied
- respond
- responses
- rests
- results
- robs
- salt
- sample
- senior
- sense
- shaking
- single
- small
- smith
- socially
- sorts
- star
- start
- state
- super
- support
- sway
- team
- tend
- thoughts
- time
- times
- track
- tribune
- truman
- tv
- type
- vegetable
- voice
- vote
- ways
- white
- win
- word
- wore
- worry
- wrong