full transcript

From the Ted Talk by Jason Robert Jaffe: Pros and cons of public opinion polls


Unscramble the Blue Letters


We are constantly asked for our opinions. Which team do you think will win the spuer Bowl? Who wore it better on the red carpet? Who are you going to vote for for mayor? Public opinion polls are everywhere. Important decision makers in American government have long relied on public ooniipn polls throughout elections and itrmpnaot lgiieaslton. The problem is pbiluc opinion isn't easy to tacrk and, often times, isn't even right. In 1948, the Chicago dialy Tribune ran a now famous headline: "Dewey Defeats Truman," they cried in big, bold, black and white letters. The problem is that Dewey hadn't defeated tamrun. The Tribune had relied on polls to come to their conclusion. Whoops! This happens all the time because public opinion polls are either inaccurate or misleading. So, why are they wnorg? And why do we keep using them? First, let's start with an important term: spamle. A sample is the group of people that respond to questions during a public opinion poll. A poll's qtulaiy rests llrgeay on its sample, and a sample can be bad in a few key ways. It can be too small, too narrow, or the poll itself can be too dlfiufcit. Polls that are too small are bad for oibovus reasons. And while you can't possibly ask every snigle person in America for their opinion, the more people you ask, the more auctrace your pirotdiecn. Polls that are too narrow, that only ask a certain type of person a question, are bad, too. Consider a poll about whether or not the potato is the best vegetable in America. If you only asked people in Idaho, where the state food is the potato, cneachs are that you would get a much different answer than if you asekd people in the state of New Mexico, where the sttae vegetable is beans. Getting the right kind of diversity in your sample means making sure that your sample has a range of ages, recas, genders, and geographic regions, just to name a few. Finally, polls that are too hard can't tell you much either. If you're asking people for their opinions on things about which they have no prior knowledge, the results will be pointless. You're better off shaking a Magic 8 ball. It's not just the people you're asking that can cause bias, though. The person doing the asking is part of the prbolem, too. That's called interviewer bias. iretievenwr bias is all about the effect that the proesn asking the questions has on the sample. Humans generally don't like confrontation. poeple worry that their answers may make them look bad. Therefore, we find that people tend to give socially desirable responses, not necessarily their honest opinions, because they don't want to come across as heartless, racist, or bigoted. And the way we word our questions matters too. When polls purposely sway the answers one way or the other, it's called a push poll because it pushes people to anwser a certain way. "Would you vote for candidate Smith?" is a prlceftey normal question. "Would you vote for candidate Smith if you knew that he robs senior citizens?" is a push poll. So, if polls are open to all sorts of manipulation and irccniacueas, why are they still so peralvnet? Despite their flaws, public opinion polls provide us with some sense of the thoughts and modos of large groups of people. They offer piiailctnos the chance to pass legislation they think a motairjy of Americans will spuprot. They help fashionistas on TV know which star wore the dress better on the red carpet. Finally, they make us, the people who get polled, feel as though our voice has been heard. So, next time you get a phone call asking your opinion, or if you see a poll online, take some time to think about who is asking and why they're asking. Then, take that poll, and its results, with a grain of salt or a ptatoo.

Open Cloze


We are constantly asked for our opinions. Which team do you think will win the _____ Bowl? Who wore it better on the red carpet? Who are you going to vote for for mayor? Public opinion polls are everywhere. Important decision makers in American government have long relied on public _______ polls throughout elections and _________ ___________. The problem is ______ opinion isn't easy to _____ and, often times, isn't even right. In 1948, the Chicago _____ Tribune ran a now famous headline: "Dewey Defeats Truman," they cried in big, bold, black and white letters. The problem is that Dewey hadn't defeated ______. The Tribune had relied on polls to come to their conclusion. Whoops! This happens all the time because public opinion polls are either inaccurate or misleading. So, why are they _____? And why do we keep using them? First, let's start with an important term: ______. A sample is the group of people that respond to questions during a public opinion poll. A poll's _______ rests _______ on its sample, and a sample can be bad in a few key ways. It can be too small, too narrow, or the poll itself can be too _________. Polls that are too small are bad for _______ reasons. And while you can't possibly ask every ______ person in America for their opinion, the more people you ask, the more ________ your __________. Polls that are too narrow, that only ask a certain type of person a question, are bad, too. Consider a poll about whether or not the potato is the best vegetable in America. If you only asked people in Idaho, where the state food is the potato, _______ are that you would get a much different answer than if you _____ people in the state of New Mexico, where the _____ vegetable is beans. Getting the right kind of diversity in your sample means making sure that your sample has a range of ages, _____, genders, and geographic regions, just to name a few. Finally, polls that are too hard can't tell you much either. If you're asking people for their opinions on things about which they have no prior knowledge, the results will be pointless. You're better off shaking a Magic 8 ball. It's not just the people you're asking that can cause bias, though. The person doing the asking is part of the _______, too. That's called interviewer bias. ___________ bias is all about the effect that the ______ asking the questions has on the sample. Humans generally don't like confrontation. ______ worry that their answers may make them look bad. Therefore, we find that people tend to give socially desirable responses, not necessarily their honest opinions, because they don't want to come across as heartless, racist, or bigoted. And the way we word our questions matters too. When polls purposely sway the answers one way or the other, it's called a push poll because it pushes people to ______ a certain way. "Would you vote for candidate Smith?" is a _________ normal question. "Would you vote for candidate Smith if you knew that he robs senior citizens?" is a push poll. So, if polls are open to all sorts of manipulation and ____________, why are they still so _________? Despite their flaws, public opinion polls provide us with some sense of the thoughts and _____ of large groups of people. They offer ___________ the chance to pass legislation they think a ________ of Americans will _______. They help fashionistas on TV know which star wore the dress better on the red carpet. Finally, they make us, the people who get polled, feel as though our voice has been heard. So, next time you get a phone call asking your opinion, or if you see a poll online, take some time to think about who is asking and why they're asking. Then, take that poll, and its results, with a grain of salt or a ______.

Solution


  1. majority
  2. people
  3. truman
  4. prediction
  5. largely
  6. support
  7. track
  8. answer
  9. races
  10. state
  11. politicians
  12. problem
  13. chances
  14. perfectly
  15. daily
  16. difficult
  17. sample
  18. prevalent
  19. wrong
  20. important
  21. public
  22. asked
  23. single
  24. moods
  25. interviewer
  26. inaccuracies
  27. potato
  28. obvious
  29. quality
  30. super
  31. accurate
  32. person
  33. legislation
  34. opinion

Original Text


We are constantly asked for our opinions. Which team do you think will win the Super Bowl? Who wore it better on the red carpet? Who are you going to vote for for mayor? Public opinion polls are everywhere. Important decision makers in American government have long relied on public opinion polls throughout elections and important legislation. The problem is public opinion isn't easy to track and, often times, isn't even right. In 1948, the Chicago Daily Tribune ran a now famous headline: "Dewey Defeats Truman," they cried in big, bold, black and white letters. The problem is that Dewey hadn't defeated Truman. The Tribune had relied on polls to come to their conclusion. Whoops! This happens all the time because public opinion polls are either inaccurate or misleading. So, why are they wrong? And why do we keep using them? First, let's start with an important term: sample. A sample is the group of people that respond to questions during a public opinion poll. A poll's quality rests largely on its sample, and a sample can be bad in a few key ways. It can be too small, too narrow, or the poll itself can be too difficult. Polls that are too small are bad for obvious reasons. And while you can't possibly ask every single person in America for their opinion, the more people you ask, the more accurate your prediction. Polls that are too narrow, that only ask a certain type of person a question, are bad, too. Consider a poll about whether or not the potato is the best vegetable in America. If you only asked people in Idaho, where the state food is the potato, chances are that you would get a much different answer than if you asked people in the state of New Mexico, where the state vegetable is beans. Getting the right kind of diversity in your sample means making sure that your sample has a range of ages, races, genders, and geographic regions, just to name a few. Finally, polls that are too hard can't tell you much either. If you're asking people for their opinions on things about which they have no prior knowledge, the results will be pointless. You're better off shaking a Magic 8 ball. It's not just the people you're asking that can cause bias, though. The person doing the asking is part of the problem, too. That's called interviewer bias. Interviewer bias is all about the effect that the person asking the questions has on the sample. Humans generally don't like confrontation. People worry that their answers may make them look bad. Therefore, we find that people tend to give socially desirable responses, not necessarily their honest opinions, because they don't want to come across as heartless, racist, or bigoted. And the way we word our questions matters too. When polls purposely sway the answers one way or the other, it's called a push poll because it pushes people to answer a certain way. "Would you vote for candidate Smith?" is a perfectly normal question. "Would you vote for candidate Smith if you knew that he robs senior citizens?" is a push poll. So, if polls are open to all sorts of manipulation and inaccuracies, why are they still so prevalent? Despite their flaws, public opinion polls provide us with some sense of the thoughts and moods of large groups of people. They offer politicians the chance to pass legislation they think a majority of Americans will support. They help fashionistas on TV know which star wore the dress better on the red carpet. Finally, they make us, the people who get polled, feel as though our voice has been heard. So, next time you get a phone call asking your opinion, or if you see a poll online, take some time to think about who is asking and why they're asking. Then, take that poll, and its results, with a grain of salt or a potato.

Frequently Occurring Word Combinations


ngrams of length 2

collocation frequency
public opinion 6
opinion polls 4
asked people 2
interviewer bias 2
push poll 2

ngrams of length 3

collocation frequency
public opinion polls 4


Important Words


  1. accurate
  2. ages
  3. america
  4. american
  5. americans
  6. answer
  7. answers
  8. asked
  9. bad
  10. ball
  11. beans
  12. bias
  13. big
  14. bigoted
  15. black
  16. bold
  17. bowl
  18. call
  19. called
  20. candidate
  21. carpet
  22. chance
  23. chances
  24. chicago
  25. citizens
  26. conclusion
  27. confrontation
  28. constantly
  29. cried
  30. daily
  31. decision
  32. defeated
  33. defeats
  34. desirable
  35. dewey
  36. difficult
  37. diversity
  38. dress
  39. easy
  40. effect
  41. elections
  42. famous
  43. fashionistas
  44. feel
  45. finally
  46. find
  47. flaws
  48. food
  49. genders
  50. generally
  51. geographic
  52. give
  53. government
  54. grain
  55. group
  56. groups
  57. hard
  58. heard
  59. heartless
  60. honest
  61. humans
  62. idaho
  63. important
  64. inaccuracies
  65. inaccurate
  66. interviewer
  67. key
  68. kind
  69. knew
  70. knowledge
  71. large
  72. largely
  73. legislation
  74. letters
  75. long
  76. magic
  77. majority
  78. makers
  79. making
  80. manipulation
  81. matters
  82. mayor
  83. means
  84. mexico
  85. misleading
  86. moods
  87. narrow
  88. necessarily
  89. normal
  90. obvious
  91. offer
  92. online
  93. open
  94. opinion
  95. opinions
  96. part
  97. pass
  98. people
  99. perfectly
  100. person
  101. phone
  102. pointless
  103. politicians
  104. poll
  105. polled
  106. polls
  107. possibly
  108. potato
  109. prediction
  110. prevalent
  111. prior
  112. problem
  113. provide
  114. public
  115. purposely
  116. push
  117. pushes
  118. quality
  119. question
  120. questions
  121. races
  122. racist
  123. ran
  124. range
  125. reasons
  126. red
  127. regions
  128. relied
  129. respond
  130. responses
  131. rests
  132. results
  133. robs
  134. salt
  135. sample
  136. senior
  137. sense
  138. shaking
  139. single
  140. small
  141. smith
  142. socially
  143. sorts
  144. star
  145. start
  146. state
  147. super
  148. support
  149. sway
  150. team
  151. tend
  152. thoughts
  153. time
  154. times
  155. track
  156. tribune
  157. truman
  158. tv
  159. type
  160. vegetable
  161. voice
  162. vote
  163. ways
  164. white
  165. win
  166. word
  167. wore
  168. worry
  169. wrong