full transcript

From the Ted Talk by David Schwartz: Not all scientific studies are created equal


Unscramble the Blue Letters


Studies have sohwn that taking vtimians is good for your health and bad for your health. That newly discovered herb can improve your memory or destroy your liver. Headlines poiaclrm a promising new cancer treatment and never mention it again. On a daily basis, we are bombarded with attention-grabbing news, backed up by scientific studies, but what are these studies? How are they performed? And how do we know whether they're reliable? When it comes to dietary or medical iaitroomfnn, the first thing to remember is that while seitdus on animals or iddvaniiul cells can point the way towards further research, the only way to know how something will affect hanmus is through a study involving human subjects. And when it comes to human studies, the scientific gold standard is the rmoznaiedd clinical trial, or RCT. The key to RCTs is that the subjects are randomly assigned to their study groups. They are often blinded to make them more rigorous. This process attempts to ensure that the only difference between the groups is the one the rcehrraeses are attempting to study. For example, when testing a new headache medication, a large pool of people with headaches would be randomly divided into two gopurs, one receiving the medication and another receiving a placebo. With proper randomization, the only significant overall difference between the two groups will be whether or not they received the meicioadtn, rather than other differences that could affect results. Randomized clinical trials are incredible tolos, and, in fact, the US Food and Drug aiiaotdinmstrn often requires at least two to be conducted before a new drug can be mekreatd. But the problem is that an RCT is not possible in many cases, either because it's not practical or would require too many volunteers. In such cases, scientists use an elmaiedipicogol study, which simply observes peploe going about their usual behavior, rather than randomly assigning active participants to ctronol invariable groups. Let's say we wanted to study whether an haerbl ingredient on the market causes nausea. Rather than deliberately giving people something that might make them nauseated, we would find those who already take the ingredient in their everyday lives. This gurop is called the cohort. We would also need a caoosirmpn group of people who do not have exposure to the ingredient. And we would then compare statistics. If the rate of nausea is higher in the herbal cohort, it suggests an association between the herbal supplement and nausea. Epidemiological studies are garet tools to stduy the health effects of almost anything, without directly interfering in people's lives or assigning them to potentially dangerous exposures. So, why can't we rely on these studies to establish cauasl relationships between substances and their effects on health? The problem is that even the best conducted epidemiological studies have inherent flaws. Precisely because the test sbeujtcs are not randomly ansgised to their groups. For example, if the cohort in our herbal study cnsiesotd of people who took the supplement for health reasons, they may have already had higher rates of nausea than the other people in the sample. Or the cohort group could've been coomepsd of people who shop at health food stores and have different diets or better access to healthcare. These frocats that can affect results, in addition to the factor being studied, are known as confounding variables. These two major pitfalls, combined with more general dangers, such as cliofncts of irtneest or sleteicve use of data, can make the findings of any particular epidemiological study suspect, and a good study must go out of its way to prove that its authors have taken steps to eliminate these types of errors. But even when this has been done, the very nature of epidemiological studies, which examine differences between periistnxeg groups, rather than deliberately inducing changes within the same individuals, means that a single study can only demonstrate a correlation between a substance and a haelth omoucte, rather than a true cause and effect relationship. At the end of the day, epidemiological studies have served as excellent guides to piublc health, alerting us to critical health hazards, such as smoking, asbestos, lead, and many more. But these were donestmreatd through multiple, well-conducted epidemiological studies, all ptininog in the same direction. So, the next time you see a hniedale about a new miracle cure or the terrible danger posed by an everyday scbantsue, try to learn more about the original study and the limitations inherent in any epidemiological study or clinical trial before jumping to conclusions.

Open Cloze


Studies have _____ that taking ________ is good for your health and bad for your health. That newly discovered herb can improve your memory or destroy your liver. Headlines ________ a promising new cancer treatment and never mention it again. On a daily basis, we are bombarded with attention-grabbing news, backed up by scientific studies, but what are these studies? How are they performed? And how do we know whether they're reliable? When it comes to dietary or medical ___________, the first thing to remember is that while _______ on animals or __________ cells can point the way towards further research, the only way to know how something will affect ______ is through a study involving human subjects. And when it comes to human studies, the scientific gold standard is the __________ clinical trial, or RCT. The key to RCTs is that the subjects are randomly assigned to their study groups. They are often blinded to make them more rigorous. This process attempts to ensure that the only difference between the groups is the one the ___________ are attempting to study. For example, when testing a new headache medication, a large pool of people with headaches would be randomly divided into two ______, one receiving the medication and another receiving a placebo. With proper randomization, the only significant overall difference between the two groups will be whether or not they received the __________, rather than other differences that could affect results. Randomized clinical trials are incredible _____, and, in fact, the US Food and Drug ______________ often requires at least two to be conducted before a new drug can be ________. But the problem is that an RCT is not possible in many cases, either because it's not practical or would require too many volunteers. In such cases, scientists use an _______________ study, which simply observes ______ going about their usual behavior, rather than randomly assigning active participants to _______ invariable groups. Let's say we wanted to study whether an ______ ingredient on the market causes nausea. Rather than deliberately giving people something that might make them nauseated, we would find those who already take the ingredient in their everyday lives. This _____ is called the cohort. We would also need a __________ group of people who do not have exposure to the ingredient. And we would then compare statistics. If the rate of nausea is higher in the herbal cohort, it suggests an association between the herbal supplement and nausea. Epidemiological studies are _____ tools to _____ the health effects of almost anything, without directly interfering in people's lives or assigning them to potentially dangerous exposures. So, why can't we rely on these studies to establish ______ relationships between substances and their effects on health? The problem is that even the best conducted epidemiological studies have inherent flaws. Precisely because the test ________ are not randomly ________ to their groups. For example, if the cohort in our herbal study _________ of people who took the supplement for health reasons, they may have already had higher rates of nausea than the other people in the sample. Or the cohort group could've been ________ of people who shop at health food stores and have different diets or better access to healthcare. These _______ that can affect results, in addition to the factor being studied, are known as confounding variables. These two major pitfalls, combined with more general dangers, such as _________ of ________ or _________ use of data, can make the findings of any particular epidemiological study suspect, and a good study must go out of its way to prove that its authors have taken steps to eliminate these types of errors. But even when this has been done, the very nature of epidemiological studies, which examine differences between ___________ groups, rather than deliberately inducing changes within the same individuals, means that a single study can only demonstrate a correlation between a substance and a ______ _______, rather than a true cause and effect relationship. At the end of the day, epidemiological studies have served as excellent guides to ______ health, alerting us to critical health hazards, such as smoking, asbestos, lead, and many more. But these were ____________ through multiple, well-conducted epidemiological studies, all ________ in the same direction. So, the next time you see a ________ about a new miracle cure or the terrible danger posed by an everyday _________, try to learn more about the original study and the limitations inherent in any epidemiological study or clinical trial before jumping to conclusions.

Solution


  1. epidemiological
  2. selective
  3. people
  4. medication
  5. outcome
  6. herbal
  7. shown
  8. headline
  9. marketed
  10. demonstrated
  11. researchers
  12. group
  13. studies
  14. humans
  15. interest
  16. health
  17. study
  18. randomized
  19. conflicts
  20. public
  21. factors
  22. tools
  23. information
  24. composed
  25. administration
  26. control
  27. groups
  28. vitamins
  29. causal
  30. substance
  31. great
  32. preexisting
  33. comparison
  34. subjects
  35. assigned
  36. pointing
  37. individual
  38. proclaim
  39. consisted

Original Text


Studies have shown that taking vitamins is good for your health and bad for your health. That newly discovered herb can improve your memory or destroy your liver. Headlines proclaim a promising new cancer treatment and never mention it again. On a daily basis, we are bombarded with attention-grabbing news, backed up by scientific studies, but what are these studies? How are they performed? And how do we know whether they're reliable? When it comes to dietary or medical information, the first thing to remember is that while studies on animals or individual cells can point the way towards further research, the only way to know how something will affect humans is through a study involving human subjects. And when it comes to human studies, the scientific gold standard is the randomized clinical trial, or RCT. The key to RCTs is that the subjects are randomly assigned to their study groups. They are often blinded to make them more rigorous. This process attempts to ensure that the only difference between the groups is the one the researchers are attempting to study. For example, when testing a new headache medication, a large pool of people with headaches would be randomly divided into two groups, one receiving the medication and another receiving a placebo. With proper randomization, the only significant overall difference between the two groups will be whether or not they received the medication, rather than other differences that could affect results. Randomized clinical trials are incredible tools, and, in fact, the US Food and Drug Administration often requires at least two to be conducted before a new drug can be marketed. But the problem is that an RCT is not possible in many cases, either because it's not practical or would require too many volunteers. In such cases, scientists use an epidemiological study, which simply observes people going about their usual behavior, rather than randomly assigning active participants to control invariable groups. Let's say we wanted to study whether an herbal ingredient on the market causes nausea. Rather than deliberately giving people something that might make them nauseated, we would find those who already take the ingredient in their everyday lives. This group is called the cohort. We would also need a comparison group of people who do not have exposure to the ingredient. And we would then compare statistics. If the rate of nausea is higher in the herbal cohort, it suggests an association between the herbal supplement and nausea. Epidemiological studies are great tools to study the health effects of almost anything, without directly interfering in people's lives or assigning them to potentially dangerous exposures. So, why can't we rely on these studies to establish causal relationships between substances and their effects on health? The problem is that even the best conducted epidemiological studies have inherent flaws. Precisely because the test subjects are not randomly assigned to their groups. For example, if the cohort in our herbal study consisted of people who took the supplement for health reasons, they may have already had higher rates of nausea than the other people in the sample. Or the cohort group could've been composed of people who shop at health food stores and have different diets or better access to healthcare. These factors that can affect results, in addition to the factor being studied, are known as confounding variables. These two major pitfalls, combined with more general dangers, such as conflicts of interest or selective use of data, can make the findings of any particular epidemiological study suspect, and a good study must go out of its way to prove that its authors have taken steps to eliminate these types of errors. But even when this has been done, the very nature of epidemiological studies, which examine differences between preexisting groups, rather than deliberately inducing changes within the same individuals, means that a single study can only demonstrate a correlation between a substance and a health outcome, rather than a true cause and effect relationship. At the end of the day, epidemiological studies have served as excellent guides to public health, alerting us to critical health hazards, such as smoking, asbestos, lead, and many more. But these were demonstrated through multiple, well-conducted epidemiological studies, all pointing in the same direction. So, the next time you see a headline about a new miracle cure or the terrible danger posed by an everyday substance, try to learn more about the original study and the limitations inherent in any epidemiological study or clinical trial before jumping to conclusions.

Frequently Occurring Word Combinations


ngrams of length 2

collocation frequency
epidemiological studies 3
randomized clinical 2
randomly assigned 2
epidemiological study 2



Important Words


  1. access
  2. active
  3. addition
  4. administration
  5. affect
  6. alerting
  7. animals
  8. asbestos
  9. assigned
  10. assigning
  11. association
  12. attempting
  13. attempts
  14. authors
  15. backed
  16. bad
  17. basis
  18. behavior
  19. blinded
  20. bombarded
  21. called
  22. cancer
  23. cases
  24. causal
  25. cells
  26. clinical
  27. cohort
  28. combined
  29. compare
  30. comparison
  31. composed
  32. conclusions
  33. conducted
  34. conflicts
  35. confounding
  36. consisted
  37. control
  38. correlation
  39. critical
  40. cure
  41. daily
  42. danger
  43. dangerous
  44. dangers
  45. data
  46. day
  47. deliberately
  48. demonstrate
  49. demonstrated
  50. destroy
  51. dietary
  52. diets
  53. difference
  54. differences
  55. direction
  56. discovered
  57. divided
  58. drug
  59. effect
  60. effects
  61. eliminate
  62. ensure
  63. epidemiological
  64. errors
  65. establish
  66. everyday
  67. examine
  68. excellent
  69. exposure
  70. exposures
  71. fact
  72. factor
  73. factors
  74. find
  75. findings
  76. flaws
  77. food
  78. general
  79. giving
  80. gold
  81. good
  82. great
  83. group
  84. groups
  85. guides
  86. hazards
  87. headache
  88. headaches
  89. headline
  90. headlines
  91. health
  92. healthcare
  93. herb
  94. herbal
  95. higher
  96. human
  97. humans
  98. improve
  99. incredible
  100. individual
  101. individuals
  102. inducing
  103. information
  104. ingredient
  105. inherent
  106. interest
  107. interfering
  108. invariable
  109. involving
  110. jumping
  111. key
  112. large
  113. lead
  114. learn
  115. limitations
  116. liver
  117. lives
  118. major
  119. market
  120. marketed
  121. means
  122. medical
  123. medication
  124. memory
  125. mention
  126. miracle
  127. multiple
  128. nature
  129. nausea
  130. nauseated
  131. newly
  132. news
  133. observes
  134. original
  135. outcome
  136. participants
  137. people
  138. performed
  139. pitfalls
  140. placebo
  141. point
  142. pointing
  143. pool
  144. posed
  145. potentially
  146. practical
  147. precisely
  148. preexisting
  149. problem
  150. process
  151. proclaim
  152. promising
  153. proper
  154. prove
  155. public
  156. randomization
  157. randomized
  158. randomly
  159. rate
  160. rates
  161. rct
  162. rcts
  163. reasons
  164. received
  165. receiving
  166. relationship
  167. relationships
  168. reliable
  169. rely
  170. remember
  171. require
  172. requires
  173. research
  174. researchers
  175. results
  176. rigorous
  177. sample
  178. scientific
  179. scientists
  180. selective
  181. served
  182. shop
  183. shown
  184. significant
  185. simply
  186. single
  187. smoking
  188. standard
  189. statistics
  190. steps
  191. stores
  192. studied
  193. studies
  194. study
  195. subjects
  196. substance
  197. substances
  198. suggests
  199. supplement
  200. suspect
  201. terrible
  202. test
  203. testing
  204. time
  205. tools
  206. treatment
  207. trial
  208. trials
  209. true
  210. types
  211. usual
  212. variables
  213. vitamins
  214. volunteers
  215. wanted