“How to Spot a Flawed Clinical Trial” by Scott Snyder, Senior Research Scientist, Biotherapeutic Pharmaceutical Sciences

Jan 21, 2011 | Corporate Member News

One of the big stories in science news lately has been the story that links of vaccine administration to autism are not just wrong, they are fraudulent – a willful fabrication built up in an effort to sue a vaccine maker.  The disturbing thing here is that millions of parents may have been scared away from vaccines for their children by a lie.

In an effort to help my readers distinguish between scientific fact and fiction, I will now describe a way that anyone can use to tell whether a scientific study is real or horse hooey.  It can be done in less than about 30 minutes and is completely free.  One caveat – this only works for studies more than a few years old as it relies on scientists to make up their minds about the study.  It does, however, have the advantage that you are eliminating from the search those HUGE sections of the web which are trying to sell you something or are written by crackpots.

1)      Step one  – Go to Google Scholar (http://scholar.google.com/).  Type in the search terms for the study you are interested in.  If you know the last name of the study author, type it in as well.

2)      Step two – Look for the study in question in the search results and go to the section where it says “Cited by (some number)”.  Click on this.  What you are doing here is seeing what other scientists are saying about the article.  Like any Google search, you will get a number of irrelevant hits, but you should get several hits that focus on the article within the first page or two. Read the abstracts to see what they have to say.

Scott Snyder

Let’s see how this works when we apply it to the study on vaccines and autism.  I happen to know the article in question was written by a man called Wakefield so I will type in “wakefield autism vaccine”.  The study I want to look at comes up as the first hit.  As a bonus, I can see that the study has been retracted which should be a pretty good first clue.  At the bottom of the entry is a section that says “Cited by 1086”.  Click on this and look at the first 10 results. 

The title of number 3 reads, “Autism and measles, mumps and rubella vaccine: no epidemiological evidence for a causal association”.  Going down to number 5 on the list, titled “A population based study of measles, mumps and rubella vaccine and autism”, and skip right to the conclusions – “This study provides strong evidence against the hypothesis that MMR vaccination causes autism.”  Pretty good evidence here that the study is best reserved for use in a compost heap rather than informed decision making.

If you want to try this yourself, one search I might suggest is “Mann global temperature”.  It relates to a key study in global warming which many people question.

About Scott Snyder

Senior Research Scientist, Biotherapeutic Pharmaceutical Sciences

Blog Posts 

Key Areas of Research: Carbohydrate Chemistry

Professional Affiliations: Member, International Endotoxin Society

Education: Ph.D. Duke University Cell Biology with certification in Biological Chemistry M.S. Biochemistry Medical College of Wisconsin B.S. Chemistry University of Idaho

This article originally appeared on the “Think Science Now” site.

About Think Science Now:

At Pfizer, science allows us to bring innovative vaccines, nutritional products and medicines to people and animals around the world.

On Think Science Now, our inspiring scientists, clinical researchers, doctors, veterinarians and other health care professionals talk about what they are doing with science at Pfizer and why they are doing it. Thanks to them and others, we are challenging the most feared medical conditions of our time and advancing new ways to prevent, treat and cure diseases in order to bring hope to millions of people worldwide.

It’s an exciting time for science and medicine. Genomics and other advances are converging to revolutionize the way we approach health. We at Pfizer are thrilled to be a part of it and proud to share our work on Think Science Now.

Learn more about the science of medicine through the following links:

The drug discovery process 

Our therapeutic focuses  

Our scientists: from bench to bedside 

Our medical professionals: helping to ensure patient safety 

Access the Think Science Now site here.

Similar Posts

Meet A Member | BDC

Meet A Member | BDC

BDC is the bank for Canadian entrepreneurs. It promotes Canadian entrepreneurship with a focus on small and medium-sized businesses; it works with...

read more
Meet A Member | SaskTel

Meet A Member | SaskTel

Reliability—It's the cornerstone of your peace of mind.   When it comes to essential services like your business phone, cloud, IT services, and...

read more