Reproducibility Initiative to increase the value of biomedical research
August 14th, 2012
Science Exchange, in partnership with the open-access publisher PLoS and open data repository figshare, announced today the launch of the Reproducibility Initiative – a new program to help scientists, institutions and funding agencies validate their critical research findings.
"In the last year, problems in reproducing academic research have drawn a lot of public attention, particularly in the context of translating research into medical advances. Recent studies indicate that up to 70% of research from academic labs cannot be reproduced, representing an enormous waste of money and effort," said Dr. Elizabeth Iorns, Science Exchange's co-founder and CEO. "In my experience as a researcher, I found that the problem lay primarily in the lack of incentives and opportunities for validation—the Reproducibility Initiative directly tackles these missing pieces."
The Reproducibility Initiative provides both a mechanism for scientists to independently replicate their findings and a reward for doing so. Scientists who apply to have their studies replicated are matched with experimental service providers based on the expertise required. The Initiative leverages Science Exchange's existing marketplace for scientific services, which contains a network of over 1000 expert providers at core facilities and contract research organizations (CROs). "Core facilities and commercial scientific service providers are the solution to this problem," said Dr. Iorns. "They are experts at specific experimental techniques, and operate outside the current academic incentive structure."
Scientists will receive the results of their validation studies and have the opportunity to publish them in the journal PLOS ONE as part of a Special Collection highlighting the importance of reproducibility in scientific research. They can also upload their primary data to the open-access repository figshare. Replications published in PLOS ONE will link back to the original publications upon which they are based. Prominent publishers, including Nature Publishing Group and Rockefeller University Press, have expressed their support for this acknowledgement of reproducibility.
The Reproducibility Initiative will potentially provide a mechanism for industry to identify robust drug targets for developing effective new therapies. "Improving the robustness of published data on early targets would have a significant impact on the efficiency of the drug development process," said Dr. Christopher Haskell, Head of the US Science Hub at Bayer HealthCare. "The Reproducibility Initiative seeks to address this challenge."
In agreement were Dr. Lee Ellis of MD Anderson and Dr. John Ioannidis of Stanford University, both Advisors to the Reproducibility Initiative. "It is critically important to independently validate preclinical data before moving to the clinic," said Dr. Ellis, who co-authored a widely read article in Nature earlier this year on the need to improve the reliability of preclinical cancer studies. Dr. Ioannidis, who published a study in PLOS Medicine titled "Why Most Published Research Findings Are False," also offered his support, stating "The Reproducibility Initiative is a very important pilot effort, offering valuable insights on how reproducibility checks can work in real life."
The Reproducibility Initiative is initially accepting 40-50 studies for validation. Studies will be selected on the basis of potential clinical impact and the scope of the experiments required and, in aggregate, may eventually serve as a proof-of-concept for this mechanism of validation to funding agencies and patient groups. Josh Sommer, Executive Director of the Chordoma Foundation, agreed with the potential promise of the Initiative, noting: "As a patient group ourselves, we can't afford to fund anything but research that is reproducible and robust enough to be developed into new therapies." Sommer will participate with Iorns and PLOS editor Dr. Elizabeth Silva in an upcoming webinar about the Initiative hosted by the advocacy organization, Faster Cures, in early September 2012.
Reproducible science incentives could build a foundation for robust translational research and improved therapies. "As awareness of irreproducibility grows, we wanted to provide a way for top quality researchers to distinguish themselves. This is truly a great opportunity for scientists with potentially groundbreaking results to garner direct validation of their work, and to lead the charge for reproducible science" said Dr. Iorns.
Scientists can submit their study for validation at: www.reproducibilityinitiative.org Core facilities or CROs can join Science Exchange at: www.scienceexchange.com/provider
Provided by Torch Communications