TY - JOUR
T1 - Reproducibility of research and preclinical validation
T2 - Problems and solutions
AU - Pusztai, Lajos
AU - Hatzis, Christos
AU - Andre, Fabrice
N1 - Funding Information:
Three-pronged grant funding system
PY - 2013/12/1
Y1 - 2013/12/1
N2 - Lack of reproducibility in the scientific and lay literature of many scientific reports is an increasing concern, as are the high rates of failure to validate highly promising preclinical observations in clinical trials. There are many technical reasons why experimental results, particularly in cancer research, cannot be reproduced, including unrecognized variables in the complex experimental model, poor documentation of procedures, selective reporting of the most-positive findings, misinterpretation of technical noise as biological signal and, in the most extreme cases, fabrication of data. We suggest that cognitive biases in research and flaws in the academic incentive system also contribute to the publication of immature results. Recognition of these factors, which are often not discussed, provides additional strategies to improve reproducibility. We suggest that in addition to establishing better standards of data presentation and creating venues for publication of negative results, some changes to the grant submission and funding system could further improve the reproducibility of research findings.
AB - Lack of reproducibility in the scientific and lay literature of many scientific reports is an increasing concern, as are the high rates of failure to validate highly promising preclinical observations in clinical trials. There are many technical reasons why experimental results, particularly in cancer research, cannot be reproduced, including unrecognized variables in the complex experimental model, poor documentation of procedures, selective reporting of the most-positive findings, misinterpretation of technical noise as biological signal and, in the most extreme cases, fabrication of data. We suggest that cognitive biases in research and flaws in the academic incentive system also contribute to the publication of immature results. Recognition of these factors, which are often not discussed, provides additional strategies to improve reproducibility. We suggest that in addition to establishing better standards of data presentation and creating venues for publication of negative results, some changes to the grant submission and funding system could further improve the reproducibility of research findings.
UR - http://www.scopus.com/inward/record.url?scp=84889576309&partnerID=8YFLogxK
U2 - 10.1038/nrclinonc.2013.171
DO - 10.1038/nrclinonc.2013.171
M3 - Review article
C2 - 24080600
AN - SCOPUS:84889576309
SN - 1759-4774
VL - 10
SP - 720
EP - 724
JO - Nature Reviews Clinical Oncology
JF - Nature Reviews Clinical Oncology
IS - 12
ER -