Skip to main content

How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data

🧐 Skeptical/Critical β†—
Fanelli, Daniele β€’ 2009 Modern Era β€’ methodology

Plain English Summary

Ever wonder how many scientists play fast and loose with their data? This landmark study -- the first of its kind -- pulled together 21 surveys asking researchers about misconduct. The headline number: about 2% of scientists admitted they had fabricated, falsified, or fudged data at least once. That might sound small, but here's where it gets jaw-dropping -- up to a third admitted to "questionable research practices" (things like cherry-picking data or tweaking methods after seeing results). And when asked about their colleagues? A stunning 72% said they'd witnessed these dodgy practices. Medical researchers were the worst offenders. The author emphasizes these are almost certainly underestimates, since people tend to downplay their own bad behavior. This provides crucial context for evaluating fraud accusations in any scientific field.

Abstract

The frequency with which scientists fabricate and falsify data, or commit other forms of scientific misconduct is a matter of controversy. Many surveys have asked scientists directly whether they have committed or know of a colleague who committed research misconduct, but their results appeared difficult to compare and synthesize. This is the first meta-analysis of these surveys. To standardize outcomes, the number of respondents who recalled at least one incident of misconduct was calculated for each question, and the analysis was limited to behaviours that distort scientific knowledge: fabrication, falsification, ''cooking'' of data, etc… Survey questions on plagiarism and other forms of professional misconduct were excluded. The final sample consisted of 21 surveys that were included in the systematic review, and 18 in the meta-analysis. A pooled weighted average of 1.97% (N = 7, 95%CI: 0.86–4.45) of scientists admitted to have fabricated, falsified or modified data or results at least once –a serious form of misconduct by any standard– and up to 33.7% admitted other questionable research practices. In surveys asking about the behaviour of colleagues, admission rates were 14.12% (N = 12, 95% CI: 9.91–19.72) for falsification, and up to 72% for other questionable research practices. Meta-regression showed that self reports surveys, surveys using the words ''falsification'' or ''fabrication'', and mailed surveys yielded lower percentages of misconduct. When these factors were controlled for, misconduct was reported more frequently by medical/pharmacological researchers than others. Considering that these surveys ask sensitive questions and have other limitations, it appears likely that this is a conservative estimate of the true prevalence of scientific misconduct.

Links

Related Papers

More in Methodology

πŸ“‹ Cite this paper
APA
Fanelli, Daniele (2009). How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data. PLoS ONE. https://doi.org/10.1371/journal.pone.0005738
BibTeX
@article{fanelli_2009_how_many,
  title = {How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data},
  author = {Fanelli, Daniele},
  year = {2009},
  journal = {PLoS ONE},
  doi = {10.1371/journal.pone.0005738},
}