Peer Review Term Analysis

Every scientific paper and report has to go through the critical scrutiny of other experts: peer review. Scientific authors are required to take reviewers’ comments and criticisms seriously, and to fix any mistakes that may have been found. It’s a foundational ethic of scientific work: no claim can be considered valid—not even potentially valid—until it has passed peer review.

Scientists are confident they know bad science when they see it. It’s science that is obviously fraudulent—when data have been invented, fudged, or manipulated. Bad science is where data have been cherry-picked—when some data have been deliberately left out—or it’s impossible for the reader to understand the steps that were taken to produce or analyze the data. It is a set of claims that can’t be tested, claims that are based on samples that are too small, and claims that don’t follow from the evidence provided. And science is bad—or at least weak—when proponents of a position jump to conclusions on insufficient or inconsistent data.