Cherry Picking
What it is
Selectively presenting only the data or evidence that supports your position while ignoring contradictory information.
How it works
Real-world examples
- •A supplement company citing the one study that showed benefits while ignoring ten that showed none.
- •A politician quoting economic statistics from a single favorable month rather than the full trend.
- •A product page showing only five-star reviews while hiding or filtering negative ones.
Historical case studies
Ethical guidelines
- ●Present the full body of evidence, not just the parts that support your case.
- ●Acknowledge contradictory findings and explain why your conclusion still holds.
- ●Meta-analyses and systematic reviews are more trustworthy than individual studies.
How to defend against it
- ►Always ask: "What does the overall evidence say, not just this one data point?"
- ►Search for contradictory evidence independently.
- ►Be suspicious when someone cites a single study rather than the scientific consensus.
From the Defense Playbook
Deliberately generate the reasons your current judgment might be wrong before acting on it, which measurably reduces confirmation-driven error in a way that merely trying to be fair does not.
Whenever you are shown a count ("4,000 complaints", "12 deaths", "9 out of 10 dentists"), ask "out of how many?", because a numerator on its own cannot tell you whether something is common, rare, rising, or falling.
Expose yourself in advance to a weakened, clearly labelled dose of a manipulation technique together with its refutation, so that when the full-strength version arrives you recognize the move instead of being carried by it.
The four-part debunking structure from the Debunking Handbook: state the fact, flag and state the myth once, name the specific reasoning trick that makes the myth misleading, and restate the fact, so the listener leaves with both the correct information and the means to spot the next version.
Before you publish, present, or press an argument, go through it as a hostile reader would, looking for the fallacies and statistical shortcuts you would attack in an opponent, and fix or cut what you find.
When faced with a pile of arguments, ask the other side to name their single best one, or choose it yourself, and examine that one thoroughly, instead of chasing every point or knocking down only the weakest.
Before a campaign, advertisement, fundraising appeal, or pitch goes out, test it against the five TARES duties: Truthfulness of the message, Authenticity of the persuader, Respect for the audience, Equity of the appeal, and Social responsibility for the common good.
Before an A/B test or pilot starts, write down the primary metric, the harm metrics that must not get worse, the sample size or stopping rule, and the planned analysis, so that the result can tell you something you did not already want to hear.
Every playbook entry states how strong its evidence is and when not to use it. Browse the full playbook.
References
- Walton, D. (1999). One-Sided Arguments: A Dialectical Analysis of Bias. State University of New York PressArgumentation-theoretic account of one-sided advocacy: presenting only evidence favourable to a conclusion while suppressing the counter-evidence, which is the entry's definition of cherry picking.
- Cook, J., Ellerton, P., & Kinkead, D. (2018). Deconstructing climate misinformation to identify reasoning errors. Environmental Research Letters, 13(2), 024018Identifies cherry picking as a recurring misinformation technique and shows how selectively chosen data points produce a misleading but evidence-looking narrative — the entry's claim that the audience sees only half the picture.