LogicalMANIPULATIVE

Cherry-Picked Time Window

What it is

Choosing the start and end points of a data series after looking at the data, so that the visible span shows the rise, fall or flat line the presenter wants and a longer or shifted window would contradict.

How it works

Any noisy series contains sub-windows that trend up, down and sideways; the presenter who chooses the window chooses the conclusion. The move works because audiences treat the span as given — the calendar year, “since the policy took effect”, “the last decade” — rather than as a decision made with the answer in hand, and because the endpoints anchor the comparison: start at a trough and everything after is growth, start at a peak and everything after is decline. A worked illustration: a stock that falls 40 percent and then recovers 30 percent is “up 30 percent” from its low and down 22 percent from its high; both windows are accurate and only one is the truth an investor needs. The tell is a start date that coincides with an extreme, a window that ends just before an inconvenient turn, or a comparison period that shifts between the sentences of the same speech. Legitimate analysis fixes the window before seeing the result — a policy date, a full business cycle, a standard reporting period — and shows the longer series for context. Choosing the window afterward is cherry-picking with a calendar.

Real-world examples

  • •Global surface temperature series that start in 1998, an exceptionally warm El Niño year, showed a “pause” in warming through the early 2010s; the same data starting in 1997 or 1999 show a continuing rise. The window, not the thermometer, produced the pause.
  • •The 2012 Obama campaign's bar chart of monthly private-sector job changes began in January 2008, showing the deep losses of the final Bush year followed by gains; critics noted the chart ended where the story was best and omitted public-sector losses. From 2018 the Trump White House reported job and growth figures “since the election” or “since inauguration”, windows that started inside an expansion already several years old.
  • •Fund marketing quotes returns “since inception” when inception followed a crash, and quotes one-, three- or five-year returns depending on which flatters the fund this quarter; the window changes with the number, not the other way round.
  • •In the 2024 US campaign, one side cited FBI figures showing violent crime falling from 2022 to 2023 while the other cited the Bureau of Justice Statistics victimization survey showing a rise in 2022; each was a real statistic from a different source, definition and window, and each was chosen because of what it showed.

Ethical guidelines

  • ●Fix the window before you see the result, for a stated reason (a policy date, a full cycle, a standard period), and say what the reason is.
  • ●Show the longer series alongside the window you are discussing so the reader can see what the window excludes.
  • ●If the conclusion reverses under a start date one year earlier or later, it is not a finding about the world; do not present it as one.
  • ●Use the same window for your side and the other side of a comparison.

How to defend against it

  • ►Ask why the series starts where it starts. If the start coincides with a peak, a trough or a change of government, ask to see it from a different origin.
  • ►Ask what happens to the claim if the window moves one year in either direction; a robust trend survives, a manufactured one flips.
  • ►Look for the longer series yourself — the underlying agency data usually covers decades — and check whether the chosen span is typical or extreme.
  • ►Notice window-shifting within one argument: “up since 2019” in one sentence and “down since 2021” in the next is two cherry-picks, not one analysis.
  • ►Treat “since inception”, “since the election” and “over the last N months” as choices requiring justification, not as neutral defaults.

From the Defense Playbook

Check the Dateseconds

Before reacting to a story, photo, or video, find out when it was first published or recorded, because genuine but old material recirculated as if it were new is one of the cheapest and most common forms of misinformation.

Fact, Myth, Fallacy, Factminutes

The four-part debunking structure from the Debunking Handbook: state the fact, flag and state the myth once, name the specific reasoning trick that makes the myth misleading, and restate the fact, so the listener leaves with both the correct information and the means to spot the next version.

Fallacy Audit of Your Own Caseminutes

Before you publish, present, or press an argument, go through it as a hostile reader would, looking for the fallacies and statistical shortcuts you would attack in an opponent, and fix or cut what you find.

Decide Metrics Before Testingminutes

Before an A/B test or pilot starts, write down the primary metric, the harm metrics that must not get worse, the sample size or stopping rule, and the planned analysis, so that the result can tell you something you did not already want to hear.

Every playbook entry states how strong its evidence is and when not to use it. Browse the full playbook.

References

  1. Huff, D. (1954). How to Lie with Statistics. W. W. Norton
    Early popular treatment of choosing the base period and span of a series to manufacture a trend.
  2. Best, J. (2001). Damned Lies and Statistics: Untangling Numbers from the Media, Politicians, and Activists. University of California Press
    How advocates on every side select the comparison period that serves the claim, and how to ask where a number came from.
  3. Cairo, A. (2019). How Charts Lie: Getting Smarter about Visual Information. W. W. Norton
    Worked examples of charts that mislead through the span of data shown, including partisan cases from more than one side.
  4. Spiegelhalter, D. (2019). The Art of Statistics: How to Learn from Data. Pelican
    The general discipline of asking how a number was produced and what was left out before accepting the trend it claims.
Last reviewed
Suggest a correction

Detect Cherry-Picked Time Window in any text

Paste any message, email, or article into our free Manipulation Detector to see if Cherry-Picked Time Window or other techniques are being used on you.

Try the Detector FreeCreate Free Account