Spot the mistake

An AI summarized each document below, and planted three mistakes in it. Read what the AI was given, click the sentences you think are wrong, then check.

  1. 1Staff survey summaryAn AI summarized a staff survey. Three mistakes planted.Start
  2. 2Meeting notesAn AI wrote up a team meeting. Three mistakes planted.Start
  3. 3A funder reportAn AI drafted a progress report for a funder. Three mistakes planted.Start
  4. 4A client briefAn AI summarized a client brief. Three mistakes planted.Start
  5. 5A research summaryAn AI summarized a short study. Three mistakes planted.Start
  6. 6A policy memoAn AI summarized a leave policy for staff. Three mistakes planted.Start

Six kinds of mistake to look for

Common AI mistakes
  • Wrong or made-up number
    A figure that is not in the material, or one that was changed on the way.
    The AI wrote: The ad budget was approved at $20,000.
    The source: The notes say $2,000. A zero was added.
  • Cause and effect claimed
    Two things that happen together are described as one causing the other.
    The AI wrote: The new meeting schedule caused the rise in workload complaints.
    The source: The survey shows the two went up together. Nothing in it says one caused the other.
  • Made-up source
    A study, expert, standard or quote that was never in the material.
    The AI wrote: This matches the 2023 Workplace Benchmark Study.
    The source: No benchmark study appears anywhere in what the AI was given.
  • Merged figures
    Numbers from different questions, groups or years are blended into one.
    The AI wrote: 72% of staff feel supported by their manager.
    The source: One question says 54%. A different question says 90%. The 72% is not in the survey.
  • Missing part
    Something the reader needs was left out, or an open gap was filled with a guess.
    The AI wrote: Priya will book the venue.
    The source: The notes say no one is sure who books the venue. The AI should have flagged the gap.
  • Scope creep
    The AI adds something that was not asked for or not in the material.
    The AI wrote: The board asked for weekly updates on the launch.
    The source: The notes never mention the board.

Templates with these checks built in:Write a summary of a long documentTurn meeting notes into decisions and actions

More in Quality

Quality home