Writing a good check

A good check is one a stranger could run and get the same answer. It has four parts.

  1. 1What it looks at
    One thing, in the draft. Not "quality", but "the dates" or "the first paragraph".
    For example: The dates in the draft.
  2. 2What it compares to
    The source it must match, the list it must have, or the guide it is rated against.
    For example: The dates in the grant letter.
  3. 3Who runs it
    A template can count it, a second look by your AI can read it, or you must look.
    For example: Counted automatically.
  4. 4What happens on a fail
    It says what failed, shows the fix, and leaves the decision to you.
    For example: Shows the date in the letter and asks you to change it.

From vague to checkable

  • Vague: Make sure the numbers are right.Right by whose measure? A stranger could not run it.
    Checkable: Every number in the summary appears in the source table, exactly as written.Kind of check: Compare to the source
  • Vague: Check for quality.There is nothing to look at, and nothing to compare to.
    Checkable: The ask is in the first paragraph.Kind of check: Checklist
  • Vague: Is it professional?Everyone will answer differently.
    Checkable: Rate the tone against the guide: plain words, no slang, no hype. Quote the line that shows it.Kind of check: Scoring guide
  • Vague: Nothing is missing.Missing compared to what?
    Checkable: The draft states a deadline, a cost and an owner, each once.Kind of check: Checklist
  • Vague: Looks fine to me.It checks nothing a second person could repeat.
    Checkable: A person reads the dates and promises, and signs off before it is sent.Kind of check: A person looks
  • Vague: Do not make things up.It cannot be checked as written.
    Checkable: Every named study, quote or person can be found in the material you gave the AI.Kind of check: Compare to the source

Four steps to write one

  1. 1
    Start from a mistake you have seen
    A real mistake is the best starting point. Write down what the AI got wrong, in one sentence.
  2. 2
    Name the one thing it looks at
    If the check looks at two things, make it two checks.
  3. 3
    Say what it compares to
    A source, a list or a guide. Without one, only a person can run it.
  4. 4
    Say who runs it, and what a fail shows
    Counted, a second look by your AI, or you. On a fail, show the fix.

Test your check

  • Could someone else run it and get the same answer?
  • Does it look at one thing?
  • Does it say what it compares to?
  • Does a fail show the fix?

More in Quality

Quality home
  • Spot the mistake
    Six AI summaries with planted mistakes. Find them, then see why.
  • Prompt before and after
    Slide from a vague prompt to a well-built one and see what came back.
  • Watch a check run
    See a template check a draft, one check at a time, and the four kinds of check.
  • Trace the number
    Click a claim and find the source line it came from, or does not.
  • Diagnose and fix
    Pick what went wrong in a draft, then see where it is and what good looks like.
  • Check it yourself
    Paste your own AI output and run a template's checks on it, in your browser.
  • Common AI mistakes
    The six mistakes AI makes most, each with an example and how to catch it.
  • Scoring guides
    Rate work against what good looks like. Three free guides to download.