Reference: 9 of 12
Test Set
A test set is a few real jobs you run the workflow on every time you change it: a typical one, an easy one and a tricky one. Running the same set each time shows whether a change helped or broke something.
Test set
Pick a few real jobs, easy, typical and tricky, and write down what a good result looks like first.
In a Real Template
The meeting notes template comes with three samples, invented so that no real people appear. They are the template’s test set.
A weekly program team meetingA short check-in with three plain outcomesVague, overlapping notes with no dates and a few unclear ownersWhat to notice: The tricky sample has dates like “next Thursday”, a decision that was reversed and an owner who is away. It is where a weak step shows up, so it is in the set on purpose.
From the template Turn meeting notes into decisions and actions.
Easy to Mix Up
- A sampleOne invented input. A test set is a few samples chosen to include an easy, a typical and a tricky case.
- A run recordThe note of one run on one sample. The test set is what you run; the records are what you keep.
- A scoring guideThe test set is the material; the scoring guide says what good looks like on it.