# Find themes in comments or interview notes: scoring guide

Read a set of comments, survey answers or interview notes, label each one, group the labels into themes, then count each theme and back it with two real quotes.

## How to use it

1. Run the template on your own material, or take an answer you already have.
2. For each criterion below, read the answer against the two lines and tick one: meets or does not meet. Quote what you saw.
3. A criterion marked "checked by you" is yours to mark. An AI cannot meet it for you.
4. Count the ticks for meets, out of 7. Fix the first criterion that is not met and run the guide again.

## The guide

### 1. Every quote is really in the comments

A plain rule you can check by eye.

- Meets: Every quote beside a comment is words that are really in that comment.
- Does not meet: A quote is paraphrased, joined from two comments, or not in the comments.
- Your mark: [ ] Meets  [ ] Does not meet
- What you saw:

### 2. Every theme names its comments

A plain rule you can check by eye.

- Meets: Every theme has a name and the numbers of the comments in it.
- Does not meet: A theme has no name or no comment numbers.
- Your mark: [ ] Meets  [ ] Does not meet
- What you saw:

### 3. Every first quote is really in the comments

A plain rule you can check by eye.

- Meets: The first quote of every theme is really in the comments.
- Does not meet: A first quote is reworded or is not in the comments.
- Your mark: [ ] Meets  [ ] Does not meet
- What you saw:

### 4. Every second quote is really in the comments

A plain rule you can check by eye.

- Meets: The second quote of every theme is really in the comments.
- Does not meet: A second quote is reworded or is not in the comments.
- Your mark: [ ] Meets  [ ] Does not meet
- What you saw:

### 5. Every theme has a count and two quotes

A plain rule you can check by eye.

- Meets: Every theme row has a count and two quotes.
- Does not meet: A theme row is missing its count or one of its quotes.
- Your mark: [ ] Meets  [ ] Does not meet
- What you saw:

### 6. The total matches the number of comments

Checked by a second AI prompt.

- Meets: The total equals the number of comments, and the theme counts plus the one-off comments add up to it.
- Does not meet: The total is not the number of comments, or the counts leave comments out or count one twice.
- Your mark: [ ] Meets  [ ] Does not meet
- What you saw:

### 7. The themes fit what people said

Checked by you.

- Meets: You read the themes and a few quotes under each, and each theme says what its quotes say.
- Does not meet: A theme says more than its quotes do, or an important point is missing or lost inside a bigger theme.
- Your mark: [ ] Meets  [ ] Does not meet
- What you saw:

## Your result

Met ___ of 7

---

From Logic Lab (logiclabhq.com). Free to use and adapt, with credit.