INDUSTRY FIELD GUIDE
Tutoring question and explanation data for AI
Changing a number or condition can make an old answer explanation wrong even if the question looks familiar.
NAICS 611691 · Exam Preparation and Tutoring
Changing a number or condition can make an old answer explanation wrong even if the question looks familiar. IES summarizes tutoring evidence. A tutoring provider can make an independent evaluation set with deliberately altered original questions and instructor-reviewed explanations. IES peer tutoring evidence
Write two original problem variants and a solution for each. Attach a superseded explanation to one and leave another explanation incomplete. Ask the assistant which condition changed, which answer follows, and what evidence is missing. Keep a reviewer’s solution separate from model input until scoring.
Use no official tests, test-preparation bank items, learner submissions, scores, or publisher material without permission. All questions and responses should be independently created for the sample.
Describe a tutoring evaluation sample
Original Fiund exercise
A changed condition can invalidate a familiar explanation
An instructor independently writes simple fictional token problems. The answer key is withheld from model inputs until evaluation; no test-bank or learner material is used.
| Record | Source | What it records |
|---|---|---|
| TU1 | Original problem A | A box starts with 8 tokens and gains 3. Ask its final count. Reviewed explanation A gives 8+3=11. |
| TU2 | Revised problem B | The same box starts with 8 tokens and loses 3. Attached explanation still says 8+3=11. |
| TU3 | Problem C draft explanation | Starts with 8 and loses 3, then gains 2. Explanation stops after 8−3=5 and supplies no final count. |
Question for the model
Which explanation is stale, what answer follows for B, and what step remains missing in C's draft?
Show the reference answer and checks
TU2 changes gains to loses, so A's 8+3 explanation is stale for B. B's stated condition gives 8−3=5 tokens. TU3's intermediate result of 5 addresses the loss but omits the subsequent gain of 2, so its final count would be 7 under the supplied problem. Distinguish a wrong-condition explanation from an incomplete but correct intermediate step.
- Reusing 11 for B because the numbers and wording look familiar.
- Treating C's intermediate 5 as the requested final result or marking every intermediate statement false.
Fields to preserve
- Exact problem version and operation
- Captures the condition that changes the reasoning.
- Explanation-to-item link
- Prevents reuse of a superseded answer.
- Intermediate and final states
- Distinguishes incomplete reasoning from an incorrect step.
Test another case
Write a new problem where the change is a conditional instruction rather than an arithmetic sign. Check whether the model cites the changed condition before applying an answer pattern.
Use independently authored questions, responses and keys. Exclude official tests, publisher banks, actual learner submissions and personal scores.
Discuss a contribution
Describe the sources you control, the task they could support and what has already been checked. Use the existing-data assessment for an archive or the collection brief for a new recording project. The contributor agreement defines Fiund’s licensing authority and compensation. A guide or fictional exercise does not establish an accepted collection or a sale.