How an inspection pilot works
Scope a single check, collect examples, evaluate the results, and decide what the next release needs.
Discuss an inspection pilot
Four parts of a pilot
Scope the decision
Agree on a unit of inspection, a visible feature, and what would make an example uncertain. Name the reviewer who can resolve disagreements.
Plan samples
Collect ordinary and difficult cases across relevant shifts, lots, and capture conditions. Keep repeated views of one physical unit together when splitting the data.
Evaluate the check
Compare candidate decisions to references on a held-out set. Track misses, false alarms, review workload, and captures without enough evidence.
Review the handoff
Share the scope, error examples, and next-step recommendation. Write down the conditions that would call for a new review.