Evaluation
Confusion-matrix calculator
Calculate defect precision, recall, false-alarm rate, and accuracy from reviewed examples.

Work through the numbers
Related tools
Pilot acceptance worksheet
Write down the evidence for a ship, extend, or stop decision before seeing the results.
Holdout split checklist
Look for duplicate or adjacent images that could make your test result look better than it is.
Reviewer disagreement log
Capture disagreements, the observed evidence, and the rule that resolves them.