Skip to main content
Industry Playbooks

SMT AI inspection acceptance: false calls, missed defects and review effort

Define inspected units, defect references and operating conditions. Evaluate false calls among good parts, misses among defective parts, total review volume and complete operator effort before agreeing release, recovery and ownership.

By

Tenten AI Delivery Team

Industry Delivery

Published

Updated

Read time

3 min

SMT AI inspection acceptance: false calls, missed defects and review effort

For an SMT AI inspection change, establish what quality and operations owners will accept: products, defects, capture and line conditions, and how outputs affect release, rejection or manual review.

Reducing unnecessary review can be a goal alongside required defect control. Acceptance evidence covers misses, false calls and complete operating effort, not usage or inspection graphics alone.

Establish units and reference labels

Choose boards, components or defects as the measurement unit without mixing denominators. Define defect classes, severity, applicable products and reference classification. Record annotators, disagreements and reviewed outcomes.

Cover relevant good and defective material across products, batches, materials, equipment and lighting. Collecting only machine-rejected parts that operators override misses defective material that was accepted and cannot evaluate the complete inspection path.

Keep representative evaluation material independent of tuning data. Record camera, model, rule and line versions, then assess applicability to new batches or lines through their actual differences.

Define each denominator

ObservationDenominator and recordsAcceptance question
False-positive rateReference-good units rejected / all reference-good unitsIs rejection of good material acceptable?
False-negative rateReference-defective units accepted / all reference-defective unitsWhich defects are missed and with what consequences?
Total rejection or review volumeRejected/reviewed units / all inspected units, plus countsDoes review work fit available capacity?
Complete operator effortReview, confirmation, rework and exceptions by role/periodIs work removed or transferred elsewhere?
Downstream defects and complaintsShipment scope, observation window, reporting and traceabilityWhich quality issues need investigation?

False positives among good units differ from false rejects as a share of all inspected units. Multiplying the former by all boards does not directly estimate review volume. Complaints can be delayed, unreported or detected elsewhere; they are not complete missed-defect ground truth. Trace them separately to units and inspection conditions.

Separate scores, actions and acceptance

Specify the score meaning and its mapping to release, review or rejection. If higher scores mean more likely defective and scores at or above a cutoff trigger rejection, raising that cutoff on fixed evaluation data reduces rejections and may increase misses. Inspect results by defect and severity.

The threshold guide separates score estimation from action selection and warns against tuning on training data. Two error-rate targets are not automatically two executable score cutoffs. A pass/review/reject policy requires explicit intervals and ownership.

Confidence values and boxes help inspect outputs; they do not establish correct judgments or calibrated scores. Authorized quality owners approve changes and release. Review feedback before using it for adjustments, then evaluate affected conditions.

Accept the whole path and operation

Measure inspection, transfer, review and exception handling together. Establish line-speed/capacity needs, outages, uncertain results and recovery. Keep change, evaluation and rollback versions; name annotation, quality acceptance, maintenance and floor-support owners.

Released time is capacity that needs comparison with actual staffing and expenses before estimating cash benefit. Report usage separately from quality and workload. The voluntary NIST AI RMF supports lifecycle risk work; acceptance still depends on the product, risks and evidence.

Read the manufacturing inspection guide for methods and interfaces, or the existing manufacturing solution for samples, validation and integration scope.

Share

Summarize this page with AI

Start with one workflow.
Agree on the next step.

Leave your contact details and question type. We will follow up by email to understand the work and discuss scope.