This is a common tension between operational efficiency and audit optics. Here’s my perspective after implementing quality systems across multiple regulated industries:
What Auditors Actually Care About:
- Competency Evidence - Can you prove qualified personnel are involved in quality decisions?
- Decision Traceability - Is there clear record of who/what approved the product?
- Exception Handling - What happens when automated rules encounter edge cases?
- System Validation - Has the automated workflow been validated against your quality procedures?
Automation Acceptance Factors:
Auditors generally accept automated workflows when you demonstrate:
- The workflow logic directly implements documented quality procedures
- Validation evidence shows the system correctly applies acceptance criteria
- Audit trails capture all decision points with timestamps and user context
- Human oversight exists for exception conditions
- Periodic review confirms workflow effectiveness
Practical Implementation Approaches:
Option 1: Risk-Based Hybrid
Classify quality characteristics by risk level. Use ISO 14971 risk assessment methodology:
- Low risk: Fully automated approval
- Medium risk: Automated with exception flagging for human review
- High risk: Always require qualified person approval
In Odoo, implement this through quality point configuration with different workflow paths based on characteristic criticality.
Option 2: Supervised Automation
Automate data collection and initial assessment, but require quality personnel to review and confirm automated decisions. The human doesn’t re-measure, they verify the automated decision makes sense given the data. This satisfies competency requirements while maintaining efficiency.
Implement a quality review queue where inspectors batch-approve automated assessments. They can override if something looks wrong.
Option 3: Statistical Release with Audit
Use automated workflows for real-time production decisions, but implement statistical sampling audits by quality engineers. They periodically review automated decisions to verify correctness. Document this as your ongoing validation program.
Addressing Your Specific Audit Finding:
The “evidence of review” concern can be addressed without abandoning automation:
- Implement electronic signature module for quality approvals
- Configure workflow to require quality engineer sign-off for first article inspections, even if automated checks pass
- Add a review step for any inspection where multiple characteristics are measured - automated assessment plus human verification
- Create quality review dashboards showing trending data - have quality engineers review and acknowledge these weekly
Documentation Package for Auditors:
Prepare a validation package for your automated workflows:
- Quality procedure defining acceptance criteria
- Workflow logic specification showing how system implements procedure
- Validation test cases with expected vs actual results
- Traceability matrix linking requirements to workflow steps
- Change control process for workflow modifications
- Training records for personnel who configure workflows
- Periodic effectiveness review reports
Specific to AS9100:
Aerospace standard requires objective evidence of conformance. Automated measurement data IS objective evidence. But AS9100 also emphasizes competent personnel. Solution: Have your quality engineers review statistical summaries of automated inspections and sign off that the system is operating correctly. This demonstrates ongoing oversight by competent personnel without requiring approval of every individual measurement.
My Recommendation:
Don’t abandon your automated workflows - they provide better data integrity than manual processes. Instead, add a lightweight review layer:
- Keep automated data collection and initial assessment
- Add quality engineer review dashboard showing flagged conditions
- Require sign-off on statistical summaries (daily or per batch)
- Implement mandatory review for any out-of-trend conditions
- Document your workflow validation thoroughly
This gives you efficiency of automation plus the human oversight evidence auditors want to see. The key is framing it as “supervised automation” rather than “fully autonomous” - humans are still in the loop, just at a supervisory level rather than transactional level.
Also consider your auditor’s industry experience. Some auditors come from paper-based quality backgrounds and are inherently skeptical of automation. Educate them on your validation approach and show them the superior traceability of electronic systems versus paper travelers.