Model audit
Regular audit of every live model and decision component.
Continuous monitoring tells you whether a model is working as expected; an audit asks whether the model is still doing the right job. All models and decision components running live are reviewed quarterly.
Model card
- Model review
- Quarterly
- Policy review
- Annually
- Event-driven
- ≤10 business days
- Independence
- Authors can't audit
What does it do?
Roles
Reviewer, component owner and approver are separate.
Independence
A reviewer cannot be the author of the change they audit.
Inventory from the system
The configuration running live is checked, not what has been declared.
Measurement review
Sample thresholds and confidence intervals are checked.
Event triggers
When decision authority expands or a new model goes live.
Record
Every audit is put on record.
How does it work, step by step?
- 1
Stage 1
Preparation
Scope and period are fixed.
- 2
Stage 2
Inventory
Running models and versions are listed.
- 3
Stage 3
Measurement
Shadow and rollout reports are read.
- 4
Stage 4
Findings
Findings are classified.
- 5
Stage 5
Record
The audit record is written and approved.
Meet Model audit.
Let's review with our team how the model would work in your business.