MS-2.13 Effectiveness of the employed TEVV metrics and processes in the MEASURE function are evaluated and documented
Effectiveness of the employed TEVV metrics and processes in the MEASURE function are evaluated and documented. The evaluation apparatus is itself evaluated, for whether the metrics still discriminate, whether they are being optimised against, and whether they carry unexamined assumptions.
Source: NIST AI RMF 1.0, MS-2.13. The statement above is our statement of the clause, read from the published text and cited so you can check it against the official text, not the instrument verbatim. Open NIST AI RMF 1.0 in the compliance library.
These are the artefacts auditors commonly ask for on this requirement, our guidance rather than text from the standard. Your assessor decides what is sufficient in your context, and asks for samples across the period when a report covers one.
system holds itEvidence a system already holds
none for this control
periodic reviewEvidence produced at each review
- Evaluation of whether the TEVV metrics remain effective and discriminating · Policy repository / GRC workspace
- Review of assumptions embedded in the measurement approach · Document repository
governing documentDocuments that govern the control
- Consideration of gaming, saturation and drift in the metrics themselves · Policy repository / GRC workspace
- Changes made to TEVV processes as a result · Document repository
First move
Common gaps auditors find
- Metrics never questioned once adopted
- Metric saturation read as system improvement
- Effectiveness review performed by the team whose work the metrics judge
Do this for your whole sheet
Paste the rows you run your controls from and get this mapping for every control at once, with the periodic-review ones flagged and a first move per row. No account for the first run.
Build my evidence sheetMS-2.12 Environmental impact and sustainability of AI model training and management activities as identified in the… · MS-3.1 Approaches, personnel, and documentation are in place to regularly identify and track existing…