EvidenceSheet
NIST AI RMF 1.0 · MEASURE - NIST AI RMF 1.0

MS-1.2 Appropriateness of AI metrics and effectiveness of existing controls is regularly assessed and updated…

Appropriateness of AI metrics and effectiveness of existing controls is regularly assessed and updated including reports of errors and impacts on affected communities. The metrics themselves are re-examined on a cycle for whether they remain appropriate, informed by reported errors and by impacts on affected communities.

Source: NIST AI RMF 1.0, MS-1.2. The statement above is our statement of the clause, read from the published text and cited so you can check it against the official text, not the instrument verbatim. Open NIST AI RMF 1.0 in the compliance library.

4
artefacts
1
held by a system
1
at each review
moderate
to go live
Document repository
where the evidence lives
teal = a system already holds it · olive = produced at each review. To go live: easy when half or more of the artefacts are already held by a system, moderate from a quarter to a half, hard below a quarter.

These are the artefacts auditors commonly ask for on this requirement, our guidance rather than text from the standard. Your assessor decides what is sufficient in your context, and asks for samples across the period when a report covers one.

system holds itEvidence a system already holds

  • The trigger conditions, such as drift or changed operating setting, that force a re-assessment · Document repository

periodic reviewEvidence produced at each review

  • Records of periodic assessment of metric appropriateness and control effectiveness · Policy repository / GRC workspace

governing documentDocuments that govern the control

  • Error reports and community impact reports considered in that assessment · Document repository
  • Changes made to metrics or controls as a result · Policy repository / GRC workspace

First move

Start with the 1 of 4 artefacts that already live in a system (Document repository); keep the periodic reviews but log each one as a dated record with a named reviewer.

Common gaps auditors find

Do this for your whole sheet

Paste the rows you run your controls from and get this mapping for every control at once, with the periodic-review ones flagged and a first move per row. No account for the first run.

Build my evidence sheet

MS-1.1 Approaches and metrics for measurement of AI risks enumerated during the MAP function are selected for… · MS-1.3 Internal experts who did not serve as front-line developers for the system and independent assessors are…