EvidenceSheet
NIST AI RMF 1.0 · MEASURE - NIST AI RMF 1.0

MS-2.4 The functionality and behavior of the AI system and its components, as identified in the MAP function, are…

The functionality and behavior of the AI system and its components – as identified in the MAP function – are monitored when in production. Production monitoring covers the functionality and behaviour that mapping identified as consequential, so drift away from the design assumptions is detected while running.

Source: NIST AI RMF 1.0, MS-2.4. The statement above is our statement of the clause, read from the published text and cited so you can check it against the official text, not the instrument verbatim. Open NIST AI RMF 1.0 in the compliance library.

4
artefacts
1
held by a system
1
at each review
moderate
to go live
SIEM / log platform
where the evidence lives
teal = a system already holds it · olive = produced at each review. To go live: easy when half or more of the artefacts are already held by a system, moderate from a quarter to a half, hard below a quarter.

These are the artefacts auditors commonly ask for on this requirement, our guidance rather than text from the standard. Your assessor decides what is sufficient in your context, and asks for samples across the period when a report covers one.

system holds itEvidence a system already holds

  • The production monitoring configuration and what it observes · SIEM / log platform

periodic reviewEvidence produced at each review

  • Drift detection results and the thresholds applied · Document repository

governing documentDocuments that govern the control

  • Traceability from monitored signals to the behaviours mapping identified · Document repository
  • Alerting and the named recipients of monitoring output · Policy repository / GRC workspace

First move

Start with the 1 of 4 artefacts that already live in a system (SIEM / log platform); keep the periodic reviews but log each one as a dated record with a named reviewer.

Common gaps auditors find

Do this for your whole sheet

Paste the rows you run your controls from and get this mapping for every control at once, with the periodic-review ones flagged and a first move per row. No account for the first run.

Build my evidence sheet

MS-2.3 AI system performance or assurance criteria are measured qualitatively or quantitatively and demonstrated for… · MS-2.5 The AI system to be deployed is demonstrated to be valid and reliable, and limitations of the…