EvidenceSheet
NIST AI RMF 1.0 · MEASURE - NIST AI RMF 1.0

MS-2.5 The AI system to be deployed is demonstrated to be valid and reliable, and limitations of the…

The AI system to be deployed is demonstrated to be valid and reliable. Limitations of the generalizability beyond the conditions under which the technology was developed are documented. Validity and reliability are demonstrated before deployment, and the boundary beyond which the demonstration does not carry is written down.

Source: NIST AI RMF 1.0, MS-2.5. The statement above is our statement of the clause, read from the published text and cited so you can check it against the official text, not the instrument verbatim. Open NIST AI RMF 1.0 in the compliance library.

4
artefacts
0
held by a system
2
at each review
hard
to go live
Source control / CI pipeline
where the evidence lives
teal = a system already holds it · olive = produced at each review. To go live: easy when half or more of the artefacts are already held by a system, moderate from a quarter to a half, hard below a quarter.

These are the artefacts auditors commonly ask for on this requirement, our guidance rather than text from the standard. Your assessor decides what is sufficient in your context, and asks for samples across the period when a report covers one.

system holds itEvidence a system already holds

none for this control

periodic reviewEvidence produced at each review

  • Validation results demonstrating validity and reliability prior to deployment · Source control / CI pipeline
  • Evidence that validation failure would prevent deployment · Source control / CI pipeline

governing documentDocuments that govern the control

  • Documented limitations on generalisability beyond the development conditions · Document repository
  • The conditions under which the system was developed and tested · Document repository

First move

No system holds this evidence for you: it is people and documents. Reminders and routing to the owner still save time. Put the document under version control with an owner and review date, and log each review as a record with reviewer and date.

Common gaps auditors find

Do this for your whole sheet

Paste the rows you run your controls from and get this mapping for every control at once, with the periodic-review ones flagged and a first move per row. No account for the first run.

Build my evidence sheet

MS-2.4 The functionality and behavior of the AI system and its components, as identified in the MAP function, are… · MS-2.6 AI system is evaluated regularly for safety risks as identified in the MAP function, is demonstrated to be…