MS-2.1 Test sets, metrics, and details about the tools used during test, evaluation, validation, and verification…
Test sets, metrics, and details about the tools used during test, evaluation, validation, and verification (TEVV) are documented. The TEVV record is complete enough for the evaluation to be repeated: which test sets, which metrics, which tools and which versions.
Source: NIST AI RMF 1.0, MS-2.1. The statement above is our statement of the clause, read from the published text and cited so you can check it against the official text, not the instrument verbatim. Open NIST AI RMF 1.0 in the compliance library.
These are the artefacts auditors commonly ask for on this requirement, our guidance rather than text from the standard. Your assessor decides what is sufficient in your context, and asks for samples across the period when a report covers one.
system holds itEvidence a system already holds
none for this control
periodic reviewEvidence produced at each review
- Tools and versions used during evaluation · Document repository
governing documentDocuments that govern the control
- Documentation of the test sets used, including provenance and composition · Document repository
- The metrics computed and their definitions · Policy repository / GRC workspace
- Sufficient detail for the evaluation to be repeated by someone else · Document repository
First move
Common gaps auditors find
- Results reported with the test set identified only by filename
- Metric named but not defined, so results are not comparable across runs
- Tooling versions unrecorded, so a result cannot be reproduced
Do this for your whole sheet
Paste the rows you run your controls from and get this mapping for every control at once, with the periodic-review ones flagged and a first move per row. No account for the first run.
Build my evidence sheetMS-1.3 Internal experts who did not serve as front-line developers for the system and independent assessors are… · MS-2.2 Evaluations involving human subjects meet applicable requirements including human subject protection and are…