MS-2.11 Fairness and bias as identified in the MAP function is evaluated and results are documented
Fairness and bias – as identified in the MAP function – is evaluated and results are documented. Fairness evaluation states which fairness definition was applied and why, evaluates against it, and records the results including where the definition itself is contested.
Source: NIST AI RMF 1.0, MS-2.11. The statement above is our statement of the clause, read from the published text and cited so you can check it against the official text, not the instrument verbatim. Open NIST AI RMF 1.0 in the compliance library.
These are the artefacts auditors commonly ask for on this requirement, our guidance rather than text from the standard. Your assessor decides what is sufficient in your context, and asks for samples across the period when a report covers one.
system holds itEvidence a system already holds
none for this control
periodic reviewEvidence produced at each review
none for this control
governing documentDocuments that govern the control
- The fairness definition or definitions applied and the reason for choosing them · Document repository
- Evaluation results disaggregated across the relevant groups · Document repository
- Identification of the groups assessed and the basis for that selection · Document repository
- Documentation of trade-offs where fairness definitions conflict · Document repository
First move
Common gaps auditors find
- A single fairness metric applied with no argument that it fits the context
- Groups assessed limited to those for which attribute data happened to exist
- Disparity measured and documented with no decision recorded about it
Do this for your whole sheet
Paste the rows you run your controls from and get this mapping for every control at once, with the periodic-review ones flagged and a first move per row. No account for the first run.
Build my evidence sheetMS-2.10 Privacy risk of the AI system as identified in the MAP function is examined and documented · MS-2.12 Environmental impact and sustainability of AI model training and management activities as identified in the…