MS-3.3 Feedback processes for end users and impacted communities to report problems and appeal system outcomes are…
Feedback processes for end users and impacted communities to report problems and appeal system outcomes are established and integrated into AI system evaluation metrics. End users and impacted communities have a working route to report problems and appeal an outcome, and what arrives through it feeds the evaluation metrics rather than a separate queue.
Source: NIST AI RMF 1.0, MS-3.3. The statement above is our statement of the clause, read from the published text and cited so you can check it against the official text, not the instrument verbatim. Open NIST AI RMF 1.0 in the compliance library.
These are the artefacts auditors commonly ask for on this requirement, our guidance rather than text from the standard. Your assessor decides what is sufficient in your context, and asks for samples across the period when a report covers one.
system holds itEvidence a system already holds
none for this control
periodic reviewEvidence produced at each review
- Records of problems reported and appeals lodged, with outcomes · Document repository
- Evidence the route is discoverable by the people expected to use it · Document repository
governing documentDocuments that govern the control
- The reporting and appeal route available to end users and impacted communities · Document repository
- The integration of that feedback into evaluation metrics · Policy repository / GRC workspace
First move
Common gaps auditors find
- Appeal route exists in policy but is not reachable from the point of the decision
- Reports handled as customer service tickets with no route into evaluation
- No appeal available where the decision is automated and consequential
Do this for your whole sheet
Paste the rows you run your controls from and get this mapping for every control at once, with the periodic-review ones flagged and a first move per row. No account for the first run.
Build my evidence sheetMS-3.2 Risk tracking approaches are considered for settings where AI risks are difficult to assess using currently… · MS-4.1 Measurement approaches for identifying AI risks are connected to deployment contexts and informed through…