Assess compliance

Use the platform UI to assess compliance of your models with guidelines based on analyzing evidence and findings.

Compliance assessments provide an unbiased starting point that enables more efficient discussions between validators and developers and involves three steps:

1. Link evidence to reports
2. Link findings to reports
3. Provide compliance assessments

Prerequisites

• You are logged in to ValidMind.
• The model you are documenting is registered in the model inventory.¹
• A model developer has marked their model documentation as Ready for Validation.²
• You are a Validator or assigned another role with sufficient permissions to perform the tasks in this guide.³

¹ Register models in the inventory

² Submit for approval

³ Manage permissions

Link evidence to reports

1. In the left sidebar, click Model Inventory.

2. Select a model by clicking on it or find your model by applying a filter or searching for it.⁴

3. In the left sidebar that appears for your model, click Validation Report and then locate 2. Validation.

   You can now expand any subsection of the validation report you would like to work with.

   For example, select 2.1.1. Assumptions.

4. In any section of the documentation where the button is available, click Link Evidence to Report.

   

   Validation report section 2.1.1. that shows a compliance assessment with the option to link to evidence

5. On the Link Evidence to Validation Report page that opens, select the evidence that is related to your assessment.

   If you are not sure if something is relevant, you can expand the section by clicking for more details.

6. Click Update Linked Evidence.

   Confirm that the newly linked-to evidence shown under Developer Evidence is accurate.

⁴ Working with the model inventory

Link findings to reports

1. In the left sidebar, click Model Inventory.

2. Select a model by clicking on it or find your model by applying a filter or searching for it.⁵

3. In the left sidebar that appears for your model, click Validation Report and then locate 2. Validation.

   You can now expand any subsection of the validation report you would like to work with.

   For example, select 2.1.1. Assumptions.

4. In any section of the documentation where the button is available, click Link Finding to Report.

   

   Validation report section 2.1.1. that shows a compliance assessment with the option to link to finding

5. On the Link Finding to Report page that opens, select from the list of available findings, or create a new finding.⁶

6. Click Update Linked Findings.

   Confirm that newly linked finding shown under Findings is accurate.

⁵ Working with the model inventory

⁶ Create new finding

Provide compliance assessments

1. In the left sidebar, click Model Inventory.

2. Select a model by clicking on it or find your model by applying a filter or searching for it.⁷

3. In the left sidebar that appears for your model, click Validation Report and then locate 2. Validation.

   You can now expand any subsection of the validation report you would like to work with.

   For example, select 2.1.1. Assumptions.

4. In any section of the documentation where the assessment dropdown menu is available, select one of the available options:

   • No compliance — No tests have been run and no other evidence has been provided.
   • Some compliance — Evidence provided but not properly documented or verifiable.
   • Strong compliance — Evidence provided and documented, but not validated.
   • Full compliance — Evidence provided, documented, and validated.

   For example, to indicate that there is some compliance based on the evidence or findings you linked to:

   

   Validation report section 2.1.1. that shows a compliance assessment with the option to link to finding

   Confirm that the compliance summary shown for each subsection under 2. Validation provides an accurate overview for current qualitative and quantitative risk assessments:

   

   Risk assessment compliance summary

⁷ Working with the model inventory

What’s next

• Collaborate with others
• Working with model findings
• Assign section statuses
• View model activity