Assess compliance

Use the ValidMind Platform to assess compliance of your models with guidelines based on analyzing evidence and findings.

Compliance assessments provide an unbiased starting point that enables more efficient discussions between validators and developers and involves three steps:

1. Link evidence to reports
2. Link findings to reports
3. Provide compliance assessments

Prerequisites

• You are logged in to ValidMind.
• The model you are documenting is registered in the model inventory.¹
• A model developer has marked their model documentation as Ready for Validation.²
• You are a Validator or assigned another role with sufficient permissions to perform the tasks in this guide.³

¹ Register models in the inventory

² Submit for approval

³ Manage permissions

Link evidence to reports

Link developer evidence

To link evidence logged by developers⁴ to your validation report:

⁴ Get started with the ValidMind Library

1. In the left sidebar, click Inventory.

2. Select a model or find your model by applying a filter or searching for it.⁵

3. In the left sidebar that appears for your model, click Validation Report.

   You can now expand any subsection of the validation report you would like to work with.

   For example, locate 2. Validation then select 2.1.1. Assumptions.

4. In any section of the report where the button is available, click Link Developer Evidence.

   

   Validation report section 2.1.1. that shows a compliance assessment with the option to link to developer evidence

5. On the Link Developer Evidence to Validation Report page that opens, select the evidence that is related to your assessment.

   • Available evidence is associated with the relevant documentation section.
   • If you are not sure if something is relevant, you can expand the section by clicking for more details.

6. Click Update Linked Evidence.

   • Confirm that the newly linked-to evidence shown under Developer Evidence is accurate and is connected to the correct documentation section.
   • Evidence that needs your attention gets flagged with Requires Attention. These sections get flagged automatically whenever a test result is above or below a certain threshold.

⁵ Working with the model inventory

Link validator evidence

To link validator evidence to a report, you must first log tests as a validator with the ValidMind Library.⁶

⁶ Get started with the ValidMind Library

1. In the left sidebar, click Inventory.

2. Select a model or find your model by applying a filter or searching for it.⁷

3. In the left sidebar that appears for your model, click Validation Report.

   You can now expand any subsection of the validation report you would like to work with.

   For example, locate 2. Validation then select 2.1.1. Assumptions.

4. In any section of the report where the button is available, click Link Evidence to Report.

   

   Validation report section 2.1.1. that shows a compliance assessment with the option to link evidence

5. On the Link Validator Evidence to Validation Report page that opens, select the evidence that is related to your assessment.

   If you are not sure if something is relevant, you can expand the section by clicking for more details.

6. Click Update Linked Evidence.

   • Confirm that the newly linked-to evidence shown under Developer Evidence is accurate.
   • Evidence that needs your attention gets flagged with Requires Attention. These sections get flagged automatically whenever a test result is above or below a certain threshold.

⁷ Working with the model inventory

Link findings to reports

1. In the left sidebar, click Inventory.

2. Select a model or find your model by applying a filter or searching for it.⁸

3. In the left sidebar that appears for your model, click Validation Report.

   You can now expand any subsection of the validation report you would like to work with.

   For example, locate 2. Validation then select 2.1.1. Assumptions.

4. In any section of the report where the button is available, click Link Finding to Report.

   

   Validation report section 2.1.1. that shows a compliance assessment with the option to link to finding

5. On the Link Finding to Report modal that opens, select from the list of available findings, or click Create New Finding.⁹

6. Click Update Linked Findings.

   Confirm that newly linked finding shown under Findings is accurate.

⁸ Working with the model inventory

⁹ Create new finding

Provide compliance assessments

1. In the left sidebar, click Inventory.

2. Select a model or find your model by applying a filter or searching for it.¹⁰

3. In the left sidebar that appears for your model, click Validation Report.

   You can now expand any subsection of the validation report you would like to work with.

   For example, locate 2. Validation then select 2.1.1. Assumptions.

4. In any section of the documentation where the assessment dropdown menu is available, select one of the available options:

   • No compliance — No tests have been run and no other evidence has been provided.
   • Some compliance — Evidence provided but not properly documented or verifiable.
   • Strong compliance — Evidence provided and documented, but not validated.
   • Full compliance — Evidence provided, documented, and validated.

   For example, to indicate that there is some compliance based on the evidence or findings you linked to:

   

   Validation report section 2.1.1. that shows a compliance assessment with the option to link to finding

   Confirm that the compliance summary shown for each subsection under 2. Validation provides an accurate overview for current qualitative and quantitative risk assessments:

   

   Risk assessment compliance summary

¹⁰ Working with the model inventory

What’s next

• Collaborate with others
• Working with model findings
• Assign section statuses
• View model activity