Finalizing
Validation Reports

Validator Fundamentals — Module 4 of 4

Click to start

Learning objectives

“As a validator who has logged validation tests with the ValidMind Library to the ValidMind Platform, I want to refine my model’s validation report, submit my validation report for approval, and track artifact (finding) resolution and other updates to my model.”

This final module is part of a four-part series:

Validator Fundamentals

Module 4 — Contents

Section 1

• Refine validation report
• Manage artifacts
• Submit validation report for approval

Section 2

• Collaborate with others
• Track record activity
• View analytics

First, let’s make sure you can log in to ​ValidMind.

Training is interactive — you explore ​ValidMind live. Try it!

→ , ↓ , SPACE , N — next slide     ← , ↑ , P , H — previous slide     ? — all keyboard shortcuts

Before you begin

• Prerequisite courses
• Log in

To continue, you need to have been onboarded onto ValidMind Academy with the Validator role and completed the first three modules of this course:

Module 1

Module 2

Module 3

Already logged in and refreshed this module? Click to continue.

1. Log in to check your access:

Log in to ​ValidMind

Be sure to return to this page afterwards.

2. After you successfully log in, refresh the page to connect this training module up to the ValidMind Platform:

Section 1

Refine validation report

Make qualitative edits

(Scroll down for the full instructions.)

Learn more …

Try it live on the next page.

• Add content blocks
• Edit test result descriptions

1. From the Inventory in the ValidMind Platform, go to the model you connected to earlier.

2. In the left sidebar that appears for your model, click Validation under Documents.

3. Click on 1. Executive Summary to expand and add content to that section.

4. Hover your mouse over the space where you want your new block to go until a horizontal line with a sign appears that indicates you can insert a new block:

Adding a content block in the UI

After adding the block to your validation report, generate a content draft with AI using the content editing toolbar:

1. Click (Generate Text with AI) in the toolbar while editing a content block.

2. Enter in a custom prompt and click Send, or click Generate Content to compose a draft for review.

3. Review the draft composed by the ​ValidMind AI Content Builder for accuracy and relevance, then:

   • Click Insert to document to add the draft into your content block.
   • Or, submit a different prompt in the dialogue box and click Send to regenerate a different draft.

4. After you insert the AI-generated draft, click on the text box to make the necessary edits and adjustments to your copy, ensure that content is in compliance with the quality guidelines outlined by your organization.

You can also use the content editing toolbar to revise the description of test results to explain the changes made to the raw data and the reasons behind them.

For example:

1. Within your validation report, click on 2.2.1. Data Quality to expand that section and locate the linked Class Imbalance Assessment evidence.

2. Click See evidence details to review the LLM-generated description that summarizes the test results, that confirm that our final preprocessed dataset actually passes our test.

3. Edit the description for our individually inserted ClassImbalance:raw_dataset_preprocessed test:

Editor for a test result description

Add & edit content blocks

1. Select the name of your record you registered for this course to open up the record details page.
2. On the left sidebar that appears for your record, click Validation under Documents.
3. Click on 1. Executive Summary to add and edit a content block.
4. Click on 2.2.1. Data Quality to edit the description for the linked Class Imbalance Assessment test results.

When you’re done, click to continue.

Assess model compliance

(Scroll down for the full instructions.)

Learn more …

Try it live on the next page.

• Add risk assessment notes
• Provide compliance assessments

1. From the Inventory in the ValidMind Platform, go to the model you connected to earlier.

2. In the left sidebar that appears for your model, click Validation under Documents.

3. Click on 2.2.1. Data Quality to expand that section and locate the Class Imbalance Assessment sub-section.

4. Click under Risk Assessment Notes to edit the content block using the content editing toolbar.

   For example, use ^beta (Generate Text with AI) to create a draft summarizing the contents of the Class Imbalance Assessment sub-section.

   Sample compliance assessment

1. In the same Class Imbalance Assessment sub-section above the Risk Assessment Notes, locate the Guideline with the assessment drop-down.

2. Select one of the available assessment options.

3. Confirm that the compliance summary shown for each subsection under 2. Validation provides an accurate overview for current qualitative and quantitative risk assessments:

   Risk assessment compliance summary

Assessment options available for selection depend on configuration for individual validation report templates.

Your organization can customize these options to match its own assessment framework, or choose to remove them from templates entirely.

Add your compliance assessments

1. Select the name of your model you registered for this course to open up the model details page.
2. On the left sidebar that appears for your model, click Validation under Documents.
3. Click on 2.2.1. Data Quality to assess compliance for the Class Imbalance Assessment sub-section.

When you’re done, click to continue.

ValidMind Document Checker

Learn more …

The ValidMind Document Checker is a compliance tool that reviews documents against a selected regulatory standard. Use the Document Checker to identify gaps, generate actionable recommendations, and focus your efforts on areas that require attention. The Document Checker uses a structured checklist to:

• Assess whether required information or evidence is clearly documented or attached
• Identify missing or weak areas in the document
• Offer guidance on how to improve clarity, completeness, and compliance
• Ensure consistency with regulatory expectations for risk and governance

Learn how to use the Document Checker to review validation reports on the next page.

Use the Document Checker

(Scroll down for the full instructions.)

Try it live on the next page.

1. In the left sidebar, click Inventory.

2. Select a record or find your record by applying a filter or searching for it.

3. In the left sidebar that appears for your record, click Documents and select Validation.

4. Locate Check Document on the right and click to expand the menu, then click Check Document.

• 1. Select regulation
• 2. Review observations
• 3. (Optional) Export results

1. In the Document Checker modal, select a regulation and an associated assessment from the drop-down menus to check your document against:

   Example regulation or policy and assessment selected to check a document against

   A list of regulation-based questions appears for your review.

2. Scroll to the bottom and click Check Validation Document.

The ValidMind Document Checker analyzes your report, identifies gaps, and generates recommendations for specific questions that you review in the next step.

1. After the Document Checker has completed its analysis, expand individual questions or click Expand All to look through the observations:

Gap Identified — A question that is not addressed and requires attention.
Partial Gap — A question that is partially addressed and requires attention.
No Significant Gaps — A question that is fully addressed.

2. Review questions that require attention. Each question includes:

   • Observation — An analysis of how the report currently addresses the question
   • Recommendation — If suggested, guidance on how to revise the report to better address the question

Use the feedback provided by the ValidMind Document Checker to review the appropriate sections of your report and decide what revisions should be made. Or, if you have run the Document Checker before and were just checking that all report issues have been addressed, submit your report for review.

To export the results of the Document Checker to a .pdf (Portable Document Format) file for usage outside of the ValidMind Platform, click Export All.

Check your validation report

1. Select the name of your model you registered for this course to open up the model details page.
2. On the left sidebar that appears for your model, click Validation under Documents.
3. Locate Check Document on the right and click to expand the menu, then click Check Document.
4. Select a regulation and an associated assessment from the drop-down menus to to check your report against.
5. Scroll to the bottom and click Check Validation Document.
6. After the Document Checker has completed its analysis, expand individual questions or click Expand All to look through the observations.

When you’re done, click to continue.

Manage artifacts

Add more artifacts

(Scroll down for the full instructions.)

Learn more …

Try it live on the next pages.

Along with adding artifacts directly via validation reports, you can also add artifacts during your review of model documentation:

1. In the left sidebar, click Inventory.

2. Select a record or find your record by applying a filter or searching for it.

3. In the left sidebar that appears for your record, click Development under Documents.

4. On your record’s documentation page, click Add Artifact.

5. Select the artifact type you want to add:

   • Validation Issue
   • Policy Exception
   • Limitation

6. On the modal that opens, provide information for your artifact.

7. When you are done, click Save to submit the artifact.

   Once created, you can then add supporting documentation to your artifact.

Add an artifact on documentation

1. Select the name of your model you registered for this course to open up the model details page.
2. On the left sidebar that appears for your model, click Development under Documents.
3. Click Add Model Artifact to add an artifact from the overview.

When you’re done, click to continue.

Track issue resolution

(Scroll down for the full instructions.)

Learn more …

Try it live on the next pages.

As you prepare your report, review open or past due artifacts, close resolved ones, or add a mitigation plan:

• Update an artifact
• View all artifacts

1. In the left sidebar, click Inventory.

2. Select a record or find your record by applying a filter or searching for it.

Track resolution of validation issues

1. In the left sidebar that appears for your record, click Validation Issues to view a list of validation issues associated with that record.

2. Go through the open validation issues one-by-one:

   • If the validation issue has been addressed —

     • Add any final comments to assess how the issue was resolved.
     • Under status, select Closed.

   • If part or all of the validation issue remains to be addressed —

     • Assess if the issue identified by the validation issue prevents the record from being approved.
     • If a remediation plan is required, enter the details in the Proposed Remediation Plan section of the validation issue.

3. Track open issues until all validation issues are resolved or a remediation plan is in place for post-approval issues.

Track resolution of other artifact types

1. In the left sidebar that appears for your record, click Artifacts to view lists of other artifact types associated with that record.

2. Select an artifact type for a list of that artifact type:

   • Policy Exception
   • Limitation

3. Go through the open artifacts one-by-one:

   • If the artifact has been addressed —

     • Add any final comments to assess how the issue was resolved.
     • Under status, select Closed.

   • If part or all of the artifact remains to be addressed —

     • Assess if the issue identified by the artifact prevents the record from being approved.
     • Add comments indicating next required steps.

4. Track open artifacts until all artifacts are resolved or plans are in place for post-approval issues.

Along with model-specific artifacts, you can also view and filter a list of artifacts across all models within the ValidMind Platform:

View all validation issues

To view a list of validation issues across all records:

1. In the left sidebar, click Validation Issues.

   Filter this list to include only validation issues you want to see, or toggle visibilty for column headers.

2. Click on any validation issue for more information, including the proposed remediation plan and any supporting attachments.

   Attachments are listed with the following information:

   • Filename
   • Icon representing file type
   • Date uploaded
   • The user who uploaded the file
   • File size
   • Notes

   Click on the attachment to view or download the file.

View all other artifacts

To view lists of other artifact types across all records:

1. In the left sidebar, click Artifacts.

2. Select an artifact type to view from the tabs:

   • Policy Exception
   • Limitation

   In the page that opens is a list of all artifacts for that type.

   Filter this list to include only artifacts you want to see, or toggle visibilty for column headers.

3. Click on any artifact for more information.

Update your validation issue

1. Select the name of your model you registered for this course to open up the model details page.
2. In the left sidebar that appears for your model, click Validation Issues.
3. Select the validation issue you logged during this course, and make some changes to any of the fields.
4. When you are finished editing, set the valildation issue status to Closed.

When you’re done, click to continue.

View all Validation Issues

Filter this list to include only validation issues you want to see, or toggle visibilty for column headers.

When you’re done, click to continue.

Submit report for approval

Work with workflows

(Scroll down for the full instructions.)

Learn more …

Try it live on the next page.

Depending on the configuration of your workflows, you may or may not be able to move a record into another workflow state as actions can be gated to only users of certain roles.

When all the actions that can be performed by your role are completed for that record at that stage of the workflow, actions will disappear from your view.

When you’re ready, verify your workflow’s status, and then submit your documents for review or approval.

• Verify workflows
• Advance workflows

Workflows are configured by an administrator in advance. When transitioning a workflow, verify that the workflow steps reflect your organization’s requirements.

To review details for workflows currently active:

On records

1. In the left sidebar, click Inventory.

2. Select a record or find your record by applying a filter or searching for it.

3. On the landing page of your record, locate the active workflows section.

4. Click on the name of any active workflow to review that specific workflow’s details.

5. Click on the tab you would like to review:

   • Details — Name and description (if present) of the workflow, the workflow’s status and progress (if applicable), when it was created, and when it was started.
   • Activity — History of updates to the workflow on that record, including notes submitted during transitions.
   • Artifacts — Artifacts for that record created within the duration of that workflow’s runtime.
   • Workflow — Overview of the entire workflow. The current workflow step is highlighted on this view.

On artifacts

1. On the details page of your artifact, locate the active workflows section.

2. Click on the name of any active workflow to review that specific workflow’s details.

3. Click on the tab you would like to review:

   • Details — Name and description (if present) of the workflow, the workflow’s status and progress (if applicable), when it was created, and when it was started.
   • Activity — History of updates to the workflow on that artifact, including notes submitted during transitions.
   • Workflow — Overview of the entire workflow. The current workflow step is highlighted on this view.

To transition a workflow into next steps:

On records

1. In the left sidebar, click Inventory.

2. Select a record or find your record by applying a filter or searching for it.

3. On the landing page of your record, locate the active workflows section and the workflow you’d like to transition.

4. If an action is available to your role, you’ll see it listed under that workflow:

   • Click to open up the transition panel for your selected action. This arrow will be followed by the action name.
   • Enter your notes and/or any other additional inventory fields then click {action} where action is the name of your custom user action. To save a working copy of the entered information without transitioning the workflow into its next state, click Save.

5. Click {action} where action is the name of your custom user action to submit the entered information and transition the workflow into its next state.

On artifacts

1. On the details page of your artifact, locate the active workflows section.

2. If an action is available to your role, you’ll see it listed under that workflow:

   • Click to open up the transition panel for your selected action. This arrow will be followed by the action name.
   • Enter your notes and/or any other additional inventory fields then click {action} where action is the name of your custom user action. To save a working copy of the entered information without transitioning the workflow into its next state, click Save.

3. Click {action} where action is the name of your custom user action to submit the entered information and transition the workflow into its next state.

While your record stages and workflows states are custom to your organization, some examples are:

• To submit validation reports for review and approval — Click Ready for Review to indicate that you have completed your initial validation report, fill in the mandatory notes, and submit.
• To request revisions to validation reports — Click Request Revision, fill in the mandatory notes to explain the changes that are required, and submit.
• To have your validation report approved — Click Ready for Approval, fill in the mandatory notes, and submit.

Submit for approval

1. Select the name of your record you registered for this course to open up the record details page.
2. On the landing page of your record, locate the active workflows section and the workflow you’d like to transition.
3. If an action is available to your role, you’ll see it listed under that workflow:
   • Click to open up the transition panel for your selected action. This arrow will be followed by the action name.
   • Enter your notes and any other additional inventory fields then click Submit.

When you’re done, click to continue.

Section 2

Collaborate with others

Comment threads

Learn more …

Try it live on the next page.

While working with content blocks, you can comment directly on specific portions of the text.

All users associated with a record, such as developers and validators, will see a notification that a comment has been posted in their Recent Activity feed, accessible via the Dashboard.

Have a question about the model? Collaborate with your developer right in the model documentation:

• Post comments
• Reply to comments
• Resolve comments

1. In any text block or test description, select the portion of text you want to comment on, then click the button that appears.

2. Enter your comment and click Comment.

3. You can view the comment by clicking the highlighted text. Comments will also appear in the right sidebar.

1. Click the highlighted text to view the comment thread.

2. Enter your comment and click Reply.

3. You can view the comment thread by clicking the highlighted text.

1. Click the highlighted text portion to view the thread, then click to resolve the thread.

2. To view the resolved comment thread, click the Comments archive button in the toolbar.

   You can view a history of all archived comments in the Comment archive.

To reopen a comment thread, reply to the comment thread in the Comment archive or click the Reopen button in the header of that comment thread.

Comment on a text block

1. Select the name of your record you registered for this course to open up the record details page.
2. On the left sidebar that appears for your record, click Validation under Documents.
3. In the content block you added earlier: Post a comment, reply to it, and then resolve the thread.

When you’re done, click to continue.

Track record activity

Track changes & updates

Learn more …

Try it live on the next page.

View record activity

The Activity page shows a record of activities for the selected inventory record, including actions performed by users in your organization, activity from automated workflows, and updates generated via the ValidMind Library, such as:

• Fields updated
• Stage transitions
• Updates to documents: documentation, validation reports, ongoing monitoring reports, or custom documents
• Test results or metrics added via the library
• Artifacts added, updated, or removed
• User comment creation and replies on documents
• Stakeholders added or removed
• Workflow activity

To view record activity:

1. In the left sidebar, click Inventory.

2. Under the record type drop-down, select the type of record you want view activity for.

3. Select a record or find your record by applying a filter or searching for it.

4. In the expanded sidebar that appears for your record, click Activity.

Review record activity

1. Select the name of your record you registered for this course to open up the recird details page.
2. In the left sidebar that appears for your record, click Activity.
3. Confirm activity logged on the record reflects your activities from this training course.
4. (Optional) Filter the activity by category or specific values to narrow down results.

When you’re done, click to continue.

View analytics

Welcome to Analytics

Here, you can find executive summaries, track information on models, artifacts, and more.

For example:

1. Click Validation Issues to review reports on validation issues.
2. Click into any widget to review the validation issues reported by that widget.

When you’re done, click to continue.

In summary

Finalizing validation reports

Want to learn more? Find your next learning resource on ValidMind Academy.

In this final module, you learned how to:

• Add or edit content blocks in your validation report
• Assess the compliance of a model within your validation report
• Manage artifacts via multiple methods
• Submit your validation report for approval
• Collaborate with other stakeholders on your model
• Track updates on your model
• Navigate the analytics dashboard

There is more that ​ValidMind can do to help you validate models, from using your own template to code samples you can adapt for your own use case:

All model validation guides