Fulfilling a Test

This article guides you through the process of fulfilling a Test end-to-end.

What is a Test

A test, in the context of AI governance, is a specific procedure or check implemented to verify that an AI system or component is functioning as intended and meeting predefined criteria. Tests are designed to assess performance, detect anomalies, and ensure compliance with established standards or regulations.

Test Fulfillment Steps

To help you get started on your testing activity on Modulos, the example included in this article walks through the process of fulfilling a Test.

• Review the Test and its Conditions
• Configure the Test parameters
• Execute the Test
• Analyze Test Results
• Update Test Status

Requirements

• You’re logged into the Modulos platform
• You have access to a project and you're assigned the editor role. You’ll need the reviewer or owner role to complete the review step

Example: Fairness Metric Test

Let’s walk through the process of setting up and fulfilling a test to check the fairness metric of an AI model.

Step 1: Review the Test

1. Inside your project, navigate to the Testing page by clicking on Testing in the top bar
2. Find the "Fairness Metric Test" by searching in the Search for Contents field and click on it
3. Review the Overview and Conditions for the Test

Step 2: Configure the Test

1. In the Condition section, set up the test parameters:
   • Source: Select "Modulos-Client(push)"
   • Metric: Choose "Fairness Metrics"
   • Operator: Select "Greater than or equal to"
   • Value: Enter the threshold value, e.g., "0.8"
2. You can assign an owner for this Test in the sidebar

Step 3: Execute the Test

1. Use the Modulos API to push the test results. You can find the API code by clicking the "<>" button in the test interface
2. Run your fairness evaluation script and send the results to the Modulos platform

Step 4: Analyze Test Results

1. Once the test has been executed, review the Last Result section
2. Check the value, status, and timestamp of the most recent test execution
3. For a historical view, examine the Test Results History chart

Step 5: Update Test Status

1. Based on the test results, you can update the test status
2. Click on Request status change to initiate the review process
3. Select the appropriate status (e.g., "Completed" if the test passed, or "In Progress" if further work is needed)
4. Add any necessary comments explaining the status change