Configuring status preference

Based on the Playwright configuration for your project, a test can have multiple attempts. We must devise a strategy to calculate the final test status when the different test attempts have different statuses

When calculating the results for each test, you have two options to prioritize how the final outcome is assessed. Choose the method that best aligns with your testing goals:

  1. Prioritize Successful Outcomes (Passed First):
    If your focus is on ensuring that the majority of tests pass, select this option. The system will evaluate the results with a higher emphasis on tests that pass, following this order of priority:

    • Passed

    • Skipped

    • Interrupted

    • Timed Out

    • Failed

  2. Prioritize Critical Failures (Failed First) (Default):
    If identifying and addressing test failures is your top priority, choose this option. The system will prioritize results by focusing on tests that failed, using the following order:

    • Failed

    • Timed Out

    • Interrupted

    • Skipped

    • Passed

This allows you to customize the result calculation process to align with the specific objectives of your testing strategy.

To configure the status preference of a project:

  1. Choose the project for which you want to configure the status preference.

    Screenshot 2024-09-20 at 3.53.13 PM.png
    Projects dashboard
  2. Click the Configure tab to go to the project configuration menu.

    Screenshot 2024-10-09 at 2.58.52 PM.png
    Project detail page
  3. In the project configuration screen, click on the Settings card. This will open the Project settings page.

    Screenshot 2024-10-09 at 3.19.43 PM.png
    Project Configuration
  4. In the projects settings page, choose the preferred strategy for status calculation and click on the Save changes button to confirm the changes.

    Screenshot 2024-10-10 at 1.35.49 PM.png
    Project configuration | Settings

Now this status preference will be used from the next test run.

Can't find what you're looking for?