Dart Test

A guide for generating Trunk-compatible test reports for Dart tests

You can automatically detect and manage flaky tests in your Dart projects by integrating with Trunk. This document explains how to configure Dart to output JUnit XML reports that can be uploaded to Trunk for analysis.

Setup steps

Work through the steps below in order. Once you’ve finished the last one, you’ll be ready to move on to configure uploads in CI.

1. Generate a compatible test report
2. Configure the report file path or glob
3. Disable retries for better detection accuracy
4. Test uploads locally

Generating Reports

Before you can upload to Trunk, you need to output a Trunk-compatible report. Dart supports JUnit outputs by using the tojunit library. You can install the tojunit library using the following command:

dart pub global activate junitreport

Then, you can convert test reports to a JUnit format by piping it to tojunitand piping the output to a file like this:

dart test <TEST_PATH> --reporter json | tojunit > junit.xml

Report File Path

The JUnit report is written to the location specified by the tojunit > pipe. In the example above, the test results will be written to ./junit.xml.

Disable Retries

You need to disable automatic retries if you previously enabled them. Retries compromise the accurate detection of flaky tests.

Dart provides retries through the retry class annotations. Disable retry, use Trunk to detect flaky tests, and use Quarantining to isolate flaky tests dynamically at run time.

Try It Locally

The Validate Command

Linux (x64)

SKU="trunk-analytics-cli-x86_64-unknown-linux.tar.gz"
curl -fL --retry 3 \
  "https://github.com/trunk-io/analytics-cli/releases/latest/download/${SKU}" \
  | tar -xz

chmod +x trunk-analytics-cli
./trunk-analytics-cli validate --junit-paths "./junit.xml"

Test Upload

Before modifying your CI jobs to automatically upload test results to Trunk, try uploading a single test run manually.

You make an upload to Trunk using the following command:

./trunk-analytics-cli upload --junit-paths "./junit.xml" \
    --org-url-slug <TRUNK_ORG_SLUG> \
    --token <TRUNK_ORG_TOKEN>

Next Steps

Configure your CI to upload test runs to Trunk. Find the guides for your CI framework below:

Azure DevOps Pipelines

BitBucket Pipelines

BuildKite

CircleCI

Drone CI

GitHub Actions

GitLab

Jenkins

Semaphore

TeamCity

Travis CI

Other CI Providers