You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The screenshot-test-comment.yml workflow (pull_request_target) always failed on first run for fork PRs because the workflow requires manual approval before running — meaning the screenshot test it was waiting on hadn't run yet.
Changes
Deleted.github/workflows/screenshot-test-comment.yml — removes the fragile PR comment workflow entirely
Added a Report Screenshot Test failure step to the ScreenshotTests job in main.yml using the ::error:: workflow command, following the same pattern already used by JavadocDoclint:
- name: Report Screenshot Test failureif: failure()run: | echo "::error title=Screenshot tests failed::Screenshot tests have failed.%0A%0A"\ "To review the differences:%0A"\ " 1. Download the 'screenshot-test-report' artifact from this run.%0A"\ ...
The error message preserves the key guidance from the old PR comment: how to download the report artifact, what to do for unintentional vs. intentional visual changes, and a link to the README.
Added retry logic to desktop screenshot tests (main.yml) — the Gradle test task is retried up to 3 times before the job is marked as failed, reducing noise from transient failures.
Added retry logic to Android screenshot tests (android-screenshot.yml) — the connectedDebugAndroidTest Gradle task is similarly retried up to 3 times, with an adb uninstall before each attempt to ensure a clean state. The job timeout was increased from 20 to 60 minutes to accommodate the retries.
CopilotAI
changed the title
[WIP] Remove screenshot test CI task and replace with error message
Remove screenshot test PR comment workflow; replace with inline CI error
Jun 9, 2026
@copilot can you make screenshot tests retry up to 3 times if they fails before marking the workflow as failed?
Done — the Test with Gradle Wrapper step now loops up to 3 times, exiting immediately on success and only failing the job after all 3 attempts are exhausted. Committed in 8a3fe26.
CopilotAI
changed the title
Remove screenshot test PR comment workflow; replace with inline CI error
Remove screenshot test PR comment workflow; replace with inline CI error and retries
Jun 9, 2026
Done — the Android test script now retries the connectedDebugAndroidTest Gradle task up to 3 times (with an adb uninstall before each attempt for a clean state), and only exits with a failure after all 3 attempts. The job timeout was also bumped from 20 to 60 minutes to accommodate the retries. Committed in the latest push.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The
screenshot-test-comment.ymlworkflow (pull_request_target) always failed on first run for fork PRs because the workflow requires manual approval before running — meaning the screenshot test it was waiting on hadn't run yet.Changes
.github/workflows/screenshot-test-comment.yml— removes the fragile PR comment workflow entirelyReport Screenshot Test failurestep to theScreenshotTestsjob inmain.ymlusing the::error::workflow command, following the same pattern already used byJavadocDoclint:The error message preserves the key guidance from the old PR comment: how to download the report artifact, what to do for unintentional vs. intentional visual changes, and a link to the README.
main.yml) — the Gradle test task is retried up to 3 times before the job is marked as failed, reducing noise from transient failures.android-screenshot.yml) — theconnectedDebugAndroidTestGradle task is similarly retried up to 3 times, with anadb uninstallbefore each attempt to ensure a clean state. The job timeout was increased from 20 to 60 minutes to accommodate the retries.