Skip to content

ci: report end-to-end test status from separate configurations#533

Draft
zimeg wants to merge 2 commits intomainfrom
zimeg-ci-circleci
Draft

ci: report end-to-end test status from separate configurations#533
zimeg wants to merge 2 commits intomainfrom
zimeg-ci-circleci

Conversation

@zimeg
Copy link
Copy Markdown
Member

@zimeg zimeg commented May 9, 2026

Changelog

N/A - But the CI curious might read on! 🐙 ✨

Summary

This PR reports E2E test status from separate configurations. We now run CI as follows:

  • Unit tests: GitHub Actions
  • E2E tests: CircleCI
  • Build signing: CircleCI

We hope to test with continued confidence but faster since tests are run without requiring coordination of GitHub Actions and status reporting from CircleCI. Tests no longer block builds either. These are run separate and confirmed to be working as expected before a release.

Preview

📸 The commits below hope to showcase this as such:

preview

Testing

We continue to check that CircleCI builds start as expected in PRs. Here are existing workflows:

  • build: Compile the source code on branches - confirmation that this step doesn't fail
  • dev-build-code-sign-deploy: Publish development on "main" branch
  • feature-build-code-sign-deploy: Prerelease a particular feature build
  • prod-build-code-sign-deploy: Stable production releases for versions

Notes

  • The preview above shows Windows running however this isn't the complete test suite after some backend changes. We save that for main branch.
  • Plan to confirm that a broken CLI build will break CI - both E2E and "build" step - in commits following!

Requirements

@zimeg zimeg added this to the Next Release milestone May 9, 2026
@zimeg zimeg self-assigned this May 9, 2026
@zimeg zimeg added code health M-T: Test improvements and anything that improves code health semver:patch Use on pull requests to describe the release version increment labels May 9, 2026
@codecov
Copy link
Copy Markdown

codecov Bot commented May 9, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 71.29%. Comparing base (806aa51) to head (a188413).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #533      +/-   ##
==========================================
- Coverage   71.31%   71.29%   -0.03%     
==========================================
  Files         222      222              
  Lines       18706    18706              
==========================================
- Hits        13341    13337       -4     
- Misses       4186     4187       +1     
- Partials     1179     1182       +3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

code health M-T: Test improvements and anything that improves code health semver:patch Use on pull requests to describe the release version increment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant