Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat: support retries in e2e tests in CI #2145

Draft
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

jpraynaud
Copy link
Member

@jpraynaud jpraynaud commented Nov 27, 2024

Content

This PR includes support for retrying e2e test runs in case of transient error on the Cardano network of the underlying devnet (which happen because of the custom configuration used for it). This will overall remove the main source of flakiness in the CI runs.

Error handling improvements:

Main execution flow restructuring:

Enhancements to GitHub workflows:

Pre-submit checklist

  • Branch
    • Tests are provided (if possible)
    • Crates versions are updated (if relevant)
    • Commit sequence broadly makes sense
    • Key commits have useful messages
  • PR
    • No clippy warnings in the CI
    • Self-reviewed the diff
    • Useful pull request description
    • Reviewer requested

Issue(s)

Closes #2123

@jpraynaud jpraynaud self-assigned this Nov 27, 2024
Copy link

github-actions bot commented Nov 27, 2024

Test Results

    4 files  ±0     52 suites  +1   11m 47s ⏱️ -1s
1 416 tests +2  1 416 ✅ +2  0 💤 ±0  0 ❌ ±0 
1 627 runs  +2  1 627 ✅ +2  0 💤 ±0  0 ❌ ±0 

Results for commit d78c7a3. ± Comparison against base commit e38a254.

♻️ This comment has been updated with latest results.

@jpraynaud jpraynaud force-pushed the jpraynaud/2123-retries-e2e-test branch from 2724af6 to 3520b73 Compare November 27, 2024 16:22
@jpraynaud jpraynaud force-pushed the jpraynaud/2123-retries-e2e-test branch 3 times, most recently from df45fe3 to 7676e66 Compare November 27, 2024 17:39
@jpraynaud jpraynaud force-pushed the jpraynaud/2123-retries-e2e-test branch 2 times, most recently from 2301030 to 01bd176 Compare November 27, 2024 18:20
@jpraynaud jpraynaud force-pushed the jpraynaud/2123-retries-e2e-test branch from 01bd176 to 4154bff Compare November 27, 2024 18:29
@jpraynaud jpraynaud force-pushed the jpraynaud/2123-retries-e2e-test branch from 4154bff to d78c7a3 Compare November 27, 2024 18:41
@jpraynaud jpraynaud deployed to testing-preview November 27, 2024 18:51 — with GitHub Actions Active
@jpraynaud jpraynaud deployed to testing-sanchonet November 27, 2024 18:51 — with GitHub Actions Active
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Implement retries in e2e tests in CI
1 participant