Skip to content

Intermittent Test Failures in Acceptance Suite Batches #3353

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
quiet-node opened this issue Dec 24, 2024 · 2 comments · Fixed by #3547
Closed

Intermittent Test Failures in Acceptance Suite Batches #3353

quiet-node opened this issue Dec 24, 2024 · 2 comments · Fixed by #3547
Assignees
Labels
bug Something isn't working Team Promoted Issues to be triaged and discussed by committers, maintainers, to be worked on the following sprint
Milestone

Comments

@quiet-node
Copy link
Contributor

Problem

Two tests in the acceptance suite are exhibiting significant flakiness:

  • Test: 'should execute "eth_sendRawTransaction" if receiver's account has receiver_sig_required disabled'
  • Issue: The beforeAll() block in the eth_getCode suite is timing out.

Solution

  • Investigate and resolve the issue

Alternatives

No response

@quiet-node quiet-node added the bug Something isn't working label Dec 24, 2024
@quiet-node quiet-node added this to the 0.64.0 milestone Dec 24, 2024
@quiet-node quiet-node moved this from Backlog to Sprint Backlog in Smart Contract Sprint Board Dec 24, 2024
@quiet-node quiet-node removed this from the 0.64.0 milestone Jan 15, 2025
@quiet-node quiet-node moved this from Sprint Backlog to Backlog in Smart Contract Sprint Board Jan 15, 2025
@Ferparishuertas Ferparishuertas added the Team Promoted Issues to be triaged and discussed by committers, maintainers, to be worked on the following sprint label Feb 11, 2025
@simzzz simzzz self-assigned this Feb 17, 2025
@simzzz simzzz moved this from Backlog to Tasks In Progress in Smart Contract Sprint Board Feb 18, 2025
@simzzz simzzz added this to the 0.67.0 milestone Feb 18, 2025
@simzzz simzzz moved this from Tasks In Progress to In Review in Smart Contract Sprint Board Feb 21, 2025
@simzzz simzzz modified the milestones: 0.67.0, 0.68.0 Feb 28, 2025
@simzzz
Copy link
Contributor

simzzz commented Feb 28, 2025

Perhaps we can add a limit to how many runners in CI can we have in parallel similar to here - https://github.com/hashgraph/solo/blob/main/.github/workflows/flow-pull-request-checks.yaml#L94 since tests flake more often when there are more jobs running in parallel

@quiet-node
Copy link
Contributor Author

@simzzz oh good idea! So say if we set it to 3, it would run 3 tests at a time then after the 3 CIs are done it would the next 3? If so I think it's a good idea the tests are getting so flaky nowadays. We can bring this up during parking to see what the team says as well

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Team Promoted Issues to be triaged and discussed by committers, maintainers, to be worked on the following sprint
Projects
None yet
3 participants