Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Maven smoke tests are flaky #7025

Closed
PerfectSlayer opened this issue May 14, 2024 · 1 comment
Closed

Maven smoke tests are flaky #7025

PerfectSlayer opened this issue May 14, 2024 · 1 comment
Labels
comp: ci visibility Continuous Integration Visibility tag: flaky test Flaky tests
Milestone

Comments

@PerfectSlayer
Copy link
Contributor

Test suite

test test_failed_maven_run_flaky_retries, v3.9.6 from datadog.smoketest.MavenSmokeTest.
Marked flaky by CircleCI

Error

Condition not satisfied after 15.00 seconds and 37 attempts
	at spock.util.concurrent.PollingConditions.within(PollingConditions.java:185)
	at spock.util.concurrent.PollingConditions.eventually(PollingConditions.java:140)
	at datadog.trace.civisibility.CiVisibilitySmokeTest.waitForCoverages(CiVisibilitySmokeTest.groovy:236)
	at datadog.trace.civisibility.CiVisibilitySmokeTest.verifyEventsAndCoverages(CiVisibilitySmokeTest.groovy:177)
	at datadog.smoketest.MavenSmokeTest.test #projectName, v#mavenVersion(MavenSmokeTest.groovy:61)
Caused by: Condition not satisfied:

receivedCoverages.size() == traceSize
|                 |      |  |
|                 2      |  1
|                        false
[[version:2, coverages:[[test_session_id:2415258914049928723, test_suite_id:127719938380221125, span_id:947516651552068468, files:[[filename:src/main/java/datadog/smoke/Calculator.java, segments:[[5, -1, 5, -1, -1]]], [filename:src/test/java/datadog/smoke/TestFailed.java, segments:[[7, -1, 7, -1, -1], [11, -1, 11, -1, -1]]]]], [test_session_id:2415258914049928723, test_suite_id:127719938380221125, span_id:5155894487225088796, files:[[filename:src/main/java/datadog/smoke/Calculator.java, segments:[[5, -1, 5, -1, -1]]], [filename:src/test/java/datadog/smoke/TestFailed.java, segments:[[7, -1, 7, -1, -1], [11, -1, 11, -1, -1]]]]], [test_session_id:2415258914049928723, test_suite_id:127719938380221125, span_id:5393341085870037505, files:[[filename:src/main/java/datadog/smoke/Calculator.java, segments:[[5, -1, 5, -1, -1]]], [filename:src/test/java/datadog/smoke/TestFailed.java, segments:[[7, -1, 7, -1, -1], [11, -1, 11, -1, -1]]]]], [test_session_id:2415258914049928723, test_suite_id:127719938380221125, span_id:9039952828890324306, files:[[filename:src/main/java/datadog/smoke/Calculator.java, segments:[[5, -1, 5, -1, -1]]], [filename:src/test/java/datadog/smoke/TestFailed.java, segments:[[7, -1, 7, -1, -1], [11, -1, 11, -1, -1]]]]]]], [version:2, coverages:[[test_session_id:2415258914049928723, test_suite_id:127719938380221125, span_id:4945266185610920573, files:[[filename:src/main/java/datadog/smoke/Calculator.java, segments:[[5, -1, 5, -1, -1]]], [filename:src/test/java/datadog/smoke/TestFailed.java, segments:[[7, -1, 7, -1, -1], [11, -1, 11, -1, -1]]]]]]]]

	at datadog.trace.civisibility.CiVisibilitySmokeTest.waitForCoverages_closure2(CiVisibilitySmokeTest.groovy:237)
	at datadog.trace.civisibility.CiVisibilitySmokeTest.waitForCoverages_closure2(CiVisibilitySmokeTest.groovy)
	at groovy.lang.Closure.call(Closure.java:412)
	at spock.util.concurrent.PollingConditions.within(PollingConditions.java:168)
	... 4 more

Cause

Only one of the two coverages is received.

Environment

Any version of Java and JVM.

Logs

test.zip

Copy link

🤖 This issue has been addressed in the latest release. See full details in the Release Notes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: ci visibility Continuous Integration Visibility tag: flaky test Flaky tests
Projects
None yet
Development

No branches or pull requests

2 participants