Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

We found 1 flaky test #176

Open
shaker-project opened this issue Nov 13, 2020 · 0 comments
Open

We found 1 flaky test #176

shaker-project opened this issue Nov 13, 2020 · 0 comments

Comments

@shaker-project
Copy link

shaker-project commented Nov 13, 2020

Hello, we are a group of researchers that investigate the occurrence of flaky tests in Android.

We voluntarily ran your GUI tests 20 times and found that a test pass or fail non-deterministically, which characterizes as flaky test [1]. Below we list each flaky test we found, and its number of failures.

We ran these tests on a generic Android Emulator (AVD) with Android API version 28.

If you confirm this behavior, our suggestion is to add the @FlakyTest annotation on these tests. See https://developer.android.com/reference/androidx/test/filters/FlakyTest

If you wish for a repair proposal, please let us know.

[1] https://hackernoon.com/flaky-tests-a-war-that-never-ends-9aa32fdef359

Graciously,
Denini, Leopoldo and Marcelo.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant