Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add a flag to have unleash return a nonzero value on failure #216

Open
toejough opened this issue Dec 13, 2023 · 1 comment
Open

add a flag to have unleash return a nonzero value on failure #216

toejough opened this issue Dec 13, 2023 · 1 comment
Assignees
Labels
t/to-triage A new issue or PR not yet triaged (needs to be categorised, prioritised etc.)

Comments

@toejough
Copy link

🚀 Feature Request

Is your feature request related to a problem? Please describe

I would like to be able to use this tool in a series of checks and stop if anything is NOT COVERED or LIVED.

Describe the solution you'd like

Have gremlins unleash --fail-not-covered --fail-lived return 1 if anything is NOT COVERED or LIVED, and similar for other states.

Describe alternatives you've considered

I could pipe this into a script that searches for text, but that's fragile and prevents the nice colored report from being printed, unless I also want to build my own pattern-matching & colorizing, which I do not. Or I could run the program twice, once for the nice human output and once into the script to scan for & react to the result, which I also don't want to do.

Additional context

I tried setting the --threshold-efficacy=1.0 and --threshold-mcover=1.0 (and up to 100.0) but at Test efficacy: 85.71%
Mutator coverage: 46.67%, the RC was still 0. Am I missing something?

@toejough toejough added the t/to-triage A new issue or PR not yet triaged (needs to be categorised, prioritised etc.) label Dec 13, 2023
@rusinikita
Copy link
Contributor

rusinikita commented Feb 14, 2024

--threshold-efficacy have value in percent

So, you need to use 100 instead of 1.0

https://gremlins.dev/latest/usage/commands/unleash/#threshold-efficacy

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
t/to-triage A new issue or PR not yet triaged (needs to be categorised, prioritised etc.)
Projects
None yet
Development

No branches or pull requests

3 participants