Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run OpenShift conformance tests #399

Open
wants to merge 4 commits into
base: 4.8
Choose a base branch
from
Open

Conversation

cfergeau
Copy link
Contributor

@cfergeau cfergeau commented Apr 23, 2021

Rather than kubernetes/conformance, this attempts to run
openshift/conformance. This disables all the instrumentation, network,
node, scheduling and storage tests as I did not have time to look in
details at the several dozens of failures they had. The goal is to
eventually empty the ignore list and fix/ignore the ignored tests.

This is just a test PR to trigger the run of the conformance test in the CI and see how it goes.

@openshift-ci-robot
Copy link

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: cfergeau

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@cfergeau
Copy link
Contributor Author

/hold

@praveenkumar
Copy link
Member

/retest

@praveenkumar
Copy link
Member

INFO[2021-04-26T06:39:24Z] error: 53 fail, 532 pass, 41 skip (1h59m21s) 
INFO[2021-04-26T06:39:24Z] {"component":"entrypoint","error":"wrapped process failed: exit status 1","file":"prow/entrypoint/run.go:80","func":"k8s.io/test-infra/prow/entrypoint.Options.Run","level":"error","msg":"Error executing test process","severity":"error","time":"2021-04-26T06:39:14Z"} 
INFO[2021-04-26T06:39:24Z] error: failed to execute wrapped command: exit status 1 

@cfergeau looks like lot of tests are failing on CI and also it is taking around 2 hour :(

@praveenkumar
Copy link
Member

/retest

@praveenkumar
Copy link
Member

/test e2e-snc

2 similar comments
@cfergeau
Copy link
Contributor Author

/test e2e-snc

@cfergeau
Copy link
Contributor Author

/test e2e-snc

@cfergeau
Copy link
Contributor Author

/retest

@cfergeau
Copy link
Contributor Author

cfergeau commented Jun 1, 2021

/retest

@cfergeau cfergeau force-pushed the conformance branch 2 times, most recently from e797da0 to 56eb6c1 Compare June 2, 2021 16:05
@cfergeau
Copy link
Contributor Author

cfergeau commented Jun 2, 2021

/retest

2 similar comments
@praveenkumar
Copy link
Member

/retest

@cfergeau
Copy link
Contributor Author

cfergeau commented Jun 3, 2021

/retest

@praveenkumar
Copy link
Member

/test e2e-snc

@praveenkumar
Copy link
Member

/retest

3 similar comments
@cfergeau
Copy link
Contributor Author

cfergeau commented Jun 3, 2021

/retest

@praveenkumar
Copy link
Member

/retest

@praveenkumar
Copy link
Member

/retest

@praveenkumar
Copy link
Member

/test e2e-snc

1 similar comment
@praveenkumar
Copy link
Member

/test e2e-snc

@praveenkumar
Copy link
Member

/retest

@praveenkumar
Copy link
Member

@cfergeau please squash the commits and re push (mostly the fixup one), so we can merge it.

@cfergeau
Copy link
Contributor Author

cfergeau commented Jun 8, 2021

@cfergeau please squash the commits and re push (mostly the fixup one), so we can merge it.

Before the merge, we also need to decide when to run it, as it's quite expensive (time-wise) to run for every PR.

@praveenkumar
Copy link
Member

/retest

2 similar comments
@praveenkumar
Copy link
Member

/retest

@praveenkumar
Copy link
Member

/retest

@cfergeau
Copy link
Contributor Author

/retest

Rather than kubernetes/conformance, this attempts to run
openshift/conformance. This disables all the instrumentation, network,
node, scheduling and storage tests as I did not have time to look in
details at the several dozens of failures they had. The goal is to
eventually empty the ignore list and fix/ignore the ignored tests.
@cfergeau cfergeau changed the base branch from master to 4.8 June 30, 2021 14:11
@cfergeau
Copy link
Contributor Author

/retest

6 similar comments
@cfergeau
Copy link
Contributor Author

cfergeau commented Jul 1, 2021

/retest

@cfergeau
Copy link
Contributor Author

cfergeau commented Jul 5, 2021

/retest

@cfergeau
Copy link
Contributor Author

cfergeau commented Jul 6, 2021

/retest

@cfergeau
Copy link
Contributor Author

cfergeau commented Jul 8, 2021

/retest

@cfergeau
Copy link
Contributor Author

cfergeau commented Jul 8, 2021

/retest

@cfergeau
Copy link
Contributor Author

cfergeau commented Jul 9, 2021

/retest

@openshift-ci
Copy link

openshift-ci bot commented Jul 9, 2021

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: cfergeau

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci
Copy link

openshift-ci bot commented Oct 20, 2022

@cfergeau: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-snc a88d4b8 link true /test e2e-snc

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Hold
Development

Successfully merging this pull request may close these issues.

3 participants