You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
What steps did you take and what happened:
I need to run sonobuoy on air-gapped environment. For that purpose I downloaded the docker images in tar format, then uploaded to the environment. Unfortunately the images didn't looks correct.
What did you expect to happen:
We use podman as container runtime (instead of docker).
So, to be able to run sonobuoy we always created a symlink.
podman images | fgrep -v bcmt-registry
REPOSITORY TAG IMAGE ID CREATED SIZE
docker.io/sonobuoy/sonobuoy v0.57.1 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/nginx 1.15-2 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/jessie-dnsutils 1.5 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/apparmor-loader 1.4 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/sample-apiserver 1.17.5 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/prometheus-dummy-exporter v0.1.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/nonewprivs 1.3 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/ipc-utils 1.3 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/csi-node-driver-registrar v2.1.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/prometheus-to-sd v0.5.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/pause 3.8 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/etcd 3.5.9-0 a4ae24e09d14 3 months ago 53.2 MB
gcr.io/k8s-authenticated-test/agnhost 2.6 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/csi-resizer v1.3.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/httpd 2.4.38-2 a4ae24e09d14 3 months ago 53.2 MB
docker.io/alpine/socat 1.7.4.3-r0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver v1.4.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/nautilus 1.5 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/csi-attacher v3.4.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/perl 5.26 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/httpd 2.4.39-2 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/busybox 1.29-2 a4ae24e09d14 3 months ago 53.2 MB
gcr.io/authenticated-image-pulling/windows-nanoserver v1 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/csi-external-health-monitor-controller v0.4.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/volume/nfs 1.3 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/nfs-provisioner v3.0.1 a4ae24e09d14 3 months ago 53.2 MB
localhost/sonobuoy/systemd-logs v0.4 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/csi-node-driver-registrar v2.3.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/livenessprobe v2.6.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/csi-provisioner v3.1.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/node-perf/npb-is 1.2 a4ae24e09d14 3 months ago 53.2 MB
gcr.io/authenticated-image-pulling/alpine 3.7 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/cloud-provider-gcp/gcp-compute-persistent-disk-csi-driver v1.2.2 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/volume/gluster 1.3 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/redis 5.0.5-1 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/node-perf/tf-wide-deep 1.2 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/nginx 1.14-2 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/csi-node-driver-registrar v2.5.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/hello-populator v1.0.1 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/csi-snapshotter v4.2.1 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/csi-attacher v3.3.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/nonroot 1.2 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/agnhost 2.40 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/csi-provisioner v3.0.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/hostpathplugin v1.7.3 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/node-perf/npb-ep 1.2 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/csi-resizer v1.4.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/volume-data-source-validator v1.0.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/volume/rbd 1.0.4 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/regression-issue-74839 1.2 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/build-image/distroless-iptables v0.1.1 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sd-dummy-exporter v0.2.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/glusterdynamic-provisioner v1.3 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/sig-storage/csi-snapshotter v5.0.1 a4ae24e09d14 3 months ago 53.2 MB
mcr.microsoft.com/windows 1809 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/kitten 1.5 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/volume/iscsi 2.3 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/resource-consumer 1.10 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/cuda-vector-add 2.2 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/e2e-test-images/cuda-vector-add 1.0 a4ae24e09d14 3 months ago 53.2 MB
registry.k8s.io/conformance v1.25.16 a4ae24e09d14 3 months ago 53.2 MB
For easier reproduction instead running tests, I just run a sonobuoy command with cli, then manually. The command will fail as something is not ok with the image downloaded/uploaded this way.
sonobuoy images --level debug
INFO[0000] e2e image to be used: registry.k8s.io/conformance:v1.25.16
DEBU[0000] Running: /usr/bin/docker [docker inspect --type=image registry.k8s.io/conformance:v1.25.16]
DEBU[0000] Image: registry.k8s.io/conformance:v1.25.16 present locally
DEBU[0000] Running: /usr/bin/docker [docker run --rm --entrypoint=e2e.test registry.k8s.io/conformance:v1.25.16 --list-images]
ERRO[0000] unable to collect images of plugins: failed to gather test images from e2e image: exit status 127 trace="exit status 127\nfailed to gather test images from e2e image\ngithub.com/vmware-tanzu/sonobuoy/cmd/sonobuoy/app.collectPluginsImages\n\t/home/runner/work/sonobuoy/sonobuoy/cmd/sonobuoy/app/images.go:513\ngithub.com/vmware-tanzu/sonobuoy/cmd/sonobuoy/app.listImages\n\t/home/runner/work/sonobuoy/sonobuoy/cmd/sonobuoy/app/images.go:321\ngithub.com/vmware-tanzu/sonobuoy/cmd/sonobuoy/app.runListImages\n\t/home/runner/work/sonobuoy/sonobuoy/cmd/sonobuoy/app/images.go:64\ngithub.com/vmware-tanzu/sonobuoy/cmd/sonobuoy/app.NewCmdImages.func1\n\t/home/runner/work/sonobuoy/sonobuoy/cmd/sonobuoy/app/images.go:94\ngithub.com/spf13/cobra.(*Command).execute\n\t/home/runner/go/pkg/mod/github.com/spf13/[email protected]/command.go:920\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\t/home/runner/go/pkg/mod/github.com/spf13/[email protected]/command.go:1044\ngithub.com/spf13/cobra.(*Command).Execute\n\t/home/runner/go/pkg/mod/github.com/spf13/[email protected]/command.go:968\nmain.main\n\t/home/runner/work/sonobuoy/sonobuoy/main.go:27\nruntime.main\n\t/opt/hostedtoolcache/go/1.19.13/x64/src/runtime/proc.go:250\nruntime.goexit\n\t/opt/hostedtoolcache/go/1.19.13/x64/src/runtime/asm_amd64.s:1594\nunable to collect images of plugins\ngithub.com/vmware-tanzu/sonobuoy/cmd/sonobuoy/app.listImages\n\t/home/runner/work/sonobuoy/sonobuoy/cmd/sonobuoy/app/images.go:323\ngithub.com/vmware-tanzu/sonobuoy/cmd/sonobuoy/app.runListImages\n\t/home/runner/work/sonobuoy/sonobuoy/cmd/sonobuoy/app/images.go:64\ngithub.com/vmware-tanzu/sonobuoy/cmd/sonobuoy/app.NewCmdImages.func1\n\t/home/runner/work/sonobuoy/sonobuoy/cmd/sonobuoy/app/images.go:94\ngithub.com/spf13/cobra.(*Command).execute\n\t/home/runner/go/pkg/mod/github.com/spf13/[email protected]/command.go:920\ngithub.com/spf13/cobra.(*Command).ExecuteC\n\t/home/runner/go/pkg/mod/github.com/spf13/[email protected]/command.go:1044\ngithub.com/spf13/cobra.(*Command).Execute\n\t/home/runner/go/pkg/mod/github.com/spf13/[email protected]/command.go:968\nmain.main\n\t/home/runner/work/sonobuoy/sonobuoy/main.go:27\nruntime.main\n\t/opt/hostedtoolcache/go/1.19.13/x64/src/runtime/proc.go:250\nruntime.goexit\n\t/opt/hostedtoolcache/go/1.19.13/x64/src/runtime/asm_amd64.s:1594"
Then manually:
podman run --rm --entrypoint=e2e.test registry.k8s.io/conformance:v1.25.16 --list-images
Error: runc: runc create failed: unable to start container process: exec: "e2e.test": executable file not found in $PATH: OCI runtime attempted to invoke a command that was not found
Anything else you would like to add:
As mentioned earlier for container runtime we use podman instead of docker, it may related to the error.
So, my questions here:
Is there any official method to run sonobuoy with different container runtime than docker? any flag, config, ...? The symlink works fine, however if there is a better approach to reach the same goal I would use that one instead.
Related to the air-gapped issue (e.g.: "sonobuoy images download" and "podman load -i /home/cloud-admin/kubernetes_e2e_images_v1.25.16.tar"). Is there any workaround to be able to use it properly?
Environment:
sonobuoy version
Sonobuoy Version: v0.57.1
MinimumKubeVersion: 1.17.0
MaximumKubeVersion: 1.99.99
GitSHA: 6f9e27f1795f10475c9f6f5decdff692e1e228da
GoVersion: go1.19.13
Platform: linux/amd64
API Version check skipped due to missing `--kubeconfig` or other error
What steps did you take and what happened:
I need to run sonobuoy on air-gapped environment. For that purpose I downloaded the docker images in tar format, then uploaded to the environment. Unfortunately the images didn't looks correct.
What did you expect to happen:
We use podman as container runtime (instead of docker).
So, to be able to run sonobuoy we always created a symlink.
We downloaded all the images
Then uploaded to the server and load
As you see the images are there (same ID, size)
For easier reproduction instead running tests, I just run a sonobuoy command with cli, then manually. The command will fail as something is not ok with the image downloaded/uploaded this way.
Then manually:
Anything else you would like to add:
As mentioned earlier for container runtime we use podman instead of docker, it may related to the error.
So, my questions here:
Environment:
sonobuoy version
kubectl version
Cloud provider
OS release
The text was updated successfully, but these errors were encountered: