[BUG] rhdh container segfaults on startup with CRC on Intel Mac #4087
Labels
Comments
|
is this running on an Intel or M-based mac? |
Per Issue subject; Intel Mac. Right now there are no aarch images for RHDH. |
|
On M1 it would have to run emulated, which might trigger an issue. It seems the |
Parallels, using Apple Virtualization Framework as it's engine. |
|
I was not able to reproduce this on my intel macbook, but it's still using macos12, so maybe that's why |
|
I also can't reproduce after upgrading my intel macbook to macos13 Tim has run more tests, booting the crc VM using https://github.com/crc-org/vfkit/blob/main/contrib/scripts/start-crc-bundle.sh does not result in a crash, it's only when running the VM through CRC (and thus with the cluster running) that the crash occurs. @reestr Another test I'd be curious about is to reproduce the bug with crc ( |
|
I also can't reproduce it on my intel macbook to macos14.4 crc with openshift preset running as expected. Get the expected output when running rhdh container |
Can you please share which version of OpenShift/CoreOS crc is running? |
I am using the released crc 2.33 which comes with 4.14.12 |
|
After having a quick sync-up with @reestr following is the observation
Looks like something to do with kubelet service and rhdh container and it is only happen with @reestr`s system. On my mac every single time it succeed (no segfault) |
|
@reestr summary was slightly different
|
@cfergeau in terms of unreleased bundle (till then) yes, but with released bundle (4.14.12) it is same. With 4.15.3 there is other observation where even without kubelet start it failed 2-3 times but then succeed after that multiple time. But with kubelet started it only succeed once and failed multiple time. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
General information
crc setupbefore starting it (Yes/No)? YesCRC version
CRC status
DEBU CRC version: 2.33.0+c43b17 DEBU OpenShift version: 4.14.12 DEBU Podman version: 4.4.4 DEBU Running 'crc status' CRC VM: Running OpenShift: Running (v4.14.12) RAM Usage: 8.573GB of 50.51GB Disk Usage: 31.62GB of 214.1GB (Inside the CRC VM) Cache Usage: 178.9GB Cache Directory: /Users/trees/.crc/cacheCRC config
Host Operating System
Steps to reproduce
podman run registry.redhat.io/rhdh/rhdh-hub-rhel9:1.1-97Expected
Container succesfully starts, only presenting javascript error when probing for plugins.
podman run -it registry.redhat.io/rhdh/rhdh-hub-rhel9:1.1-97 /bin/bash Loading config from MergedConfigSource{FileConfigSource{path="/opt/app-root/src/app-config.yaml"}, FileConfigSource{path="/opt/app-root/src/app-config.example.yaml"}, FileConfigSource{path="/opt/app-root/src/app-config.example.production.yaml"}, EnvConfigSource{count=0}} 2024-03-27T19:46:29.984Z backstage info Found 0 new secrets in config that will be redacted 2024-03-27T19:46:30.103Z backstage info loaded dynamic backend plugin 'backstage-plugin-azure-devops-backend-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-azure-devops-backend-dynamic' 2024-03-27T19:46:30.115Z backstage info loaded dynamic backend plugin 'backstage-plugin-catalog-backend-module-bitbucket-cloud-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-catalog-backend-module-bitbucket-cloud-dynamic' 2024-03-27T19:46:30.126Z backstage info loaded dynamic backend plugin 'backstage-plugin-catalog-backend-module-bitbucket-server-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-catalog-backend-module-bitbucket-server-dynamic' 2024-03-27T19:46:30.158Z backstage info loaded dynamic backend plugin 'backstage-plugin-catalog-backend-module-github-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-catalog-backend-module-github-dynamic' 2024-03-27T19:46:30.190Z backstage info loaded dynamic backend plugin 'backstage-plugin-catalog-backend-module-github-org-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-catalog-backend-module-github-org-dynamic' 2024-03-27T19:46:30.222Z backstage info loaded dynamic backend plugin 'backstage-plugin-catalog-backend-module-gitlab-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-catalog-backend-module-gitlab-dynamic' 2024-03-27T19:46:30.281Z backstage info loaded dynamic backend plugin 'backstage-plugin-jenkins-backend-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-jenkins-backend-dynamic' 2024-03-27T19:46:30.915Z backstage info loaded dynamic backend plugin 'backstage-plugin-kubernetes-backend-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-kubernetes-backend-dynamic' 2024-03-27T19:46:31.037Z backstage info loaded dynamic backend plugin 'backstage-plugin-scaffolder-backend-module-azure-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-scaffolder-backend-module-azure-dynamic' 2024-03-27T19:46:31.068Z backstage info loaded dynamic backend plugin 'backstage-plugin-scaffolder-backend-module-bitbucket-cloud-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-scaffolder-backend-module-bitbucket-cloud-dynamic' 2024-03-27T19:46:31.086Z backstage info loaded dynamic backend plugin 'backstage-plugin-scaffolder-backend-module-bitbucket-server-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-scaffolder-backend-module-bitbucket-server-dynamic' 2024-03-27T19:46:31.123Z backstage info loaded dynamic backend plugin 'backstage-plugin-scaffolder-backend-module-gerrit-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-scaffolder-backend-module-gerrit-dynamic' 2024-03-27T19:46:31.264Z backstage info loaded dynamic backend plugin 'backstage-plugin-scaffolder-backend-module-github-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-scaffolder-backend-module-github-dynamic' 2024-03-27T19:46:31.378Z backstage info loaded dynamic backend plugin 'backstage-plugin-scaffolder-backend-module-gitlab-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-scaffolder-backend-module-gitlab-dynamic' 2024-03-27T19:46:31.427Z backstage info loaded dynamic backend plugin 'backstage-plugin-sonarqube-backend-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-sonarqube-backend-dynamic' 2024-03-27T19:46:31.917Z backstage info loaded dynamic backend plugin 'backstage-plugin-techdocs-backend-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-techdocs-backend-dynamic' 2024-03-27T19:46:31.999Z backstage info loaded dynamic backend plugin 'immobiliarelabs-backstage-plugin-gitlab-backend-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/immobiliarelabs-backstage-plugin-gitlab-backend-dynamic' 2024-03-27T19:46:32.001Z backstage info loaded dynamic backend plugin '@janus-idp/backstage-plugin-3scale-backend-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-3scale-backend-dynamic/alpha' 2024-03-27T19:46:32.002Z backstage info loaded dynamic backend plugin '@janus-idp/backstage-plugin-aap-backend-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-aap-backend-dynamic/alpha' 2024-03-27T19:46:32.031Z backstage info loaded dynamic backend plugin '@janus-idp/backstage-plugin-keycloak-backend-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-keycloak-backend-dynamic/alpha' 2024-03-27T19:46:32.431Z backstage info loaded dynamic backend plugin '@janus-idp/backstage-plugin-ocm-backend-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-ocm-backend-dynamic/alpha' 2024-03-27T19:46:32.433Z backstage info loaded dynamic backend plugin '@janus-idp/backstage-scaffolder-backend-module-quay-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-scaffolder-backend-module-quay-dynamic/alpha' 2024-03-27T19:46:32.485Z backstage info loaded dynamic backend plugin '@janus-idp/backstage-scaffolder-backend-module-regex-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-scaffolder-backend-module-regex-dynamic/alpha' 2024-03-27T19:46:32.533Z backstage info loaded dynamic backend plugin '@janus-idp/backstage-scaffolder-backend-module-servicenow-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-scaffolder-backend-module-servicenow-dynamic/alpha' 2024-03-27T19:46:32.577Z backstage info loaded dynamic backend plugin '@janus-idp/backstage-scaffolder-backend-module-sonarqube-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-scaffolder-backend-module-sonarqube-dynamic/alpha' 2024-03-27T19:46:32.640Z backstage info loaded dynamic backend plugin 'roadiehq-backstage-plugin-argo-cd-backend-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/roadiehq-backstage-plugin-argo-cd-backend-dynamic' 2024-03-27T19:46:32.718Z backstage info loaded dynamic backend plugin 'roadiehq-scaffolder-backend-argocd-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/roadiehq-scaffolder-backend-argocd-dynamic' 2024-03-27T19:46:32.774Z backstage info loaded dynamic backend plugin 'roadiehq-scaffolder-backend-module-utils-dynamic' from 'file:///opt/app-root/src/dynamic-plugins-root/roadiehq-scaffolder-backend-module-utils-dynamic' 2024-03-27T19:46:32.784Z rootHttpRouter info Listening on :7007 2024-03-27T19:46:32.803Z auth info Enabled Provider Factories : {} 2024-03-27T19:46:32.831Z scalprum info Loaded dynamic frontend plugin 'backstage-plugin-azure-devops' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-azure-devops' 2024-03-27T19:46:32.831Z scalprum info Loaded dynamic frontend plugin 'backstage-plugin-dynatrace' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-dynatrace' 2024-03-27T19:46:32.831Z scalprum info Loaded dynamic frontend plugin 'backstage-plugin-github-actions' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-github-actions' 2024-03-27T19:46:32.831Z scalprum info Loaded dynamic frontend plugin 'backstage-plugin-github-issues' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-github-issues' 2024-03-27T19:46:32.832Z scalprum info Loaded dynamic frontend plugin 'backstage-plugin-jenkins' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-jenkins' 2024-03-27T19:46:32.832Z scalprum info Loaded dynamic frontend plugin 'backstage-plugin-kubernetes' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-kubernetes' 2024-03-27T19:46:32.832Z scalprum info Loaded dynamic frontend plugin 'backstage-plugin-lighthouse' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-lighthouse' 2024-03-27T19:46:32.832Z scalprum info Loaded dynamic frontend plugin 'backstage-plugin-sonarqube' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-sonarqube' 2024-03-27T19:46:32.832Z scalprum info Loaded dynamic frontend plugin 'backstage-plugin-tech-radar' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-tech-radar' 2024-03-27T19:46:32.833Z scalprum info Loaded dynamic frontend plugin 'backstage-plugin-techdocs' from 'file:///opt/app-root/src/dynamic-plugins-root/backstage-plugin-techdocs' 2024-03-27T19:46:32.833Z scalprum info Loaded dynamic frontend plugin 'immobiliarelabs-backstage-plugin-gitlab' from 'file:///opt/app-root/src/dynamic-plugins-root/immobiliarelabs-backstage-plugin-gitlab' 2024-03-27T19:46:32.833Z scalprum info Loaded dynamic frontend plugin '@janus-idp/backstage-plugin-acr' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-acr' 2024-03-27T19:46:32.834Z scalprum info Loaded dynamic frontend plugin '@janus-idp/backstage-plugin-analytics-provider-segment' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-analytics-provider-segment' 2024-03-27T19:46:32.834Z scalprum info Loaded dynamic frontend plugin '@janus-idp/backstage-plugin-dynamic-plugins-info' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-dynamic-plugins-info' 2024-03-27T19:46:32.834Z scalprum info Loaded dynamic frontend plugin '@janus-idp/backstage-plugin-jfrog-artifactory' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-jfrog-artifactory' 2024-03-27T19:46:32.834Z scalprum info Loaded dynamic frontend plugin '@janus-idp/backstage-plugin-nexus-repository-manager' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-nexus-repository-manager' 2024-03-27T19:46:32.834Z scalprum info Loaded dynamic frontend plugin '@janus-idp/backstage-plugin-ocm' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-ocm' 2024-03-27T19:46:32.835Z scalprum info Loaded dynamic frontend plugin '@janus-idp/backstage-plugin-quay' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-quay' 2024-03-27T19:46:32.835Z scalprum info Loaded dynamic frontend plugin '@janus-idp/backstage-plugin-rbac' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-rbac' 2024-03-27T19:46:32.835Z scalprum info Loaded dynamic frontend plugin '@janus-idp/backstage-plugin-tekton' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-tekton' 2024-03-27T19:46:32.835Z scalprum info Loaded dynamic frontend plugin '@janus-idp/backstage-plugin-topology' from 'file:///opt/app-root/src/dynamic-plugins-root/janus-idp-backstage-plugin-topology' 2024-03-27T19:46:32.835Z scalprum info Loaded dynamic frontend plugin 'pagerduty-backstage-plugin' from 'file:///opt/app-root/src/dynamic-plugins-root/pagerduty-backstage-plugin' 2024-03-27T19:46:32.836Z scalprum info Loaded dynamic frontend plugin 'roadiehq-backstage-plugin-argo-cd' from 'file:///opt/app-root/src/dynamic-plugins-root/roadiehq-backstage-plugin-argo-cd' 2024-03-27T19:46:32.836Z scalprum info Loaded dynamic frontend plugin 'roadiehq-backstage-plugin-datadog' from 'file:///opt/app-root/src/dynamic-plugins-root/roadiehq-backstage-plugin-datadog' 2024-03-27T19:46:32.836Z scalprum info Loaded dynamic frontend plugin 'roadiehq-backstage-plugin-github-insights' from 'file:///opt/app-root/src/dynamic-plugins-root/roadiehq-backstage-plugin-github-insights' 2024-03-27T19:46:32.836Z scalprum info Loaded dynamic frontend plugin 'roadiehq-backstage-plugin-github-pull-requests' from 'file:///opt/app-root/src/dynamic-plugins-root/roadiehq-backstage-plugin-github-pull-requests' 2024-03-27T19:46:32.836Z scalprum info Loaded dynamic frontend plugin 'roadiehq-backstage-plugin-jira' from 'file:///opt/app-root/src/dynamic-plugins-root/roadiehq-backstage-plugin-jira' 2024-03-27T19:46:32.836Z scalprum info Loaded dynamic frontend plugin 'roadiehq-backstage-plugin-security-insights' from 'file:///opt/app-root/src/dynamic-plugins-root/roadiehq-backstage-plugin-security-insights' 2024-03-27T19:46:32.841Z proxy info [HPM] Proxy created: /quay/api -> https://quay.io/ 2024-03-27T19:46:32.842Z proxy info [HPM] Proxy rewrite rule created: "^/api/proxy/quay/api/?" ~> "/" 2024-03-27T19:46:32.843Z proxy warn skipped configuring /sonarqube due to Proxy target for route "/sonarqube" must be a string, but is of type undefined 2024-03-27T19:46:32.843Z proxy warn skipped configuring /jenkins/api due to Proxy target for route "/jenkins/api" must be a string, but is of type undefined 2024-03-27T19:46:32.844Z proxy warn skipped configuring /jira/api due to Proxy target for route "/jira/api" must be a string, but is of type undefined 2024-03-27T19:46:32.844Z proxy warn skipped configuring /acr/api due to Proxy target for route "/acr/api" must be a string, but is of type undefined 2024-03-27T19:46:32.844Z proxy warn skipped configuring /jfrog-artifactory/api due to Proxy target for route "/jfrog-artifactory/api" must be a string, but is of type undefined 2024-03-27T19:46:32.844Z proxy info [HPM] Proxy created: /pagerduty -> https://api.pagerduty.com 2024-03-27T19:46:32.844Z proxy info [HPM] Proxy rewrite rule created: "^/api/proxy/pagerduty/?" ~> "/" 2024-03-27T19:46:32.845Z proxy warn skipped configuring /dynatrace due to Proxy target for route "/dynatrace" must be a string, but is of type undefined 2024-03-27T19:46:32.845Z proxy warn skipped configuring /nexus-repository-manager due to Proxy target for route "/nexus-repository-manager" must be a string, but is of type undefined 2024-03-27T19:46:32.851Z techdocs info Creating Local publisher for TechDocs 2024-03-27T19:46:32.852Z backstage info Resolving '@backstage/plugin-techdocs-backend/package.json' in the dynamic backend plugins /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1781 throw new errors.ForwardedError( ^ ForwardedError: Module 'gitlabFillerProcessor' for plugin 'catalog' startup failed; caused by Error: Missing required config value at 'integrations.gitlab' at /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1781:21 at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1780:13 at async processNode (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1302:22) ... 7 lines matching cause stack trace ... at async BackstageBackend.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1881:5) { cause: Error: Missing required config value at 'integrations.gitlab' at ConfigReader.getConfigArray (/opt/app-root/src/node_modules/@backstage/config/dist/index.cjs.js:218:13) at ObservableConfigProxy.getConfigArray (/opt/app-root/src/node_modules/@backstage/config-loader/dist/index.cjs.js:1327:30) at new GitlabFillerProcessor (/opt/app-root/src/dynamic-plugins-root/immobiliarelabs-backstage-plugin-gitlab-backend-dynamic/dist/index.cjs.js:137:14) at Object.init [as func] (/opt/app-root/src/dynamic-plugins-root/immobiliarelabs-backstage-plugin-gitlab-backend-dynamic/dist/index.cjs.js:201:37) at /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1780:35 at process.processTicksAndRejections (node:internal/process/task_queues:95:5) at async processNode (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1302:22) at async Promise.all (index 7) at async processMoreNodes (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1297:7) at async _DependencyGraph.parallelTopologicalTraversal (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1308:5) at async /opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1777:9 at async Promise.all (index 1) at async BackendInitializer.doStart_fn (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1757:3) at async BackendInitializer.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1611:5) at async BackstageBackend.start (/opt/app-root/src/node_modules/@backstage/backend-app-api/dist/index.cjs.js:1881:5) } Node.js v18.19.0Actual
Container does not start correctly, it instead segfaults.
Logs
No crc logs beyond starting:
Journal for the CRC VM shows the segfault:
Podman output:
Journal for the CRC VM shows the segfault:
[root@crc-vlf7c-master-0 /]# podman start registry.redhat.io/rhdh/rhdh-hub-rhel9:1.1-97Error: no container with name or ID "registry.redhat.io/rhdh/rhdh-hub-rhel9:1.1-97" found: no such container[root@crc-vlf7c-master-0 /]# podman run registry.redhat.io/rhdh/rhdh-hub-rhel9:1.1-97Loading config from MergedConfigSource{FileConfigSource{path="/opt/app-root/src/app-config.yaml"}, FileConfigSource{path="/opt/app-root/src/app-config.example.yaml"}, FileConfigSource{path="/opt/app-root/src/app-config.example.production.yaml"}, EnvConfigSource{count=0}}[root@crc-vlf7c-master-0 /]#Please consider posting the output of
crc start --log-level debugon http://gist.github.com/ and post the link in the issue.This issue is specific to CRC on MacOS, there are reports of rhdh running as expected on CRC with Fedora 39.
I am not able to reproduce this issue using a Vanilla Fedora 39 Server install with Podman using Parallels (Apple Virtulization Framework) with the same hardware (Intel MacOS). RHDH runs as expected on this.
The text was updated successfully, but these errors were encountered: