Occasional 500 errors on sysdig

[vburckhardt]

Description

 2024/04/18 11:42:42 Terraform apply | Error: [ERROR] Error when creating resource instance: Please contact the Service Provider for this error. [500, Internal Server Error] Sysdig provision request return code: 500 message: INTERNAL_SERVER_ERROR with resp code: {
 2024/04/18 11:42:42 Terraform apply |     "StatusCode": 502,
 2024/04/18 11:42:42 Terraform apply |     "Headers": {
 2024/04/18 11:42:42 Terraform apply |         "Cache-Control": [
 2024/04/18 11:42:42 Terraform apply |             "max-age=0, no-cache, no-store"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "Content-Length": [
 2024/04/18 11:42:42 Terraform apply |             "673"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "Content-Type": [
 2024/04/18 11:42:42 Terraform apply |             "application/json; charset=utf-8"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "Date": [
 2024/04/18 11:42:42 Terraform apply |             "Thu, 18 Apr 2024 11:41:36 GMT"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "Expires": [
 2024/04/18 11:42:42 Terraform apply |             "Thu, 18 Apr 2024 11:41:36 GMT"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "Pragma": [
 2024/04/18 11:42:42 Terraform apply |             "no-cache"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "Request-Id": [
 2024/04/18 11:42:42 Terraform apply |             "85dfef4b-4065-489e-bab6-941d763eb895"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "Retry-After": [
 2024/04/18 11:42:42 Terraform apply |             "0"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "Server": [
 2024/04/18 11:42:42 Terraform apply |             "istio-envoy"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "Strict-Transport-Security": [
 2024/04/18 11:42:42 Terraform apply |             "max-age=31536000;includeSubDomains"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "Transaction-Id": [
 2024/04/18 11:42:42 Terraform apply |             "bss-83c55e6471fc0f43"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "X-Content-Type-Options": [
 2024/04/18 11:42:42 Terraform apply |             "nosniff"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "X-Envoy-Upstream-Service-Time": [
 2024/04/18 11:42:42 Terraform apply |             "2517"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "X-Global-Transaction-Id": [
 2024/04/18 11:42:42 Terraform apply |             "bss-83c55e6471fc0f43"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "X-Op-Completion-Time": [
 2024/04/18 11:42:42 Terraform apply |             ""
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "X-Ratelimit-Limit": [
 2024/04/18 11:42:42 Terraform apply |             "100"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "X-Ratelimit-Remaining": [
 2024/04/18 11:42:42 Terraform apply |             "99"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "X-Ratelimit-Reset": [
 2024/04/18 11:42:42 Terraform apply |             "0"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "X-Request-Id": [
 2024/04/18 11:42:42 Terraform apply |             "85dfef4b-4065-489e-bab6-941d763eb895"
 2024/04/18 11:42:42 Terraform apply |         ],
 2024/04/18 11:42:42 Terraform apply |         "X-Transaction-Id": [
 2024/04/18 11:42:42 Terraform apply |             "bss-83c55e6471fc0f43"
 2024/04/18 11:42:42 Terraform apply |         ]
 2024/04/18 11:42:42 Terraform apply |     },
 2024/04/18 11:42:42 Terraform apply |     "Result": {
 2024/04/18 11:42:42 Terraform apply |         "details": "{\"operation\":\"Provision\",\"description\":\"Sysdig provision request return code: 500 message: INTERNAL_SERVER_ERROR\",\"dashboard_url\":\"https://us-south.monitoring.cloud.ibm.com/api/oauth/openid/IBM/190c293e9fda4c6684b5acf4b17871b8/8deded7a-5df6-483b-a140-d78fd888c244\",\"default_consumer_instance\":false,\"public_service_endpoint_enabled\":false,\"api_token_auth_disabled\":false}",
 2024/04/18 11:42:42 Terraform apply |         "error_code": "RC-ServiceBrokerErrorResponse",
 2024/04/18 11:42:42 Terraform apply |         "message": "Please contact the Service Provider for this error. [500, Internal Server Error] Sysdig provision request return code: 500 message: INTERNAL_SERVER_ERROR",
 2024/04/18 11:42:42 Terraform apply |         "status_code": 502,
 2024/04/18 11:42:42 Terraform apply |         "transaction_id": "bss-83c55e6471fc0f43"
 2024/04/18 11:42:42 Terraform apply |     },
 2024/04/18 11:42:42 Terraform apply |     "RawResult": null
 2024/04/18 11:42:42 Terraform apply | }
 2024/04/18 11:42:42 Terraform apply | 
 2024/04/18 11:42:42 Terraform apply | 
 2024/04/18 11:42:42 Terraform apply |   with module.observability_instance.module.cloud_monitoring.ibm_resource_instance.cloud_monitoring[0],
 2024/04/18 11:42:42 Terraform apply |   on .terraform/modules/observability_instance/modules/cloud_monitoring/main.tf line 5, in resource "ibm_resource_instance" "cloud_monitoring":
 2024/04/18 11:42:42 Terraform apply |    5: resource "ibm_resource_instance" "cloud_monitoring" {
 2024/04/18 11:42:42 Terraform apply | 
 2024/04/18 11:42:42 �[1m�[31mTerraform APPLY error: Terraform APPLY errorexit status 1�[39m�[0m

New or affected modules

---

By submitting this issue, you agree to follow our Code of Conduct

[ocofaigh]

OK, as suspected, this is because there is already an instance with platform metrics enabled, but the error message is not exposing that:

From logs perspective, I am seeing the provisioning is trying to define the "defaultConsumerInstance" and there is an existing instance enabled (for platform metrics) in the same region (specifically: 4df48161-f317-4084-abfa-caf070b562d0 (don't know why that part of the error is not propagated)

I have reached out to Sysdig team about the error message (as it used to give a meaningful message), and have created #44 to track exposing the ability to disable platform metrics

[ocofaigh]

Sysdig team have updated the error