Trouble Connecting to LocalStack from GitHub CI | Connect to 127.0.0.1:4566 [/127.0.0.1] failed: Connection refused

[SujithKrishnan31]

Select Topic Area

Hello,

Has anybody noticed similar issue when running 'localstack' application in a service container and access the application from the GitHub Actions host. I'm trying to set up LocalStack within GitHub CI pipeline, but I'm encountering following error.

com.amazonaws.SdkClientException: Unable to execute HTTP request: Connect to 127.0.0.1:4566 [/127.0.0.1] failed: Connection refused (Connection refused): Unable to execute HTTP request: Connect to 127.0.0.1:4566 [/127.0.0.1] failed: Connection refused (Connection refused)

CI workflow

  tests:
    name: Run unit tests
    runs-on: enterprise-runner
    timeout-minutes: 10
    container:
      image: ...../airflow_testbed:latest
      env:
        TEST_MOCK_SERVICES_HOST: localstack
      volumes:
        - ${{ github.workspace }}:/airflow-utils/
    services:
      localstack:
        image: localstack/localstack
        env:
          SERVICES: s3
        ports:
          - 4566:4566
          - 4571:4571

Basically I'm trying to run pytest for my airflow codebase and it works fine when running in locally.

Here I access the env value in test file

	TARGET_HOST = os.environ.get("TEST_MOCK_SERVICES_HOST", "localhost")
	host = f"http://{TARGET_HOST}:4566"
    mocker.patch.object(
        BaseHook,
        "get_connection",
        return_value=Connection(
            conn_id="s3_connection",
            host=host,
            extra='{"host": "' + host + '"}',
        ),
    )

Dont know why --network and --endpoint options are not supported here

[ghost]

Add a step in your GitHub Actions workflow before your tests run to check connectivity to the LocalStack service. You could use simple tools like curl to see if the port is open:

- name: Check LocalStack connectivity
  run: |
    curl -f http://localstack:4566/health || echo "Cannot connect to LocalStack"

Temporarily hardcode the TARGET_HOST in your test setup to localstack to rule out any environment variable issues.

[SujithKrishnan31]

Thanks for the suggestion, Vontanne Hovhannes! I went through different options and pinpointed the issue.

By default, the spark.hadoop.fs.s3a.endpoint property was connecting to localhost, overriding the TEST_MOCK_SERVICES_HOST environment variable set to localstack.

The problem was resolved by configuring s3.endpoint correctly for localstack.