Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Superset leaks open db connections #31868

Open
3 tasks done
martimors opened this issue Jan 15, 2025 · 0 comments
Open
3 tasks done

Superset leaks open db connections #31868

martimors opened this issue Jan 15, 2025 · 0 comments
Assignees
Labels
#bug:performance Performance bugs

Comments

@martimors
Copy link
Contributor

martimors commented Jan 15, 2025

Bug description

I have performed some load testing on our superset instance, and to my surprise, the limiting factor is the number of open database connections. In our case, the database is a rather beefy postgresql instance hosted in Azure.

Image

I made the load test bombard the following endpoints using Locust:

  • Log in (once per user)
  • List datasets, api/v1/datasets (weight 100)
  • Create and delete a chart, api/v1/chart (weight 10)
  • Get a data sample for a chart, api/v1/chart/data (weight 1, this hits DataBricks)

After some time, the console gets spammed with errors from sqlalchemy that the connection pool is full.

Somewhere in the app, connections are opened and not being closed, and this severely hampers performance.

Screenshots/recordings

No response

Superset version

4.1.1

Python version

I don't know

Node version

I don't know

Browser

Not applicable

Additional context

No response

Checklist

  • I have searched Superset docs and Slack and didn't find a solution to my problem.
  • I have searched the GitHub issue tracker and didn't find a similar bug report.
  • I have checked Superset's logs for errors and if I found a relevant Python stacktrace, I included it here as text in the "additional context" section.
@dosubot dosubot bot added the #bug:performance Performance bugs label Jan 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
#bug:performance Performance bugs
Projects
None yet
Development

No branches or pull requests

3 participants