New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Master issue: Improve ScanCode resources usage (CPU, RAM, Disk) #3755

Open

9 tasks

pombredanne opened this issue Apr 30, 2024 · 1 comment

Member

pombredanne commented Apr 30, 2024

It would be great to optimize resources usage.
In particular, these are the likely key hot spots:

memory as used in license detection (was typically 0.8 GB now closer to 1.5GB per process)
memory when return large JSON scans (which are all re-loaded in memory assembled from the cache)
CPU when running copyright detection
CPU when running license detection

Some related issues:

Member Author

pombredanne commented Apr 30, 2024

@tdruez can you reference related ScanCode.io issues
@JonoYang same on PurlDB?

tdruez mentioned this issue

Raise minimum required resources (RAM) per CPU core nexB/scancode.io#1191

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment