-
Notifications
You must be signed in to change notification settings - Fork 135
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add subcmd to use metadata to roughly calculate the size of the local bandersnatch mirror #1305
Comments
Howdy, This isn't really a bandersnatch question. This is all a limitation of lots of small files on your storage backend. The only ideas we could possibly try:
Another hack I've generally recommended is making a dedicated partition or volume for each part of bandersnatch's storage - e.g. simple and packages directories to be in their own filesystems and then
I don't have the cycles to look into these ideas, but would take a PR add docs or a |
Thank you for your reply, and look forward to adding the du parameter to bandersmatch. |
Awesome. Yeah I’ll be surprised if it’s much faster and will be hard to get accurate without checking if the files exist, which is the expensive part. It might surprise us and be much quicker than du … |
At present, I can obtain the official directory size of pypi(https://pypi.org/stats/), while I am synchronizing the pypi directory. However, the du or duc command takes too long to count. Is there a more convenient way to do this?
The text was updated successfully, but these errors were encountered: