New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Incremental Synchronization Issue with Bandersnatch #1663
Comments
You're in luck. bandersnatch does not delete unless you run a We do not have a feature to only take new packages created/added on PyPI to day. But I am not sure you mean this. I would take a PR to do so, but I don't know the cleanest way. I guess pull down the fill mirror list via the XMLRPC call we do and save all the package names and use that as your start point. Then from there compare to the original list and make that an allow list maybe? This would need to be some sort of filter plugin to be accepted. |
Thank you very much. I only want to mirror all packages from the pypi.org. My target is to build a comprehensive dataset of python registry for research. |
I am currently using
bandersnatch
for mirroring PyPI and have encountered an issue regarding incremental synchronization. I want to set up mybandersnatch
mirror to only sync new packages added topypi.org
. For packages that have been removed from pypi.org, do not delete these packages from the local mirror during synchronization. In short, only perform incremental backups without deleting any packages.how to configure
bandersnatch.conf
to achieve this?The text was updated successfully, but these errors were encountered: