Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

community repo image sizes #47

Open
optiz0r opened this issue Apr 30, 2019 · 1 comment
Open

community repo image sizes #47

optiz0r opened this issue Apr 30, 2019 · 1 comment
Assignees

Comments

@optiz0r
Copy link
Collaborator

optiz0r commented Apr 30, 2019

Raising an issue after discussing with @geaaru in #sabayon-dev, Community images are growing excessively. Pre-mottainai we had weekly squashes which would flatten the docker image layers (reducing churn), and monthly cache_clean jobs which would end the chains. Under mottainain, I don't think we have either of these, and images are growing unbounded.

We could schedule a mottanai plan which runs the cache_clean job again, but as there's no locking support that I'm aware of, we could easily get into a race condition where the results of the long-running clean-plus-full-rebuild job get replaced by the next execution of the normal job. I think some locking support in mottainai is needed?

@mudler
Copy link
Member

mudler commented Apr 30, 2019

Correct, we had this previously, now we can just trigger tasks with cache_clean.

For this operation you don't need to actually tag into a namespace, but just wipe the cache and create a fresh one, so it is sufficient to add this in the task:

cache_image: "yes"
cache_clean: "yes"

But this is a trick to accomplish that until we have a proper way to handle this.

There is some rough optional protection support in my branch (but lacks still lot of functionalities, things as locks) that should prevent namespace overlaps, by dropping new tasks targeting the same namespace.

I would rather prefer to have in the long run an api endpoint to manage this kind of resources, and how you can prune them, wdyt?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants