Replace pdm to uv for faster dependency management
#347
Conversation
…l usage of pdm with uv
github-actions
bot
added
enhancement
| WORKDIR /project | ||
|
|
||
| # Install uv | ||
| COPY --from=ghcr.io/astral-sh/uv:0.5.2 /uv /bin/uv |
There was a problem hiding this comment.
Does this definitely work? I'm sure you tested it and I just didn't realise this syntax was possible 😅
But I thought that --from and external source never used to be an option!
That's why I used this pattern:
FROM ghcr.io/astral-sh/uv:0.5.2 as uv-image
...
COPY --from=uv-image /uv /bin/uvThere was a problem hiding this comment.
Nice! Thus must have been added in a recent docker version
https://docs.docker.com/build/building/multi-stage/#use-an-external-image-as-a-stage
| # Install dependencies and project into the local packages directory | ||
| RUN pdm install --check --prod --no-editable | ||
| # Sync the project again using uv, ensuring all project dependencies are installed | ||
| RUN --mount=type=cache,target=/root/.cache/uv \ |
There was a problem hiding this comment.
What's the reason for the double sync?
There was a problem hiding this comment.
What's the reason for the double
sync?
RUN --mount=type=cache,target=/root/.cache/uv \
--mount=type=bind,source=pyproject.toml,target=pyproject.toml \
--mount=type=bind,source=uv.lock,target=uv.lock \
uv sync --frozen --no-install-project
# Sync the project again using uv, ensuring all project dependencies are installed
RUN --mount=type=cache,target=/root/.cache/uv \
uv sync
I found, the first uv sync with --no-install-project caches dependencies, while the second installs the project after copying the code. This speeds up builds. Details: [link].
There was a problem hiding this comment.
Love the idea!
But the code is not copied in between the two run commands, meaning this extra step doesn't really do anything 😆
(You could probably remove the second sync with no consequence)
Replaced
pdmwithuvfor faster dependency management.uvis written in Rust, making it much faster for locking dependencies and managing Python versions.Changes:
pdmusage touv.uvcompatibility.Bonus:
Pre-commit hook ensures lockfile updates automatically.
Reference:
Inspired by [fmtm PR #1891](hotosm/fmtm#1891).
@spwoodcock @nrjadkry @nischalstha9 , I've updated the project to use
uvas the package manager. Could you please review the changes.