Nydus 2024 Roadmap

[imeoer]

Build System

Feature	Description	Status
Image Commit	nydusify commit commits a new nydus image from a nydus container, like docker/nerdctl commit.	#1543, #1557
Image Deduplicate	analyze the chunk similarity of image data to generate a chunk dict to reduce image incremental size.	#1572
AI Model Reference	make nydus image support referencing LLM model data stored on external storage, make image build faster and image run senselessly.	#1545, containerd/nydus-snapshotter#580
Image Compact	merge small layers of images after de-duplicated by the chunk dict to improve image runtime performance	TODO

Runtime System

Feature	Description	Status
Streaming Prefetch	previous prefetch method was at the file and chunk level, which resulted in high QPS and connection counts for the backend, the streaming prefetch implements at the blob level.	#1538
Prefetch Analysis and Build	analyze and prioritize prefetching the files that container need to access first, and build this high-priority data into a separate image layer for prefetching during the image startup phase.	containerd/nydus-snapshotter#572
Nydus & Dragonfly Performance	dragonfly optimize performance for nydus' massive small IO pattern	TODO
Nydus Config Hot Reload	implement nydusd diskless config and hot reload capability, also ensure compatibility with nydusd hot upgrade and failover handling	TODO
Nydus Volume	support mount nydus image/data as a container volume	TODO

Stability & Docs

Feature	Description	Status
Nydusd & Snapshotter	improve ease of use and stability	TODO
Nydusd & Snapshotter	improve user documentation	TODO