Code

Distributed inference example#890

Code

Draft

angeloskath wants to merge 4 commits intomainml-explore/mlx-examples:mainfrom distributed-layersml-explore/mlx-examples:distributed-layersCopy head branch name to clipboard

+123-31

Commits

Commits on Nov 5, 2024

• Start distributed inference for llama models

  angeloskath

  committed
  5e18b59

• Temporarily remove async_eval

  angeloskath

  committed
  043fc2a

• Remove async eval and add sequential load

  angeloskath

  committed
  1c52719

Commits on Nov 6, 2024

• Make the chat distributed

  angeloskath

  committed
  6041c7e