Skip to content

Latest commit

 

History

History
68 lines (58 loc) · 7.53 KB

README.md

File metadata and controls

68 lines (58 loc) · 7.53 KB

Awesome MLX

An awesome list dedicated to the MLX library from Apple

Articles

2024

Models

Libraries and Tools

  • mlxserver: This Python library is the easist way to begin building on top of Apple's machine learning library, MLX.
  • mlx-llm: Large Language Models (LLMs) applications and tools running on Apple Silicon in real-time with Apple MLX.
  • lightning-whisper-mlx: An incredibly fast implementation of Whisper optimized for Apple Silicon.
  • mlx-benchmark: Benchmark of Apple MLX operations on all Apple Silicon chips (GPU, CPU) + MPS and CUDA.
  • MLX-VLM: MLX-VLM is a package for running Vision LLMs locally on your Mac using MLX.
  • mlx-llm-server: For inferring and serving local LLMs using the MLX framework
  • mlx-transformers: MLX Transformers is a library that provides model implementation in MLX. It uses a similar model interface as HuggingFace Transformers and provides a way to load and run models in Apple Silicon devices.
  • mlxcli: Run large models from the terminal using Apple MLX.
  • SiLLM: SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.
  • MLX_CLIP 📚🤖: A simple package to use CLIP on apple silicon using the MLX libraries from Apple
  • outlinesmlx: A fast minimalistic implementation of guided generation on Apple Silicon using Outlines and MLX
  • mlx-embedding-models: Run text embeddings on your Apple Silicon GPU. Supports any BERT- or RoBERTa-based embedding model, with a curated registry of high-performing models that just work off the shelf.
  • RLX: Reinforcement Learning with MLX: https://github.com/noahfarr/rlx
  • 🍏 MLX - ResNet 🍏: ResNet implementation with the MLX, Apple's DL framework.
  • mlx_stft: Short-Time Fourier Transform (STFT) for MLX (Apple)
  • PyOllaMx (Ollama + MlX): Your gateway to both Ollama & Apple MlX models
  • mlx-bench: Benchmark MLX Performance across commits
  • mlx-image: mlx image models for Apple Silicon machines
  • mlx-local-server: A tiny server to run local inference on MLX model in the style of OpenAI
  • AutoMLX: An easy-to-use LLMs inference tool for quickly loading models accelerated by the Apple MLX framework on Mac devices, and providing a simple and compatible API interface for integration with other LLMs tools.

Demo

  • mlx-chat-app: Chat with MLX is a high-performance macOS application that connects your local documents to a personalized large language model (LLM).
  • photo-similarity-search: Super simple MLX (apple silicon) CLIP based photo similarity web app
  • Video Summarization: Transcribe and summarize videos using whisper and llms on apple mlx framework
  • MLX Assistant: A simple script to enhance text editing across your Mac, leveraging the power of MLX. Designed for seamless integration, it offers real-time text correction everywhere you type.
  • MLX RAG With GGUF Model Weights: Minimal, clean code implementation of RAG with mlx using gguf model weights
  • Enhancing Video Analysis with MLX: A Guide: Explore the capabilities of the MLX library and leverage the genAI stack on MacOS to interact with any video.
  • MLX Demos: Explore machine learning techniques with Gradio interfaces for Stable Diffusion image generation and LoRA text generation with the Apple MLX framework.
  • MLX Chat: A simple UI / Web / Frontend for MLX mlx-lm using Streamlit.
  • SiLLM-examples: Examples for using SiLLM
  • PyOMlx: A wannabe Ollama equivalent for Apple MlX models
  • MLX Community Projects: Let's collect some cool MLX integrations and community lead projects here for visibility!
  • nanoGPT_mlx: Port of Andrej Karpathy's nanoGPT to Apple MLX framework.
  • Autogram: Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.
  • MLX RAG: Retrieval Augmented Generation (RAG) example using Langchain (loader), Chroma (vector database), Hugging Face sentence-transformers (embeddings) and MLX (LLM).
  • mflux: Run the powerful FLUX models from Black Forest Labs locally on your Mac!

MLX Swift

  • MLX Swift: Swift API for MLX
  • MLX Swift Examples: Examples using MLX Swift
  • mlx-swift-chat: A multi-platform SwiftUI frontend for running local LLMs with Apple's MLX framework.
  • ChatMLX: ChatMLX is a large model real-time conversation app implemented using MLX
  • Ph3iOSOnDeviceChatApp: Source code to run Microsoft's Phi 3 Min 4K model completely on device