llmops
Here are 277 public repositories matching this topic...
The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
-
Updated
Jun 5, 2024 - Python
Evaluation and Tracking for LLM Experiments
-
Updated
Jun 5, 2024 - Jupyter Notebook
RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
-
Updated
Jun 5, 2024 - Python
No-code multi-agent framework to build LLM Agents, workflows and applications with your data
-
Updated
Jun 5, 2024 - Python
A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
-
Updated
Jun 5, 2024 - Jupyter Notebook
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
-
Updated
Jun 5, 2024 - Python
A high-throughput and memory-efficient inference and serving engine for LLMs
-
Updated
Jun 5, 2024 - Python
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
-
Updated
Jun 5, 2024 - Jupyter Notebook
AI Observability & Evaluation
-
Updated
Jun 5, 2024 - Jupyter Notebook
Test your prompts, agents, and RAGs. Use LLM evals to improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
-
Updated
Jun 5, 2024 - TypeScript
🪢 Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23
-
Updated
Jun 4, 2024 - TypeScript
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
-
Updated
Jun 4, 2024 - Python
Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
-
Updated
Jun 4, 2024 - Python
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
-
Updated
Jun 4, 2024 - Python
🐢 Open-Source Evaluation & Testing for LLMs and ML models
-
Updated
Jun 4, 2024 - Python
DrakeLLM is developed to help students to solve the issue of making notes from videos, books and others. Utilising RAG, Drake helps in making quick notes along with a Q&A bot. Books, YouTube tutorials or Videos, Drake supports all your means.
-
Updated
Jun 4, 2024 - Python
ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.
-
Updated
Jun 4, 2024 - Python
Improve this page
Add a description, image, and links to the llmops topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the llmops topic, visit your repo's landing page and select "manage topics."