🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.

DeveloperGPT is a LLM-powered command line tool that enables natural language to terminal commands and in-terminal chat.

Open source Python SDK for agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks like CrewAI, Langchain, and Autogen

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

LLM-driven software development helper.

Design, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.

Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory.

✨ A Copilot Chat experience in Neovim. Supports Anthropic, Ollama and OpenAI

Private, secure, AI chatbot interface to serve locally or host on an HTML. This simplified interface and minimal file format aims to provide a frramework easily built and expanded on as the field of AI continues to grow. Currently in the early stages: Development is happening rapidly.

Java version of LangChain

Enhanced ChatGPT Clone: Features OpenAI, Assistants API, Azure, Groq, GPT-4 Vision, Mistral, Bing, Anthropic, OpenRouter, Vertex AI, Gemini, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. More features in development

This repository provides a LangChain-powered chatbot for customer support, enabling businesses to deliver efficient and personalized support experiences to their customers. Leverage the power of natural language processing (NLP) to handle customer inquiries, resolve issues promptly, and enhance overall customer satisfaction.

Amazon Bedrock Anthropic Claude, (Llama2-7B/13B/70B /Falcon-7B/40B/180B on Amazon Sagemaker) LLMs with Amazon Opensearch Serverless as a Vector DB

AI client for Ollama, Groq, Anthropic and OpenAI

AI-First Process Automation with Large ([Language (LLMs) / Action (LAMs) / Multimodal (LMMs)] / Visual Language (VLMs)) Models

Evaluate LLMs capability of assessing semantic relations

OpenLIT is an open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics in a single application 🔥 🖥 . Open source GenAI and LLM Application Performance Monitoring (APM) & Observability tool

Scala client for OpenAI API

🤖 Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG