Repositories list

• litellm

  Public
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

  gatewaybedrockopenai+ 9vertex-aiazure-openaillmlangchainllmopsanthropicopenai-proxy+ 2

  Python

  •

  Other

  •1.8k•15k•767•215•Updated Dec 27, 2024Dec 27, 2024

• proxy_load_tester

  Public
  Python

  •

  MIT License

  •8•4•0•0•Updated Dec 14, 2024Dec 14, 2024

• example_openai_endpoint

  Public
  An example OpenAI /chat/completions endpoint

  Python

  •4•4•0•1•Updated Nov 26, 2024Nov 26, 2024

• locust-load-tester

  Public
  Python

  •1•0•0•0•Updated Nov 11, 2024Nov 11, 2024

• provider-litellm-http

  Public
  Crossplane Provider designed to facilitate sending LiteLLM HTTP requests as resources.

  Go

  •

  Apache License 2.0

  •15•1•0•0•Updated Oct 23, 2024Oct 23, 2024

• provider-litellm

  Public
  LiteLLM Gateway (Proxy) crossplane provider

  Go

  •

  Apache License 2.0

  •0•0•0•0•Updated Oct 21, 2024Oct 21, 2024

• example_litellm_gcp_cloud_run

  Public
  Example Repo to deploy LiteLLM Proxy (AI Gateway) on GCP Cloud Run

  Dockerfile

  •

  MIT License

  •8•2•0•0•Updated Oct 16, 2024Oct 16, 2024

• proxy_load_tester_4

  Public
  Python

  •

  MIT License

  •8•0•0•0•Updated Apr 23, 2024Apr 23, 2024

• prometheus-deploy

  Public
  A Blueprint for deploying Prometheus to render.com

  Dockerfile

  •5•0•0•0•Updated Apr 16, 2024Apr 16, 2024

• proxy_load_tester_3

  Public
  Python

  •

  MIT License

  •8•0•0•0•Updated Apr 11, 2024Apr 11, 2024

• proxy_load_tester_2

  Public
  Python

  •

  MIT License

  •8•1•0•0•Updated Apr 11, 2024Apr 11, 2024

• example_anthropic_endpoint

  Public
  An example anthropic API Endpoint

  Python

  •

  MIT License

  •0•1•0•0•Updated Apr 6, 2024Apr 6, 2024

• simple_litellm_proxy

  Public
  Python

  •1•2•0•0•Updated Apr 6, 2024Apr 6, 2024

• simple_proxy_openai

  Public
  Python

  •2•1•0•0•Updated Mar 27, 2024Mar 27, 2024

• locust-github-action

  Public
  Shell

  •11•0•0•0•Updated Mar 14, 2024Mar 14, 2024

• assistants_test_project

  Public
  test project using OpenAI assistants API

  0•0•0•0•Updated Mar 7, 2024Mar 7, 2024

• liteLLM-proxy

  Public
  Python

  •

  MIT License

  •29•129•8•0•Updated Feb 10, 2024Feb 10, 2024

• litellm-CodeLlama-server

  Public
  Python

  •7•13•0•1•Updated Jan 25, 2024Jan 25, 2024

• bettertest

  Public
  Python

  •1•75•1•0•Updated Jan 24, 2024Jan 24, 2024

• litellm-staging

  Public
  Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

  Python

  •

  MIT License

  •1.8k•1•0•0•Updated Jan 3, 2024Jan 3, 2024

• trend-api

  Public
  Anomaly detection and forecasting API

  R

  •

  GNU General Public License v3.0

  •11•0•0•0•Updated Dec 26, 2023Dec 26, 2023

• reliableGPT

  Public
  Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors

  Python

  •

  MIT License

  •40•638•19•1•Updated Nov 20, 2023Nov 20, 2023

• llm-benchmark

  Public
  List of good LLM Benchmarks

  0•6•0•0•Updated Nov 3, 2023Nov 3, 2023

• openai-proxy

  Public
  Python

  •

  MIT License

  •5•20•0•0•Updated Oct 23, 2023Oct 23, 2023

• litellm_playground_fe_template

  Public
  Python

  •

  MIT License

  •4•8•0•0•Updated Oct 16, 2023Oct 16, 2023

• error-logs-ui

  Public
  JavaScript

  •1•0•0•0•Updated Sep 20, 2023Sep 20, 2023

• openai-proxy-ab-testing

  Public
  Python

  •0•2•0•0•Updated Sep 8, 2023Sep 8, 2023

• llm-zoo

  Public
  Python

  •

  MIT License

  •2•1•0•0•Updated Aug 29, 2023Aug 29, 2023

• anthropic_playground

  Public
  Python

  •

  MIT License

  •1•1•0•0•Updated Aug 29, 2023Aug 29, 2023

• Awesome-LLMOps

  Public
  An awesome & curated list of best LLMOps tools for developers

  Shell

  •

  Creative Commons Zero v1.0 Universal

  •406•24•0•0•Updated Jun 21, 2023Jun 21, 2023