supporting anthropic MCP servers

[rawwerks]

any interest from the berriAI team on modifying the litellm client to also serve as an anthropic "MCP Client", such that MCP servers can be called?

https://github.com/modelcontextprotocol

[runekaagaard]

Yeah I had the exact same idea. I'm using various chatgpt specific tools in emacs with litellm to use different LLM providers like Claude and having litellm handle the MCP part sounds like a great idea to enhance a LOT of different platforms with MCP. I would be open to work on it if it makes sense. There is a new quickstart repo with a client example here:

https://github.com/modelcontextprotocol/quickstart-resources/blob/main/mcp-client/client.py

I'm not sure if it's a good fit, what would talk against doing it?

[krrishdholakia]

hey @rawwerks @runekaagaard this is interesting. i can't find an api reference - am i misunderstanding mcp or is it just missing docs for how to call their api's?

if someone has an e2e example here it would be great

-litellm maintainer