L

LiteLLM

Access 100+ LLMs via a unified Python SDK and AI Gateway.

PlatformOpen SourceGrowing
Visit Website36K

What is LiteLLM?

LiteLLM is access 100+ LLMs via a unified Python SDK and AI Gateway.

About

LiteLLM is a tool designed for developers and ML teams to easily access and manage over 100 large language models (LLMs) through a unified interface. It offers both a Python SDK and an AI Gateway, allowing users to call various LLMs in OpenAI format and integrate with A2A agents and MCP servers. Key capabilities include model invocation, agent communication, and MCP tool integration.

Strengths

  • Supports over 100 LLMs with a unified interface.
  • Flexible deployment options via Proxy Server or Python SDK.
  • Easy integration with A2A agents and MCP tools.

Limitations

  • May require setup and configuration for optimal use.
  • Limited support for non-Python environments.
  • Dependency on external LLM providers for functionality.

Use Cases

Invoke multiple LLMs for various tasks using a single API.Integrate A2A agents for advanced conversational capabilities.Connect MCP servers to leverage additional tools and functionalities.

Integrations

OpenAIAnthropicAzureBedrockVertex AILangGraphPydantic AI