Any-llm

lastmod 2025-07-30created 2025-07-302 edits

A single interface for many LLM providers

About

• A Python library from the Mozilla AI team that lets you use 20+ LLM providers through a single function
  • To switch between models from OpenAI, Anthropic, Google, Mistral, AWS Bedrock, etc., you only change provider_id/model_id
• Uses the official provider SDKs first to minimize compatibility issues, and requires no separate proxy/gateway server, so it is ready to use right after pip install
• Developer-friendly: full IDE type hints, intuitive exception handling, custom exceptions, documentation, and a quick-start guide
• A lightweight router that is framework-agnostic and needs no separate proxy/gateway server (usable right away with just an API key)
• Solves the problems of existing solutions and is actively maintained: used in real products such as Mozilla's any-agent
  • LiteLLM: implements providers itself instead of using official SDKs → compatibility/bug concerns
  • AISuite: modular structure, but lacking in maintenance and typing
  • Framework-dependent: fragmented again per project
  • Proxy-only: requires a separate server, adds complexity

See also

• LLM

Favorite site

• Github - mozilla-ai/any-llm
• any-llm - A single interface for many LLM providers | GeekNews