⬢github first seen 1 d ago, last 2 h ago, peak #7

LiteLLM gateway lets developers call 100+ AI APIs from one interface

Original: BerriAI/litellm

BerriAI's LiteLLM is drawing attention as an open-source AI gateway built on a Rust core with a Python SDK. It lets developers call more than 100 large language model APIs — including Bedrock, Azure, OpenAI, Anthropic, Vertex AI, vLLM and Nvidia NIM — in OpenAI or native format, with built-in cost tracking, guardrails, load balancing and logging. The project is trending among developers building applications across multiple AI providers.

Why now: Developers are actively seeking unified tools to manage multiple LLM providers amid rapid growth in AI API usage.

BerriAILiteLLMOpenAIAnthropicAWS Bedrock

Open on github →

Evidence

• BerriAI/litellm · BerriAI · 16

  The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

API: https://socialmediatrends-api.osmike.com/v1/trends/1601242