⬢github first seen 15 h ago, last 14 min ago, peak #7

LiteLLM open-source AI gateway draws developer attention

Original: BerriAI/litellm

BerriAI's LiteLLM, an open-source AI gateway, is gaining traction among developers. The Python-based tool lets applications call more than 100 large language model APIs, including AWS Bedrock, Azure, OpenAI, Anthropic, Google Vertex AI, vLLM and Nvidia NIM, in a single OpenAI-compatible format, with built-in cost tracking, guardrails, load balancing and logging. A Rust core with a Python SDK keeps it lightweight. Interest reflects growing demand for tools that simplify managing multiple AI providers.

Why now: Developers are actively looking for unified gateways to manage multiple LLM providers as AI adoption accelerates.

BerriAILiteLLMOpenAIAnthropicAWS Bedrock

Open on github →

Rank over time, top of the chart is #1. 62 snapshots from 15 h ago to 14 min ago.

Evidence

• BerriAI/litellm · BerriAI · 16

  The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

API: https://socialmediatrends-api.osmike.com/v1/trends/1601242