LLM inference providers

A new approach applies TCP-style congestion control to route large language model requests across multiple inference providers, adapting traffic to each provider's capacity and reliability. The idea draws interest from developers dealing with outages, rate limits and cost differences across model APIs, as it borrows a proven networking technique to make LLM routing more resilient and efficient.