search
LLM providers
Trends
- 1Adaptive routing for LLM traffic borrows TCP congestion control●Routing LLM traffic across inference providers with TCP-style congestion control
A new approach applies TCP-style congestion control to route requests across multiple LLM inference providers, adapting to each provider's load, latency and failures in real time. The idea is drawing attention among developers building multi-provider AI systems, who see congestion-control signalling as a practical way to keep inference reliable and cost-effective as demand for model serving grows.
Repos
- deepfates/imp declarative self-improving language-model programs for Elixir 😇
- unreallabsai/unreal-agent Async-first agent harness
- sebastiancarlos/shobr 🧑💻 The stealthiest, UNIX-iest, Job Search Automator
- XEonAX/blender-copilot A Copilot-style AI chat panel that lives inside Blender. The agent loop runs in Blender's own Python process, execu