Janus

Trends

1
Janus lets a single Go binary run GGUF models on any GPU●Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/NvidiaYhn Technology Semiconductors1067 min ago
A new open-source project called Janus is drawing attention on Hacker News. It is a Go binary that runs GGUF large language models through Vulkan graphics drivers, meaning it works on AMD, Intel and Nvidia GPUs without vendor-specific tooling. Commenters are discussing how it compares to existing inference tools and whether Vulkan can keep pace with CUDA-based performance.

Vibra-Ingenn/Janus Janus is a API router for AI models written in Go and has a Vulkan Model runner