Janus

Trends

1
Janus: Go tool runs GGUF models via Vulkan on any GPU▼Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/NvidiaYhn Technology Semiconductors7512 min ago
A new open-source project called Janus lets users run GGUF-format large language models on AMD, Intel and Nvidia GPUs through a single Go binary using the Vulkan graphics API. Posted on Hacker News, the tool is drawing attention because it removes the need for vendor-specific CUDA or ROCm stacks, offering a simpler cross-platform way to run local AI models.

Vibra-Ingenn/Janus Janus is a API router for AI models written in Go and has a Vulkan Model runner