Janus

Trends

1
Janus tool runs GGUF models via Vulkan on any GPU●Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/NvidiaYhn Technology Semiconductors931 h ago
A new open-source project called Janus offers a single Go binary that can run GGUF-format language models on AMD, Intel and Nvidia GPUs through the Vulkan graphics API. It was shared on Hacker News, drawing attention as a potential simpler alternative to existing runtimes. The cross-vendor GPU support means users are not tied to CUDA.

Vibra-Ingenn/Janus Janus is a API router for AI models written in Go and has a Vulkan Model runner