search
local LLMs
Trends
- 1Janus tool runs GGUF AI models on any GPU via Vulkan●Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia
A developer has released Janus, an open-source Go binary that runs GGUF large language models using Vulkan graphics API, making it work across AMD, Intel and Nvidia GPUs without vendor-specific tooling. The project, hosted on GitHub under Vibra-Ingenn, is drawing attention as a lightweight, cross-platform alternative for running local AI models on varied consumer hardware.
Repos
- antirez/ds4 DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
- ollaya-dev/ollaya Run open decision models locally: pull and serve Laya, decider, NLI and GLiClass behind a TypeSafe-compatible API. Ollam
- TheoLeeCJ/SemIf-OpenJev Semantic ifs from open models, on a 3090 at home. Independent; not affiliated with Jev or TypeSafe.