AIHacker Newsabout 2 hours ago
Janus: Go Binary Runs Local GGUF Models via Vulkan
5 min read
Janus is a single Go binary enabling local execution of GGUF models using Vulkan acceleration across AMD, Intel, and Nvidia hardware. It exposes an OpenAI-compatible API and a web UI, allowing users to run inference locally without needing Python or Docker setups.
Level
Hype check
Tap to vote and see what everyone thinks.