Issue 2026-10-01 · Industry · 开源 · 产品
Janus: Go Binary Runs GGUF Models via Vulkan

A developer released Janus, a single Go binary that runs GGUF models on AMD, Intel, or NVIDIA GPUs via Vulkan or CPU, exposing an OpenAI-compatible API. It requires no Python, Docker, or Ollama, and supports hot-swapping models and thinking models.
Read original ↗- AnyLanguageModel 1.0 ships for local models on Apple platforms
- Opinion: AI Has Crossed a Line and Should Be Regulated Like Banks
- Open-source inside-llm visualizes LLM internals and quantization gaps
- Yogurt: open-source, on-device meeting notes app
- Open field guide to inference engineering: self-hosting models can cut costs ~80%