Vulkan

3 stories

Vulkan is a cross-platform graphics and compute API often used to run local AI models across AMD, Intel and NVIDIA GPUs. Recent coverage includes Janus, a single Go binary from a developer that runs GGUF models via Vulkan or CPU with no Python, Docker or Ollama, and an enthusiast's six-board BC-250 cluster running Qwen Next Flash on four boards at about 28 tok/s.

Related topics
That is everything