TensorFold
LLM inference engine for Metal, CUDA and Vulkan, built in Zig.
TensorFold is an LLM inference engine for Metal, CUDA and Vulkan that serves models without Python. It has appeared repeatedly on GitHub Trending, with entries describing a Zig-based implementation that runs inference across Metal, CUDA and Vulkan backends and explicitly avoids Python and MLX.
LLM inference engine for Metal, CUDA and Vulkan, built in Zig.
An LLM inference engine for Metal, CUDA and Vulkan that serves models without Python.
A Zig-based Metal/CUDA/Vulkan inference engine that serves LLMs without Python or MLX.
LLM inference engine for Metal, CUDA and Vulkan.