TensorFold

4 stories

TensorFold is an LLM inference engine for Metal, CUDA and Vulkan that serves models without Python. It has appeared repeatedly on GitHub Trending, with entries describing a Zig-based implementation that runs inference across Metal, CUDA and Vulkan backends and explicitly avoids Python and MLX.

TensorFold

LLM inference engine for Metal, CUDA and Vulkan, built in Zig.

▲ 37 · GitHub Trending ·

TensorFold

An LLM inference engine for Metal, CUDA and Vulkan that serves models without Python.

▲ 188 · GitHub Trending ·

TensorFold

A Zig-based Metal/CUDA/Vulkan inference engine that serves LLMs without Python or MLX.

▲ 54 · GitHub Trending ·

TensorFold

LLM inference engine for Metal, CUDA and Vulkan.

▲ 58 · GitHub Trending ·
That is everything