llama.cpp runs GGUF models natively on jailbroken PS5
PS5LM uses llama.cpp's Vulkan backend to run GGUF models on a jailbroken PS5's RDNA 2 GPU, serving OpenAI- and Anthropic-compatible APIs as a local model server.