Industry

Only Sun, October 18, 2026 · All dates →

Community tests full n-gram table for Qwen 3.8 Flash Next

A LocalLLaMA user says the SSD-resident PLE (n-gram table) is heavily quantized in common GGUFs, hurting performance. Packing an FP8 PLE with ple_fp8_pack.py reportedly cut errors for an iq3_s model with no speed loss, only extra disk use. The needed safetensors come from Qwen's FP8 repo, and the packed file loads via the --ple-gguf option.

r/LocalLLaMA · 37 h ago

Qwen llama.cpp Strata

Otaku: an LLM frontend built for creative writing

A developer introduced Otaku, an LLM frontend for local engines focused on writing quality in long stories, small context and both web and terminal interfaces. New features include a two-way character library, a NovelAI-style story mode, image context, web search, model questions and author's-note injections, plus replacing the middle of overlong stories with summaries.

r/LocalLLaMA · 41 h ago

Otaku NovelAI

That is everything