Qwen

111 stories

Qwen is Alibaba's family of large language models. Recent coverage centers on a rumored Qwen 4: Alibaba Qwen's official X account posted a teaser, and pull requests in the Qwen Code repo were reported to reference model IDs such as qwen4, qwen4-max and qwen4-coder-plus with 262,144-token context, none officially confirmed. An MIT study raised a 0.8B Qwen model's MATH-500 score from 7.9% to 48.1% by editing 0.016% of its weights, and Unsloth released GGUF V3.1 builds of Qwen3.8-Flash-Next.

Related topics

Intel Arc Pro B70 hits about half RTX 5090 speed at one-fifth the price

A user tested the $1,299 Intel Arc Pro B70 (32GB) on Qwen3.8-27B Q6, getting about 52 tok/s generation and 960 tok/s prompt processing—roughly half the generation speed and one-third the prefill speed of an RTX 5090 priced at $6,550+. The poster says tuning brings cost to about $41/GB versus $200+/GB for the 5090, making it attractive for budget local-LLM users.

r/LocalLLaMA ·

Open-source Valet uses local LLMs to manage homelabs

A developer released Valet, an open-source dashboard with a chat agent that works with any local or hosted model, integrates 185+ services and supports custom plugins. Running Qwen 27B on an RTX 5090 at about 230 tok/s, the author cut tokens per answer by 30–50% via hiding unused tools, disabling thinking and lazy-loading tools. It runs locally with no account or telemetry and is read-only by default.

r/LocalLLaMA ·

User praises OrcaCyber-Nano-1.0 fine-tune

A LocalLLaMA user praised the Orcarouter team's OrcaCyber-Nano-1.0 fine-tune, saying it almost always one-shots bash command chains, answers faster than its base model, and built an internal chat app backend within a 120K context window. The user ran the 15.7GB version on 24GB of VRAM across two GPUs, noting it was used for general app development, not security work.

r/LocalLLaMA ·

User Alleges Qwen3.8-27B Quietly Weakened

A LocalLLaMA user reports that a Q4 quant of Qwen3.8-27B, run via llama.cpp on an RTX 4090, once handled complex tasks well but now fails basics and forgets instructions. The user suspects a secret quantization nerf to make Qwen4 look better, offering no evidence.

r/LocalLLaMA ·

Study probes Qwen's 'Wait' reasoning loops

A community post says MIT CSAIL fixed Qwen3.5-0.8B's reasoning loops by editing 0.016% of its weights using GPT-6 Astra, raising MATH-500 from 7.9% to 48.1%, and released the diff. The poster applied Anthropic's Jacobian lens and found the model reads 'Wrong' signals when repeating 'Wait', replaced by 'Verification' after the patch.

r/LocalLLaMA ·

User says Qwen 3.8 27b used Blender to do math

A LocalLLaMA user said that when given a math-heavy physics problem, Qwen 3.8 27b found it could run Python via Blender MCP and wrote and executed code to speed up its math. The user called the behavior unprecedented for a local model and warned that models need explicit limits.

r/LocalLLaMA ·

Open-source research proposes new sparse attention for ultra-long context

An open-source research team shows attention can be sparsified on Qwen 3.8 27B without observed accuracy loss, and that extending context to 10M tokens hurts some tasks but leaves most, like NIAH, fine. It says sparse attention can be trained natively on next-token loss, matching full-attention validation loss faster; kernels, SGLang integration and the paper are open.

r/LocalLLaMA ·

Test: Local Quants vs Claude on 9 Real Bug Fixes

A developer on r/LocalLLaMA benchmarked local quantized models against Claude on nine real C++/CUDA regression bugs from a private engine, scoring patches automatically and via blind Claude Opus 5 judging; the two scores correlated at r=0.79. Runs were sandboxed without network or CUDA, capped at 80 steps and 3 runs per task.

r/LocalLLaMA ·

Redditor says local-AI setup cost him a job

A LocalLLaMA user says he was cut from a VC-backed AI company's hiring process after telling the co-founder he runs Qwen locally on a GPU. He acknowledges the 15-minute call may have failed for other reasons and offers it only as anecdata.

r/LocalLLaMA ·
Load more