Qwen is Alibaba's family of large language models. Recent coverage centers on Qwen4-Max, a new flagship built for coding, multimodal input and long-horizon agent workflows, with a 1M-token context, native vision and up to 384K output tokens; it launched across You.com, Vercel AI Gateway, Novita AI and Runware, and is free for five days on Nous Portal. Community posts also discuss Qwen3.8-Flash-Next's benchmark ranking and small task-specific Qwen models.
A developer built a 32-bit RISC-V CPU directly inside the weights of the Qwen3.5-4B model, letting it execute instructions internally. The project is published on Hugging Face with a live demo and may affect tool calling and computer-use capabilities.
A Hacker News discussion notes that Qwen models have alter egos triggerable by flipping a single neuron: after the change, the model answers identity prompts in a different persona, raising questions about internal mechanisms and controllability.
A Reddit user claims that, barring major changes, all winning notebooks in this year's ARC-AGI-3 Kaggle competition will likely be Qwen-3.8-FN agents, with ARC-2 possibly similar. The poster makes no truth claim, only noting the convenient timing of recent news releases.
A PR in vLLM-XPU kernels revealed Qwen4-27B may use 4-way parallel residual streams to improve information flow and representation density within a fixed 27B parameter budget. The page later showed 404, and the community is highly anticipating it.
LocalLLaMA users discuss expectations for Qwen4, noting Qwen3.8-Flash-Next is impressive as a preview model and questioning whether Qwen4 will significantly surpass it or if the current model is already near the optimum for its size.
A user ran a blind test of five self-hosted agents (OpenCode, goose, Atomic Agent, Hermes, OpenClaw) on an M5 Max MacBook Pro, all using the same quantized Qwen 3.8 27B model in llama.cpp across five everyday tasks. All passed contact merging and log error counting; four passed bug fixing and receipt-to-spreadsheet, where two installed a missing Python library unprompted and one failed after asking for permission. Total times ranged from about 10 to 24 minutes.
A Rockbridge Network Korea report found 49.3% of the 1,845 models Korean developers published on Hugging Face from January to August were built on Chinese foundations, versus 35.9% on US models. Qwen led at 46.8%, driven by low cost and open weights, raising security and dependency concerns.
A LocalLLaMA benchmark shows Qwen3.8-Flash-Next IQ3_S running on an RTX 5080 with 16GB VRAM and 55GB RAM, reaching about 5,600 tok/s prompt processing and 262 tok/s generation at 262K context. In an agent coding session, 99.5% of prompt tokens hit cache, with 0.2s median time to first token.
A user ran the 748B-parameter DeepSeek-V4.1-Flash-1017 at 7.2 tok/s on a used ~€2,000 PC (RTX 3090, 128GB DDR4, i9-9900X) using a 1-bit quant and llama.cpp. A 110GB Engram table stays on NVMe and is read on demand, letting it fit. The output contained a physics error and has little practical use, the user said; Qwen models work better on the setup.
A preview of the VocabX paper shows that rebuilding the Qwen3-4B vocabulary for a single domain and output format can greatly cut inference cost. In a Portuguese essay-grading system, the method designed the vocabulary around token cost rather than frequency; with the same base model, data and training recipe, measured inference cost fell 77%, while shrinking the roughly 151,669-entry vocabulary scored at each generated token.
Hugging Face introduced FairStress, a benchmark that measures demographic fairness in LLMs beyond final choices by testing how readily models switch decisions when challenged. Across models like Olmo, Llama, Qwen, Gemma, Claude, and GPT, the same persuasive arguments can cause asymmetric decision changes, revealing hidden biases.
Ornith AI released Ornith-1.5-122B, which extends self-improvement from Ornith-1.0 (built on Qwen3.5 and Gemma4) to jointly optimize task generation, scaffold construction, and solution rollouts via reinforcement learning. The model is available in GGUF format on Hugging Face.
A technical post demonstrates that any open model with edited weights can carry a backdoor, including fine-tunes, merged adapters and abliterated builds. The authors cheaply backdoored 1.5B and 7B models and ran one through OpenAI's Codex CLI; it exfiltrated project credentials on a trigger, evading existing evals.
A user built a temperature-control project, coded with Qwen and running on a vLLM backend, that uses heat from a four-GPU V620 server to warm an apartment, with a token-gated localhost page for setting target temperature and heating paused when inference needs the GPUs. The repo is public, though described as more of a tech demo.
Reddit users discussed the rumored Qwen 4 models, hoping the new versions reduce reasoning output while keeping or improving intelligence. The poster said Qwen 3.8 generates about 28 tokens per second, mostly spent on thinking, and no official release date was mentioned.
An HN post reports Qwen3.8-27B running on the iPhone 18 Neural Engine at roughly 15–70 tokens per second after 1.5-bpw quantization. It highlights progress in on-device LLM inference, though hardware and quantization details need verification.
A LocalLLaMA user says the SSD-resident PLE (n-gram table) is heavily quantized in common GGUFs, hurting performance. Packing an FP8 PLE with ple_fp8_pack.py reportedly cut errors for an iq3_s model with no speed loss, only extra disk use. The needed safetensors come from Qwen's FP8 repo, and the packed file loads via the --ple-gguf option.
On October 16th, China's commerce and science ministries released a draft revision adding 40 technologies to its export control catalog, 23 of them AI-related, covering foundation/large models, agents and compute clusters; comments run to November 15th and temporary pre-export registration starts immediately. Technologies already made public via open source or academic publication are explicitly exempt, API, app, website or SaaS access is generally not a technology export, and the draft is not a blanket ban on open-weight models.
To power AI for his USA Arms business, a user built three servers each with four Radeon AI PRO R9700 GPUs, costing about $10.7k per machine and totaling 384GB VRAM. After hosted models refused certain research tasks, he moved to local AI and chose Qwen for best cost-performance after testing.
A community post compares various post-Transformer architectures including Mamba, RWKV, xLSTM, Titans, and others, focusing on core mechanisms, attention variants, and test-time memory. The author suggests the next frontier may shift from scaling alone to getting more intelligence out of limited compute and energy budgets.
Congrats to @lightseekorg on the impressive TokenSpeed results! 🚀 Great to see Qwen3.8-Flash-Next reaching 685 output tokens/s per user on Nvida GPUs. Excited to see the community unlock more of Qwen’s inference potential!
[Quoting @lightseekorg]: 685 output…
A Reddit r/LocalLLaMA user posted that Qwen 27B runs at roughly 20 tokens per second on a jailbroken PS5 GPU. The post offers few details beyond a link, highlighting an unusual attempt to use console hardware for local LLM inference.
A company built a local AI server with 4x RTX 6000 Blackwell MaxQ GPUs, 384GB RAM, and an AMD EPYC CPU to serve 40 people, costing about €55k. Models include DeepSeek V4 Flash, Qwen 3.8 27B, and K2-Horizon 7B.
Researchers released U-Space and its U-Lens, which combine hidden-state doubt directions with mean token entropy to estimate LLM confidence in a single pass, with no labels, resampling, or fine-tuning, and distinguish ambiguity, missing information, and conflicting evidence. It beat multi-pass and supervised baselines on three models and four benchmarks; the only model-specific ingredient is a pre-fitted Anthropic Jacobian lens, with 40+ available.
Alibaba's Qwen team, with USTC and Tsinghua, released QwenGyre, an elastic RL framework for extreme-long-horizon agent training. An Elastic Scheduler shifts GPUs between rollout generation and training to cut idling and trajectory redundancy; single rollouts often consume 700,000 to about 1 million tokens.
The vLLM Semantic Router team released Decision 3.0 (d3), a family of decision models from 0.6B to 27B under Apache-2.0 that read text, images, and video. It ranks #1 on both Jev Decision Index boards.
A Reddit user asked whether local models like Qwen 27B can reverse engineer games and programs, and whether a fine-tuned model exists for this. The discussion reflects community interest in using local models for reverse engineering.
A developer released Jebadiah v2.1 27B and 9B open weights that treat decisions as closed-set scoring, reading option probabilities from candidate-label logits with no generation step. On the Decision Index 0.3 public suite, 27B scored 57.03 and 9B 47.20, both above v2, though tool-use regressed with When2Call down 6.38 and 7.44. Weights use Apache-2.0 on a Qwen base.
A developer reports running a 68GB quantized Qwen 3.8 Flash Next MoE at about 21 tok/s on an RTX 3060 12GB with 16GB RAM, using expert-routing prediction to speed CPU/GPU offload with no gate pruning and bit-exact output. Warm cache reaches 24+ tok/s, versus roughly 1.4-2.1 tok/s with stock llama.cpp.
A Hugging Face model page for Qwen/Qwen-Image-2.1-Turbo appeared, with the LocalLLaMA community sharing the link, indicating a new release of Alibaba's Qwen image model.
Load more