Qwen3.8-27B is an open ~27B-parameter model in Alibaba's Qwen family, widely used as a base for local deployment and fine-tuning. Recent coverage has focused on quantization and inference efficiency: ISTA-DASLab used a prefiller model to recover low-quant accuracy, and LemonSeed reached about 159 tok/s on an iPad via an eGPU. It also serves as the base for the Humanlike Chat 2.0 LoRA and for GRPO training in ThinkingBox, reaching a 60.78% success rate.
Five Qwen3.8-27B models beat Fable 5 on LiveCodeBench HardUsing the GVS5H method, five Qwen3.8-27B models collaborated via a Memdoor multi-agent workflow, achieving a mean score of 9.8/10 over five passes on the first ten LiveCodeBench Hard problems, surpassing Fable 5's standalone 8.0.
Nanbeige releases Nanbeige4.3-33B modelNanbeige4.3-33B is now on Hugging Face, claimed to outperform Qwen3.8-27B across a range of benchmarks. It will serve as the foundation for a small-model distillation pipeline, including Nanbeige4.3-3B and possibly other sizes.
Five Qwen3.8-27B models match Fable 5 in benchmark testsA paper and code repository introduce ledger-based zero-shot self-orchestration, in which fresh instances of one model split problems and coordinate through a shared filesystem. On the 100 latest hard LiveCodeBench problems, gains reach 25.6 points on pinned backends; orchestrated Qwen3.8 Flash Next hits 93.0% pass@1 versus Fable 5's 90.4% at 9% of the cost, and local Qwen3.8-27B rises from 66.8% to 92.4%. The authors note some models show no gain or worse.
ThinkingBox uses database checks as RL rewardsThe team reused ThinkingBox's executable checks of final database state as training rewards, building an offline task pool. With 50 GRPO steps on Qwen3.8-27B, average success rose from 51.70% to 60.78%, and tasks solved correctly in all 20 attempts went from 38 to 107.
Developer builds Pokemon 2v2 multi-agent LLM test environmentA developer wrapped the official Pokemon Showdown simulator into a Gym-style 2v2 environment to measure how LLM agents communicate and coordinate. Teammates allowed free chat won 64% of battles against a scripted max-damage bot, showing talk improves teamwork. The setup is intended for later RL training of collaborative behavior.
ISTA-DASLab Uses Prefiller Model to Boost Qwen3.8-27B Low-Quant AccuracyISTA-DASLab demonstrated a prefiller model approach that recovers low-quant accuracy for Qwen3.8-27B while retaining low VRAM usage and fast decoding. It requires an Nvidia Blackwell GPU and shows no speed penalty for contexts longer than ~4k tokens.
User says Qwen3.8 27b flashed router firmware after Claude refusedA Reddit user says Claude and Opus 4.8 refused to help flash a Xiaomi router to OpenWrt, while the uncensored Qwen3.8 27b completed the task using the official OpenWrt guide, exploiting a CGI flaw to enable SSH and flash the firmware. The post raises questions about whether future Qwen models will add cyber safeguards.
Nine models, five coding tasks tested on one 16GB GPUA benchmark ran five coding tasks against ten models on a 16GB RX 9060 XT, graded by a hidden checker. deepseek-v4.1-flash (a cloud API) and a condensed Qwen3.8-27B quant both scored 5/5; the last two tasks carried the signal, with losses tied to tie-break rules and performance gates.
Developer compares Gemma4-31B, Qwen3.8-27B, and 6.1-Sol on coding tasksA 20-year software engineer tested Gemma4-31B and Qwen3.8-27B at the same quantization on repository analysis and new project authoring, finding comparable output quality: Gemma4 was more efficient with fewer calls, while Qwen explored more and gave a fuller picture. GPT 6.1-Sol was added later.
LemonSeed: Qwen3.8-27B Hits 159 tok/s on iPad via eGPU R9700LemonSeed Studio is an iPad editor that runs on-device inference via an AMD GPU in a Thunderbolt enclosure, embedding the upstream Linux amdgpu driver. Running Qwen3.8-27B Q4 with a DFlash2 draft, the R9700 decodes at 158.5 tok/s on iPadOS and 159.4 tok/s on macOS, versus a 31.2 tok/s baseline, while Strix Halo reaches 64.4 tok/s on Linux.
ThinkingBox benchmark: one-shot agent success rarely repeatsMicrosoft authors released ThinkingBox-Bench: 507 business workflows across 5 domains, each run 20 times and graded on terminal backend state. Kimi-K3 solved 93.89% of tasks at least once but only 13.41% all 20 times, while Claude Opus 5 discovered fewer (79.09%) yet repeated far more (47.53%), showing discovery and repeatability rank models almost oppositely.
Blockway releases Agens Volundr 32B Preview: hybrid architecture with KV cache in only 18 layersHong Kong-based team Blockway released Agens Volundr 32B Preview, its first model on a custom hybrid architecture, under Apache-2.0. Only 18 of 72 layers keep a KV cache, and it supports 262K context, trained on limited compute. Benchmarks show it ahead of Qwen3.8-27B on coding and math tasks but behind on agent tasks.
Qwen3.8-27B Humanlike Chat 2.0 ReleasedA developer released Humanlike Chat 2.0, a Qwen3.8-27B LoRA fine-tune trained with on-policy distillation that fixes v1's lack of tool use, short replies and single personality, adding tool calls, instruction following and code/math ability. Version 1 drew 700+ upvotes, 248 comments and 44k downloads.
0.8B model with 9 LoRA adapters gives 38x faster decisionsA developer released Jeff-Qwen3.5-0.8B plus 9 task-specific LoRA adapters that answer common agent decisions first, passing only uncertain queries to Qwen3.8-27B. On an M4 Max, accuracy rose from 86.6% to 95.3% and time per decision fell from 8.1s to 0.25s, for under 2 GB of extra memory.
Four RTX 3060 Ti GPUs Hit 120 t/s Local Inference With 262K ContextA user built a 4-GPU rig from power-limited 8GB RTX 3060 Ti cards and, using tensor parallelism with Exl3 and HyperQwen, reached roughly 120 t/s at 150K context in bf16; quantizing the KV cache extends context to 262K with little slowdown under concurrency.
DIY Builder Creates Dual RTX 3090 Inference RigA Reddit user showcased a homemade '2400cc Inference Racer': two used RTX 3090s linked via NVLink, driven by a bare 7840U ThinkPad motherboard, cooled by a VW Golf radiator and about 2.4 litres of coolant, with PCIe routed through WWAN and SSD slots and a patched BIOS. It runs Ubuntu and serves Qwen3.8-27B via vLLM.
Swiss-South African lab open-sources 27B creative-writing model Hemmingway-1A small Swiss-South African lab open-sourced Hemmingway-1, a 27B creative-writing fine-tune of Qwen3.8-27B, under Apache-2.0 with bf16 weights (~54.7 GB) on HuggingFace and vLLM compatibility. It scores 1330 on EQ-Bench 4 and beats tested frontier models on the lab's internal blind writing benchmarks for communication and human-likeness, while math, code, and factual recall are unchanged from the base model, making it a deliberate specialist.
Open-source engine Splash hits 144 tok/s on M5 MaxOpen-source inference engine Inco Splash launched, claiming 144 tok/s for Qwen3.8-27B on an M5 Max MacBook Pro, up to 3x Ollama and 2x oMLX decode speed. It requires M3 or newer, macOS 26.4+, and 36GB RAM, works with Claude Code and Codex, and is available in LM Studio.
PrismML releases tiny reasoning LLMPrismML released Bonsai 2 27B, compressing Alibaba’s Qwen3.8 27B to 5.9GB (≈9–10x memory reduction) while retaining about 98% of benchmark performance; the Caltech-founded startup has a $22.25 million seed round and investors including Khosla Ventures.
Ternary Bonsai 2 (27B) released under 6GBTernary Bonsai 2, derived from Qwen3.8-27B, keeps the 27B hybrid‑attention architecture but uses ternary weights to shrink the model to under 6GB; the model card claims it is 9× smaller than FP16 while retaining 98.2% of its intelligence, and it’s available on Hugging Face with a WebGPU demo.
Offload most of Qwen3.8 KV cache to RAMA vLLM user shared on r/LocalLLaMA a method to keep most of Qwen3.8-Flash-Next's KV cache in system RAM while using a barely-fitting VRAM quant, achieving 1M context on 3×3090 GPUs with ~80 tok/s at short context, ~60 tok/s at long context, and 3,701 tok/s at a 248k prefill; patches and the model are available on their Hugging Face page.
Swift‑Qwen3.8‑27B Cuts Overthinking TokensA LocalLLaMA post highlights UkisAI’s Swift‑Qwen3.8‑27B fine‑tune, which penalizes tokens that trigger overthinking and borrows BottleCap AI techniques to reduce reasoning tokens by roughly 30–50% while keeping output quality.
Qwen3.8-27B Tuned for Humanlike ChatA developer fine-tuned Qwen3.8-27B using 125,217 obfuscated human-to-human messages to produce a LoRA that makes replies shorter and more conversational; the model and a demo are published on Hugging Face.
Terminal Bench v4 ranks GLM-5.3 topA shared Terminal Bench v4 ranking shows GLM-5.3 leading at 41.9%, followed by GLM-5.3-Flash (32.8%) and DSV4.1-Flash (26.8%). Qwen3.8-27B is the only smaller model with notable results. The list reflects community perceptions of open vs closed models.
Muse-glimmer-30b outperforms on creative benchmarksA Reddit user reports Muse-glimmer-30b ranks highly on creative writing benchmarks like EQ-Bench and Hemingway-bench, producing strong stylistic imitations (e.g., David Sedaris) compared with qwen3.8-27b.
The A.I. Daily