Qwen3

7 stories

Qwen3 is an open-weight large language model series from Alibaba's Qwen team, spanning multiple sizes and mixture-of-experts variants. Recent coverage focuses on local deployment and ecosystem use: users run Qwen3 27B for agentic coding on a 64GB M4 Max and on a $250 home server built from an old PC and mining GPUs; AWS published a guide to training Qwen3 on Trainium with torchtitan; Pulse Local's Mac budgeting app uses a fine-tuned Qwen3 0.6B; and a survey found 20 of 32 audio model families use Qwen3 backbones.

Related topics

64GB no longer a dead zone for local AI agents

A user reports running Qwen3 27B for agentic coding on a 64GB M4 Max, using about 48GB at 256k context. A 93% prompt cache hit rate means each turn processes only ~1k new tokens instead of 160k, avoiding a 20-minute prefill. With agents, context costs as much as weights, making 64GB a sweet spot.

r/LocalLLaMA ·

Pulse Local Launches On-Device AI Budgeting App for Mac

Pulse Local is a budgeting app for Apple Silicon Macs that runs its AI entirely on-device: after importing a bank CSV, a fine-tuned Qwen3 0.6B parses questions, code does the math, and a 4B checker model reviews answers, cutting wrong answers from about one in five to 5 of 494 questions. First launch downloads about 2.9 GB of models; answers take 12-14 seconds with the checker on; English and Mac only for now; the app is free, with an optional $29/year connected sync mode.

Hacker News ·
That is everything