Gemma is Google's family of lightweight open-weight models, often used for on-device and local deployment. Recent coverage includes a Google DeepMind and GovTech Singapore on-device scam-detection model fine-tuned from lightweight Gemma, and a developer running Gemma 26B QAT at about 26 tokens per second on low-VRAM hardware; Ornith-1.5-122B also builds on earlier work using Qwen3.5 and Gemma4.
Community asks: where are uncensored, NSFW audio models?An r/LocalLLaMA user asked about progress on uncensored, NSFW audio models, noting an attempt about a year ago appeared to stall. The poster questioned whether the gap reflects a lack of interest, resources or know-how, contrasting it with the rapid stream of new text-model releases.
Copium Prediction: Google and Other Labs to Release New Models Before Qwen 4A Reddit user predicts that Google and other major AI labs will release new local models before Qwen 4's launch to briefly lead benchmarks, citing the earlier case of Gemma 4 dropping just days before a Qwen release.
Rumors of an upcoming Gemma 5 release surfaceA post on r/LocalLLaMA citing an X thread sparked speculation that Google's Gemma 5 model family is imminent; no official confirmation has been provided.
Opera introduces WebAI standard for local browser AIOpera unveiled WebAI, a standard letting users run AI models locally in its browser without the cloud, supporting open-weight models such as Gemma and Apple's on-device model. It is available as an opt-in early preview in Opera One, with GX and Neon to follow. Opera cites privacy and no cloud subscription costs.
Nearly half of new Korean AI models build on Chinese foundationsA Rockbridge Network Korea report found 49.3% of the 1,845 models Korean developers published on Hugging Face from January to August were built on Chinese foundations, versus 35.9% on US models. Qwen led at 46.8%, driven by low cost and open weights, raising security and dependency concerns.
Developer proposes speculative decoding using 2-bit draft plus RAM residualA developer published a Hugging Face repo that keeps a 2-bit draft model in VRAM and a 6-8 bit residual in system RAM, sending only activations over PCIe so the draft costs no extra memory. Tests show a 6-bit residual nears Q8_0 quality while reading about 28% fewer bytes.
Specializing SLM vocabularies can cut inference cost by 77%A preview of the VocabX paper shows that rebuilding the Qwen3-4B vocabulary for a single domain and output format can greatly cut inference cost. In a Portuguese essay-grading system, the method designed the vocabulary around token cost rather than frequency; with the same base model, data and training recipe, measured inference cost fell 77%, while shrinking the roughly 151,669-entry vocabulary scored at each generated token.
Ornith-1.5-122B released: self-improving model built on QwenOrnith AI released Ornith-1.5-122B, which extends self-improvement from Ornith-1.0 (built on Qwen3.5 and Gemma4) to jointly optimize task generation, scaffold construction, and solution rollouts via reinforcement learning. The model is available in GGUF format on Hugging Face.
Google DeepMind and Singapore launch on-device AI anti-scam toolGoogle DeepMind and GovTech Singapore built an on-device scam detection model fine-tuned from lightweight Gemma, analyzing chats locally without cloud data egress to preserve privacy. Scams account for over half of Singapore's reported crimes and more than S$4B in losses since 2019, with social engineering causing up to 80% of losses.
U-Space offers label-free uncertainty detection for LLMsResearchers released U-Space and its U-Lens, which combine hidden-state doubt directions with mean token entropy to estimate LLM confidence in a single pass, with no labels, resampling, or fine-tuning, and distinguish ambiguity, missing information, and conflicting evidence. It beat multi-pass and supervised baselines on three models and four benchmarks; the only model-specific ingredient is a pre-fitted Anthropic Jacobian lens, with 40+ available.
Low-VRAM users hope for Qwen4 35B and similar modelsA r/LocalLLaMA user joked that owners of 8GB VRAM plus 16GB RAM check the subreddit daily hoping for new models such as Qwen4 35B A3B, while still relying on Gemma 26B QAT at about 26 tokens per second.
Hope for KVCache + Engram in Upcoming ModelsA Reddit post urges applying DeepSeek-V4.1-Flash’s KVCache and Engram ideas to medium/large models so 30B-class models can run on GPUs in Q8/Q4. The post gives approximate VRAM and Engram estimates, suggests Engram may be ~1/3–1/2 of model size (10–15 GB for 30B), and argues 32GB VRAM should suffice for many optimized models.
The A.I. Daily