Industry

Everything · newest first

Models, products and AI startups, near-duplicates collapsed to the most credible source

Lean-QwenFlash Runs 125B Model on Low Memory

A developer adapted the glm-flash-lite SSD offloading approach to Qwen3.8-Flash-Next (125B), creating Lean-QwenFlash, which decodes at ~20 tok/s with 16GB VRAM and 8GB RAM. An RTX 4090 hits 20 tok/s decode and 1,627 tok/s prefill at 262k context; an RTX 3080 laptop achieves 18-21 tok/s at 100k context. Code and scripts are open-sourced on GitHub.

r/LocalLLaMA ·

memt-1.0 architecture: memory built into weights, 66x smaller storage

A community write-up details memt-1.0, a memory-native architecture that uses gated deltanet-2 to internalize memory into the model's computation layer plus a mixture-of-storage layer for capacity, instead of append-only prompts or external RAG. At 128k context, memt-1.0-nano claims about 1.86x end-to-end inference speedup and 66x less persistent storage than a full-context KV cache; a two-stage pipeline trained on 34B tokens preserves general reasoning.

r/MachineLearning ·

Qwen3.8 Flash Next hits 262 tok/s on 16GB VRAM

A LocalLLaMA benchmark shows Qwen3.8-Flash-Next IQ3_S running on an RTX 5080 with 16GB VRAM and 55GB RAM, reaching about 5,600 tok/s prompt processing and 262 tok/s generation at 262K context. In an agent coding session, 99.5% of prompt tokens hit cache, with 0.2s median time to first token.

r/LocalLLaMA ·

Five Qwen3.8-27B models match Fable 5 in benchmark tests

A paper and code repository introduce ledger-based zero-shot self-orchestration, in which fresh instances of one model split problems and coordinate through a shared filesystem. On the 100 latest hard LiveCodeBench problems, gains reach 25.6 points on pinned backends; orchestrated Qwen3.8 Flash Next hits 93.0% pass@1 versus Fable 5's 90.4% at 9% of the cost, and local Qwen3.8-27B rises from 66.8% to 92.4%. The authors note some models show no gain or worse.

Hacker News ·

Declassified Files Reveal CIA's Decades-Long AI Pursuit

Declassified documents and government records show U.S. intelligence agencies explored machine reasoning in the early 1980s, analyzed millions of social media posts by 2011, and used generative AI for investigations in 2019. Most notably, the Defense Intelligence Agency's 2019 SABLE SPEAR program tested whether AI could identify fentanyl trafficking networks better than human analysts. This indicates intelligence AI use predates ChatGPT by decades.

Creative Loafing Charlotte ·

US Creative Industries Shed 200k Jobs; How Much Is AI to Blame?

Apricitas's Joseph Politano notes US creative industries lost over 200,000 jobs in four years, about 50,000 in the past year alone—a slump as severe as 2001 and 2008 despite no generalized recession. Job losses across every digital-arts subsector while in-person entertainment grows is the clearest sign of AI's role, though firms are coy about AI use, making attribution hard.

Hacker News ·

Open-Source Security Ops Platform Argus Hits Hacker News

Argus is a free, MIT-licensed open-source security operations platform that monitors cloud, logins, code and devices around the clock and detects and responds to attacks at machine speed. All automated actions run through a single broker with approvals, dry runs, automatic rollback and a kill switch, and canary keys lure attackers using stolen credentials.

Hacker News ·

RSM roundtable: life sciences AI lacks strategy, early gains in productivity

An RSM US LLP roundtable found most life sciences organizations have AI usage policies but no full strategy tied to business goals; even among large, well-resourced firms only a minority have a defined roadmap. Early AI gains center on productivity, while real value comes from industry-specific use cases, and strong data management and governance are key to managing risk and scaling value.

RSM US LLP ·

AI Data Centers Face Drought Scrutiny, Pivot to Fuel Cells

Intensive AI workloads demand vast freshwater for cooling; evaporative towers can consume hundreds of thousands of litres of municipal water daily, competing with farms and residents in drought-prone regions and drawing community opposition. With water permits becoming regulatory flashpoints, operators are accelerating a shift to clean on-site fuel cells.

Istituto Impariamo ·

Blogger makes his site readable for AI agents

A blogger adapted his nginx-served static site for agents like Claude, ChatGPT and Perplexity by publishing every post as Markdown, accessible via a .md suffix or Accept-header content negotiation. Safeguards include Vary: Accept for caches, canonical links and noindex on Markdown copies to avoid duplicate indexing. He also added /llms.txt, /llms-full.txt (about 225 KB) and /index.md to explain the site to agents.

Hacker News ·

Community post: KLD is misunderstood as a quantization quality metric

A Reddit post argues KLD is overrated as a metric for ranking quantized models. It says computing KLD on random text doesn't reflect inference-time distributions, and creators can easily inflate results by evaluating on calibration data. The author recommends generating data with the base model and ignoring prompt tokens.

r/LocalLLaMA ·

Pennsylvania to require labels on AI-generated ads

Pennsylvania Governor Josh Shapiro signed the Artificial Intelligence Deceptive Advertising Act, requiring ads significantly modified or generated by AI—images, video, audio or text—to carry labels in the same format, regardless of where the ad was made. One of the first state laws mandating AI content disclosure, it leaves loopholes: terms like 'significantly modified' and 'evidently fictional' are undefined, with carve-outs for parody, satire and commentary.

The Verge ·
Load more