GPT-3 is an autoregressive language model released by OpenAI in 2020, built on the Transformer architecture and trained on large-scale text. Recent coverage reports that OpenAI has officially discontinued GPT-3, with GPT-5.6 Terra suggested as a replacement, and community users note the two are not drop-in replacements. Separately, a researcher fine-tuned a 348M-parameter model that reached a 99.4% average across nine GPT-3 arithmetic sub-tasks.
Smaller models bring more AI capabilities on-deviceComputerworld notes a countercurrent to ever-larger models: compact models such as Tether's suite, the largest at about 4 billion parameters, some small enough to run offline on a basic smartphone. Needing a fraction of frontier systems' compute, lightweight models are shifting more AI applications from the cloud to local devices.
GPT-3 discontinued todayOpenAI's original GPT-3 model is officially discontinued today, with GPT-5.6 Terra suggested as a replacement. Community users voiced nostalgia and noted that old and new models are not drop-in replacements, which is why local models matter.
The 2026 Inference Hardware RevolutionBy 2026 the AI focus shifted from training to inference: reasoning models, chain-of-thought outputs and agentic AI have sharply increased inference load, prompting vendors like Tensordyne to build inference chips (Napier) and Nvidia to call it an "inflection point of inference" at GTC 2026. Data centers and vendors are adjusting products and investments for continuous, high-volume inference.
Mathematical framework for transformer circuitsThe 2021 paper proposes a mathematical framework for mechanistic interpretability of transformers, starting with simple two-layer attention-only models to identify algorithmic motifs that could scale to larger models and help explain or predict safety-relevant behaviors.
348M model trained on 22.7B tokens solves arithmeticA researcher trained a 348M‑parameter language model on 22.7B tokens and fine‑tuned it to produce worked steps for arithmetic, achieving a 99.4% average on nine GPT‑3 arithmetic sub‑tasks (n=300, greedy, exact match) and cleanly handling addition up to 14 digits; the author attributes earlier limits to vocabulary, not arithmetic ability.
The A.I. Daily