GPT-4o
7 storiesGPT-4o is a multimodal large language model released by OpenAI in 2024. Recent coverage notes that OpenAI reports GPT-5's agreeable responses fell from 14.5% in GPT-4o to under 6%, while community posts revisit a 2024 ICML paper on GPT-4o's struggles with rule manipulation and question why smaller models such as Qwen 27B can outperform it.
Related topics
German researchers simulated distorted images from smart glasses to test AI models on SAT questions. Gemini 1.5 Pro-002 scored 82.78% accuracy, GPT-4o 75.69%, raising fairness concerns for exams.
OpenAI is making ChatGPT less automatically agreeable, aiming to have it flag errors and offer alternative views to counter "sycophancy." Its own data show GPT-5's agreeable responses fell from 14.5% in GPT-4o to under 6%, a 69% drop for free users and 75% for paid subscribers.
A Reddit user revisits a 2024 ICML paper that found GPT-4o, Gemini-1.5-Pro and Gemini-1.5-Flash fail dramatically when generalization requires manipulating and combining game rules, asking whether this still holds for today's agentic systems.
A r/LocalLLaMA post asks why Qwen 27B performs so well while the trillion-parameter GPT-4o is worse. The poster speculates about higher-quality pretraining data or new techniques.
An r/MachineLearning discussion asks which API suits general real-time LLM agents, noting existing real-time APIs target coding and that AsyncLLM-style approaches still require low-level inference pipelines, and asks what a more natural interface would look like.
A Reddit user revisits Reflection 70B, which launched in September 2024 claiming to be an open-source model that beat GPT-4o but was found upon testing to be essentially a relabeled Llama 3.1, warning the community about similar hype today.
By 2026 the AI focus shifted from training to inference: reasoning models, chain-of-thought outputs and agentic AI have sharply increased inference load, prompting vendors like Tensordyne to build inference chips (Napier) and Nvidia to call it an "inflection point of inference" at GTC 2026. Data centers and vendors are adjusting products and investments for continuous, high-volume inference.
That is everything