Einsia

2 stories

Every Einsia story collected by The AI Daily, 2 so far, newest first, refreshed hourly.

Related topics

Study: strongest model may not make the best coordinator

In Einsia's WorkflowArena benchmark, Opus 5.5 and GPT-6 Astra wrote static workflows for four executor models on 32 tasks. Opus's workflows raised executor scores by 6.41 points on average, while Astra's cut them by 2.53 points despite Astra being the stronger system in the main benchmark. The benchmark spans 145 long-horizon tasks in eight domains; the team concludes coordinator choice should not rely on solo performance alone.

r/MachineLearning ·

Einsia releases Frontier3DBench for coding agents

Einsia released Frontier3DBench, which tests whether coding agents can build editable Blender projects and runnable Unreal Engine worlds across 145 tasks in 9 categories, using 11 model-harness configurations. GPT-6.1-sol leads overall and on objects and scenes, while GPT-6-astra leads interactive worlds; all configurations score lower on reference-based reconstruction than on text-driven generation. Across 165 world submissions, local mechanisms scored 83.08 versus 30.26 for stateful workflows.

r/MachineLearning ·
That is everything