Nathan Lambert @natolambert

At the top end of models, real-world usability matters a lot more than +/- 2 points on AA. This takes a while to understand for a model, where AA is a sort of potential, but some models hit and some miss (e.g. opus 5 vs 5.5). Seems like 3.1 may be closer to the miss side. [引用 @fawnunwrap]: OPENAI IS NO LONGER EVEN TOP 5 ON AA ANALYSIS AFTER KIMI K3.1 https://t.co/SEl1QZ9jiX

X8 d ago
Read original ↗