Ethan Mollick @emollick

This is both fun and a useful measure of how much better multimodal AI has gotten In a short time. [引用 @EpochAIResearch]: Can AI tell if you've built your IKEA furniture wrong? Our new benchmark, the Furniture Assembly Benchmark (FAB), gives models the manual and a photo of a half-completed piece of furniture and asks them to spot the mistake. The top score has gone from 28% to 80% in just 10 months.

X39 d ago
Read original ↗