So many different kind of AI benchmarks are being released. This one is cool, "Furniture Assembly Benchmark"
Spatial reasoning used to be the safe example of what these models couldn't do.
top score has gone from 28% to 80% in just 10 months.
Somebody presumably had to build a lot of furniture wrong on purpose for this.
Can AI tell if you've built your IKEA furniture wrong? Our new benchmark, the Furniture Assembly Benchmark (FAB), gives models the manual and a photo of a half-...