When AI Can't Crack Kids' Locker Logic
Fascinating: Models can now answer questions like below 55% of the times while 9-12yo can do at 60%:
“Timothy’s locker is 24 cubic inches. Zack’s locker is half as big as Timothy’s locker. Peter’s locker is 1/4 as big as Zack’s locker. How big is Peter’s locker in cubic inches?” https://x.com/karlcobbe/status/1454236247900098560