Import AI 476: visual reasoning benchmarks and AI research taste
Elorian and Scale AI released the Humanity's Sixth Sense (HSS) benchmark, testing intuitive visual reasoning in multimodal models, containing 522 questions, 288 images, and 234 short videos. Human pass@1 is 93.1, while the highest-scoring GPT 6 Astra only reaches 53.6; Chinese open-weight models GLM-5.3-flash and Kimi K3 score only 26.8 and 25.5, respectively. P-Zero Research's TasteVal benchmark evaluates AI research taste using 8 tasks.