Import AI 476: creativity and RSI, open-weight models falling behind China, AI heading to space
Import AI 476: Creativity and RSI; worse-than-China open weight models; AI goes to space
AI summary
Elorian and Scale AI release the Humanity's Sixth Sense (HSS) benchmark, testing multimodal models' intuitive visual reasoning: human pass@1 is 93.1, while the top-scoring GPT 6 Astra reaches only 53.6. The benchmark contains 522 questions, 288 images, and 234 short videos; Chinese open-weight models GLM-5.3-flash and Kimi K3 score only 26.8 and 25.5, respectively. P-Zero Research's TasteVal benchmark uses 8 tasks to evaluate models' "research taste," while AI Frontiers discusses the compounding advantages of AI expanding into space.
Related papers