AISI 开源 optstop 优化评估 token 消耗
AI summary
一些前沿 AI 评估需要数亿 token，而每一次浪费的试验都有真实成本。 我们推出 optstop：我们的开源工具，能在估计已经精确的地方停止评估，在还不精确的地方继续运行。🧵
Full text · Original
Some frontier AI evaluations require hundreds of millions of tokens, and every wasted trial has a real cost.
We’re introducing optstop: our open-source tool that stops an evaluation where estimates are already precise, and keeps running where they're not. 🧵