Our 2 takes on @ArtificialAnlys Intelligence Index v5:
1. 60% of the score now comes from private test data. Harder for models to train with the test data.
2. The median frontier model now uses 59k output tokens per task, from 35k.
that means infra needs predictable throughput
Announcing Artificial Analysis Intelligence Index v5, featuring 2 new benchmarks and 3 upgrades. For the first time, the majority of the Index is built on private datasets
The Artificial Analysis Intelligence Index is our composite measure of model capabilities across tasks
