We made our document test harder. Here's what changed
Most models used to ace it. Now only a handful do, and the rankings moved a lot.
News
We tested Mistral Large 4 ("Le Chonk"). It's brilliant when it stops thinking
Every program it finished was correct, and it beat every local model at reading documents. But on 12 of 30 coding jobs it never gave an answer at all.
News
Why we don't publish speed numbers
How fast a model runs depends on your exact computer and app, so any number we gave would be wrong for most people.
News