We tested Mistral Large 4 ("Le Chonk"). It's brilliant when it stops thinking
Every program it finished was correct, and it beat every local model at reading documents. But on 12 of 30 coding jobs it never gave an answer at all.
News
Devstral 2 2512 review: not one we'd recommend right now
It scored 53 out of 100, #28 of 56. It solved 16 of 30 coding jobs and scored 53 on reading documents. Runs on a Mac with 128 GB.
Reviews
Ministral 3 14B 2512 review: not one we'd recommend right now
It scored 44 out of 100, #35 of 56. It solved 13 of 30 coding jobs and scored 45 on reading documents. Runs on a 12 GB graphics card or a Mac with 16 GB.
Reviews
Mistral Small 3.2 24B review: not one we'd recommend right now
It scored 44 out of 100, #36 of 56. It solved 12 of 30 coding jobs and scored 47 on reading documents. Runs on a 24 GB graphics card or a Mac with 32 GB.
Reviews
Mistral Small 3 review: not one we'd recommend right now
It scored 41 out of 100, #37 of 56. It solved 11 of 30 coding jobs and scored 45 on reading documents. Runs on a 24 GB graphics card or a Mac with 32 GB.
Reviews
Ministral 3 8B 2512 review: not one we'd recommend right now
It scored 37 out of 100, #42 of 56. It solved 9 of 30 coding jobs and scored 43 on reading documents. Runs on an 8 GB graphics card or a Mac with 16 GB.
Reviews
Mistral Nemo review: not one we'd recommend right now
It scored 23 out of 100, #48 of 56. It solved 3 of 30 coding jobs and scored 36 on reading documents. Runs on a 12 GB graphics card or a Mac with 16 GB.
Reviews
Ministral 3 3B 2512 review: not one we'd recommend right now
It scored 21 out of 100, #50 of 56. It solved 3 of 30 coding jobs and scored 32 on reading documents. Runs on an 8 GB graphics card or a Mac with 16 GB.
Reviews