Gemma 4 31B review: great at code, weaker with documents
It scored 79 out of 100, #14 of 56. It solved 28 of 30 coding jobs and scored 65 on reading documents. Runs on a 32 GB graphics card or a Mac with 48 GB.
Reviews
Gemma 4 26B A4B review: decent, with trade-offs
It scored 70 out of 100, #23 of 56. It solved 25 of 30 coding jobs and scored 58 on reading documents. Runs on a 24 GB graphics card or a Mac with 32 GB.
Reviews
Gemma 3 27B review: not one we'd recommend right now
It scored 40 out of 100, #38 of 56. It solved 10 of 30 coding jobs and scored 46 on reading documents. Runs on a 24 GB graphics card or a Mac with 32 GB.
Reviews
Gemma 3 12B review: not one we'd recommend right now
It scored 35 out of 100, #43 of 56. It solved 9 of 30 coding jobs and scored 40 on reading documents. Runs on a 12 GB graphics card or a Mac with 16 GB.
Reviews
Gemma 2 27B review: not one we'd recommend right now
It scored 23 out of 100, #46 of 56. It solved 4 of 30 coding jobs and scored 34 on reading documents. Runs on a 24 GB graphics card or a Mac with 32 GB.
Reviews
Gemma 3 4B review: not one we'd recommend right now
It scored 14 out of 100, #52 of 56. It solved 1 of 30 coding jobs and scored 25 on reading documents. Runs on an 8 GB graphics card or a Mac with 16 GB.
Reviews