Review · updated OCT 11

Nex-N2.5-Mini review: not one we'd recommend right now

It scored 57 out of 100, #27 of 56. It solved 8 of 30 coding jobs and scored 88 on reading documents. Runs on a 24 GB graphics card or a Mac with 48 GB.

The short version
  • Nex-N2.5-Mini is a free model from nex-agi that you can run on your own computer. In our tests it's not one we'd recommend right now: 57 out of 100, #27 of 56.
  • It solved 8 of 30 coding jobs and scored 88 on reading documents. On our hardest tasks it scored 40.
  • Runs on a 24 GB graphics card or a Mac with 48 GB.

Coding

Our coding test is 30 programming jobs, from small ones like reading time durations or cleaning up messy data to harder ones like a config-file parser or a double-entry ledger. We run each answer against tests the model never sees, and a job only counts if everything passes. Nex-N2.5-Mini got 8 of 30 right. The best local coders solved 29 of 30.

Reading documents

The second test hands the model things like an expense claim thread, a pay stub or an insurance statement, and asks for specific numbers and dates. Many questions need a bit of math, or noticing a correction further down the email. Nex-N2.5-Mini scored 88; the best model scored 100.

TestScorePublic questionsSecret questions
Coding271430
Reading documents889885
Decisions9510093

On the 18 hardest tasks (included in the scores above) it scored 40. This number separates the top models.

We tested the full-size version online. The smaller versions you download usually score a little lower.

Can your computer run it?

You can download Nex-N2.5-Mini in several sizes. Smaller versions fit on more computers and lose a little quality, so pick the biggest one that fits.

Your computerRuns it?Version to download
Graphics card, 8 GBNo–
Graphics card, 12 GBNo–
Graphics card, 16 GBNo–
Graphics card, 24 GBYesQ4
Graphics card, 32 GBYesQ6
Mac, 16 GBNo–
Mac, 24 GBNo–
Mac, 32 GBNo–
Mac, 48 GBYesQ6
Mac, 64 GBYesQ8
Mac, 96 GBYesQ8
Mac, 128 GBYesQ8

For normal-length chats. Long documents need more memory. Q4 or Q8? · How we worked this out

How to try it

Search for "Nex-N2.5-Mini GGUF" in LM Studio or on Hugging Face and pick the version that fits your computer. New to this? Start with our Ollama guide.

Want the strongest all-rounder instead? Qwen3.6 27B scored 97.

Its actual answers

What Nex-N2.5-Mini wrote for our public questions, word for word.

Coding: INI parser (hard) Didn't work
Coding: TTL LRU (hard) Didn't work
Coding: Parse duration Didn't work
Coding: Summarize ranges Worked
```python
def summarize_ranges(nums: list[int]) -> str:
    nums = sorted(set(nums))
    if not nums:
        return ""

    result = []
    i = 0

    while i < len(nums):
        start = nums[i]
        end = start
        j = i + 1

        while j < len(nums) and nums[j] == nums[j - 1] + 1:
            end = nums[j]
            j += 1

        if j - i >= 3:
            result.append(f"{start}..{end}")
        else:
            result.extend(str(num) for num in nums[i:j])

        i = j

    return ",".join(result)
```
Coding: Top customers Didn't work
Coding: Slugify Didn't work
Coding: Token bucket Didn't work
Decisions: Refund window (hard) 100% right
{"outcome":{"full_refund":0,"partial_refund":0,"store_credit":1,"nothing":0},"defective":{"true":0,"false":1}}
Decisions: Incident matrix (hard) 100% right
{"severity":{"0":0.01,"1":0.98,"2":0.01,"3":0},"page":{"true":0.01,"false":0.99}}
Decisions: Tool followup (hard) 100% right
{"tool":{"web_search":0.0,"calculator":0.0,"calendar":0.99,"email":0.0,"none":0.01},"confirm":{"true":0.99,"false":0.01}}
Decisions: Legit security alert (hard) 100% right
{"phishing":{"true":0.01,"false":0.99},"action_needed":{"true":0.01,"false":0.99}}
Decisions: Meeting slot (hard) 100% right
{"slot":{"A":0,"B":1,"C":0,"D":0},"raj_last":{"true":1,"false":0}}
Decisions: Review mixed (hard) 100% right
{"hardware":{"true":1,"false":0},"support":{"true":1,"false":0}}
Decisions: Support checkout down 100% right
{"department":{"billing":0.05,"technical":0.93,"account":0.01,"shipping":0.0,"sales":0.01},"urgency":{"0":0.0,"1":0.0,"2":0.02,"3":0.98},"outage":{"true":0.99,"false":0.01}}
Decisions: Refund wrong plan 100% right
{"department":{"billing":0.98,"technical":0.0,"account":0.0,"shipping":0.0,"sales":0.02},"refund":{"true":0.99,"false":0.01},"tone":{"frustrated":0.02,"calm":0.98}}
Decisions: Moderation doxxing 100% right
{"policy":{"none":0,"harassment":1,"hate":0,"spam":0,"self_harm":0},"personal_info":{"true":1,"false":0}}
Decisions: Route calendar 100% right
{"tool":{"web_search":0,"calculator":0,"calendar":1,"email":0,"none":0},"confirm":{"true":1,"false":0}}
Decisions: Doc invoice missing due 100% right
{"doc_type":{"invoice":0.95,"other":0.05,"resume":0.0,"contract":0.0,"bank_statement":0.0},"missing_due_date":{"true":0.9,"false":0.1}}
Decisions: Phishing paypal 100% right
{"phishing":{"true":0.99,"false":0.01},"risk":{"0":0,"1":0,"2":0.02,"3":0.98}}
Decisions: Pii ssn email 100% right
{
  "data_kind": {
    "none": 0.0,
    "contact": 0.0,
    "financial": 0.0,
    "government_id": 0.99,
    "health": 0.0
  },
  "sensitive": {
    "true": 0.99,
    "false": 0.01
  }
}
Decisions: Review mixed 100% right
{"sentiment":{"positive":0.0,"neutral":0.0,"negative":1.0},"defect":{"true":1.0,"false":0.0},"recommend":{"true":0.0,"false":1.0}}
Documents: Saas escalator (hard) 100% right
{"year2_price_per_seat_month":47.25,"year3_price_per_seat_month":47.25,"year1_invoice":58320.00,"year2_invoice":61236.00,"addon_months_billed":6,"addon_invoice":38556.00,"year3_invoice":134946.00,"year3_discount_percent":15,"total_contract_value":293058.00,"contract_end_date":"2027-02-28"}
Documents: Expense thread 100% right
{"employee_id":"EMP-20417","destination_city":"Lisbon","trip_start":"2025-02-24","trip_end":"2025-02-27","approved_items":[{"date":"2025-02-24","category":"airfare","amount_usd":1184.60},{"date":"2025-02-24","category":"ground_transport","amount_usd":38.88},{"date":"2025-02-25","category":"meals","amount_usd":229.39},{"date":"2025-02-26","category":"lodging","amount_usd":466.56},{"date":"2025-02-27","category":"ground_transport","amount_usd":44.82}],"rejected_item_count":1,"per_diem_days":3,"per_diem_usd":195.00,"total_reimbursable_usd":2159.25,"approver_email":"priya.raman@corvane.com"}
Documents: Lease amendment 100% right
{"tenants":["Marcus Lin","Sofia Lin"],"landlord":"Ridgeline Property Group LLC","zip":"97205","lease_end":"2025-11-30","original_monthly_rent":2150.00,"monthly_rent_from_2025_06_01":2236.00,"late_fee_from_2025_06_01":111.80,"security_deposit":2150.00,"total_pet_deposits":800.00,"total_monthly_payment_july_2025":2306.00,"move_in_payment":4700.00}
Documents: Ticket SLA 92% right
{"ticket_id":"48213","account_id":"ACC-7731","open_issue":"inventory_sync","resolved_issues":["billing_address","invoice_pdf"],"affected_orders":["SO-99812","SO-99820","SO-99827"],"priority":"P2","sla_due_local":"2025-09-15T15:30","sla_due_utc":"2025-09-15T20:30:00Z","reissued_invoice":"INV-2025-0812"}
Documents: Sales footnotes 100% right
{"q3_total_usd":15346000,"q2_total_usd":14464000,"q2_central_originally_reported_usd":3047000,"q2_to_q3_change_pct":6.1,"top_region_q3":"East","fastest_growing_region_q1_to_q3":"International","regions_declining_q2_to_q3":["East"],"international_q3_organic_usd":1731000,"west_excluding_mountain_q3_usd":4201000}

Size: 35B parameters. First tested OCT 11.

Models that scored about the same

Comments

Sign in with GitHub to comment. Spam and abuse are hidden automatically.