Thoughts on AI, technology, and the future we're building.
New posts every week
A model-level benchmark profile for Devstral 2, combining Arena category ranks, suite indexes, commercial price and speed data, SWE-bench status, and lab context.
Lab
Mistral
Open weights
Coverage
33%
3 of 9 tracked signals
Best Arena rank
#77
WebDev Arena
Best suite
#81
Coding / 19
Model profile
This view treats missing values as coverage gaps, then puts every available score, rank, cost, and speed signal into the same visual hierarchy.
Analyst view
Its best composite result is rank #81 in the coding view, with a 19 coding index. The strongest raw Arena signal is WebDev Arena at rank #77 with 1,583 public votes.
Best current lane
Coding
#81 / 19 coding index
Strongest raw signal
Code
#77, 1199 score
Commercial posture
Not listed
0.63s first token / 34 tok/s
Coverage gaps
Profile completeness
Arena categories
1/5
Code
Commercial match
Live
Devstral 2
SWE-bench
Not listed
No confident software benchmark row
Raw identifier
devstral-2
Performance cockpit
Arena rows show score, public rank, confidence interval, vote count, and publish date. Missing rows stay visible as coverage gaps.
Text Arena
Arena category
Not listed
No confident public Arena row for this category.
Coverage gap
WebDev Arena
Arena category
1182-1216 CI
Vision Arena
Arena category
Not listed
No confident public Arena row for this category.
Coverage gap
Search Arena
Arena category
Not listed
No confident public Arena row for this category.
Coverage gap
Document Arena
Arena category
Not listed
No confident public Arena row for this category.
Coverage gap
SWE-bench Verified
Software issue resolution
Not listed
No confident SWE-bench row matched to this model.
Coverage gap
Cost and speed
Price, latency, and throughput are only shown when a confident commercial source row is matched.
Blended price
Not listed
USD / 1M tokens
Input price
Not listed
USD / 1M input tokens
Output price
Not listed
USD / 1M output tokens
Latency
0.63s
Median time to first token
Output speed
34 tok/s
Median generation speed
Matched source row
Devstral 2Suite position
These views combine available public signals into purpose-specific indexes. A missing card means the model lacks enough source coverage for that lens.
Value
Quality, price, latency, and output speed
Not listed
Not enough matched source rows for this composite view.
Coding
Code Arena, SWE-bench, and output speed
coding index
Agents
Search, documents, code, and latency
agent proxy
Reasoning
Text, documents, vision, and mode signal
Not listed
Not enough matched source rows for this composite view.
Long context
Document, search, and text benchmark proxy
Not listed
Not enough matched source rows for this composite view.
Lab context
Same-lab models make it easier to see whether this profile is a flagship, value play, specialist, or lower-coverage row.
Mistral Large 3
mistral-large-3
Best rank
#73
Coverage
56%
Mistral Medium 2508
mistral-medium-2508
Best rank
#74
Coverage
11%
Mistral Medium 2505
mistral-medium-2505
Best rank
#76
Coverage
11%
Devstral Medium 2507
devstral-medium-2507
Best rank
#81
Coverage
11%
Mistral Small 2506
mistral-small-2506
Best rank
#84
Coverage
11%
Mistral Small 3.1 24b Instruct 2503
mistral-small-3.1-24b-instruct-2503
Best rank
#86
Coverage
11%
Pixtral Large 2411
pixtral-large-2411
Best rank
#97
Coverage
44%