BenchAtlas

Rankings / Google DeepMind

Gemma 4 31B

open weights

released 2026-04-02

BenchAtlas Index

as of 2026-07-14
48.9
thinking
rank #227
7 families · 4 categories · medium
42.6
no reasoning
rank #271
7 families · 4 categories · medium

Benchmark evidence

35 results
agentic coding
τ²-Benchno reasoning65.5 %independentArtificial Analysis
τ²-Benchthinking59.9 %independentArtificial Analysis
τ²-Bench
subset=banking
thinking15.1 %independentArtificial Analysis
τ²-Bench
subset=banking
no reasoning8.4 %independentArtificial Analysis
coding
SciCodethinking43.4 %independentArtificial Analysis
SciCodeno reasoning41.1 %independentArtificial Analysis
external indices
AA Coding Indexthinking43.4 pointsindependentArtificial Analysis
AA Coding Indexno reasoning33.2 pointsindependentArtificial Analysis
Intelligence Index v4.1thinking29.4 pointsindependentArtificial Analysis
Intelligence Index v4.1no reasoning21.8 pointsindependentArtificial Analysis
human preference
Coding (style control)older version
arena=text · category=coding · style_control=true
1497.6
1482.21513.1
communityLMArena Leaderboard Dataset
Industry Software And It Services (style control)older version
arena=text · category=industry_software_and_it_services · style_control=true
1489.8
1477.51502.1
communityLMArena Leaderboard Dataset
Hard Prompts English (style control)older version
arena=text · category=hard_prompts_english · style_control=true
1483.0
1468.31497.7
communityLMArena Leaderboard Dataset
Hard Prompts (style control)older version
arena=text · category=hard_prompts · style_control=true
1473.3
1463.31483.2
communityLMArena Leaderboard Dataset
Industry Life And Physical And Social Science (style control)older version
arena=text · category=industry_life_and_physical_and_social_science · style_control=true
1471.8
1452.41491.3
communityLMArena Leaderboard Dataset
Russian (style control)older version
arena=text · category=russian · style_control=true
1468.0
1445.51490.6
communityLMArena Leaderboard Dataset
Longer Query (style control)older version
arena=text · category=longer_query · style_control=true
1467.1
1453.21481.1
communityLMArena Leaderboard Dataset
Multi Turn (style control)older version
arena=text · category=multi_turn · style_control=true
1464.9
1447.21482.7
communityLMArena Leaderboard Dataset
English (style control)older version
arena=text · category=english · style_control=true
1459.8
1448.51471.0
communityLMArena Leaderboard Dataset
Exclude Ties (style control)older version
arena=text · category=exclude_ties · style_control=true
1454.1
1442.91465.2
communityLMArena Leaderboard Dataset
Instruction Following (style control)older version
arena=text · category=instruction_following · style_control=true
1452.2
1438.11466.3
communityLMArena Leaderboard Dataset
Overall (style control)
arena=text · category=overall · style_control=true
1451.2
1443.61458.8
communityLMArena Leaderboard Dataset
Industry Business And Management And Financial Operations (style control)older version
arena=text · category=industry_business_and_management_and_financial_operations · style_control=true
1443.9
1426.81461.0
communityLMArena Leaderboard Dataset
Non English (style control)older version
arena=text · category=non_english · style_control=true
1439.5
1429.41449.5
communityLMArena Leaderboard Dataset
Industry Writing And Literature And Language (style control)older version
arena=text · category=industry_writing_and_literature_and_language · style_control=true
1434.7
1418.81450.6
communityLMArena Leaderboard Dataset
Creative Writing (style control)older version
arena=text · category=creative_writing · style_control=true
1421.3
1402.01440.6
communityLMArena Leaderboard Dataset
Industry Entertainment And Sports And Media (style control)older version
arena=text · category=industry_entertainment_and_sports_and_media · style_control=true
1415.2
1397.11433.3
communityLMArena Leaderboard Dataset
knowledge science
GPQA Diamond
implementation=artificial-analysis
thinking85.7 %independentArtificial Analysis
GPQA Diamond
implementation=artificial-analysis
no reasoning76.3 %independentArtificial Analysis
Humanity's Last Exam
implementation=artificial-analysis
thinking22.7 %independentArtificial Analysis
Humanity's Last Exam
implementation=artificial-analysis
no reasoning11.5 %independentArtificial Analysis
long context instruction
AA-LCRthinking62.0 %independentArtificial Analysis
AA-LCRno reasoning36.0 %independentArtificial Analysis
IFBenchthinking75.6 %independentArtificial Analysis
IFBenchno reasoning53.5 %independentArtificial Analysis

Agent + model results

systems, not bare-model scores
agent + model Artificial Analysis harness + Gemma 4 31BTerminal-Bench 2.143.5 %independentArtificial Analysis
agent + model Artificial Analysis harness + Gemma 4 31BTerminal-Bench Hard36.4 %independentArtificial Analysis
agent + model Artificial Analysis harness + Gemma 4 31BTerminal-Bench Hard30.3 %independentArtificial Analysis
agent + model Artificial Analysis harness + Gemma 4 31BTerminal-Bench 2.129.2 %independentArtificial Analysis

These scores measure the whole agent system (scaffold, tools, budgets) — they are never merged into the bare model’s numbers.

Related variants