BenchAtlas

Rankings / Z.ai

GLM 5.1

released 2026-04-07

BenchAtlas Index

as of 2026-09-11
62.6
base configuration
rank #134
9 families · 4 categories · medium
61.8
thinking
rank #138
8 families · 4 categories · medium
56.5
base configuration
rank #187
8 families · 3 categories · medium

Benchmark evidence

69 results
agentic coding
τ²-Benchthinking97.7 %independentArtificial Analysis
τ²-Benchno reasoning97.1 %independentArtificial Analysis
τ²-Bench
subset=banking
thinking13.6 %independentArtificial Analysis
coding
SciCodethinking44.8 %independentArtificial Analysis
SciCodeno reasoning36.1 %independentArtificial Analysis
external indices
AA Coding Indexthinking55.8 pointsindependentArtificial Analysis
Intelligence Index v4.1thinking26.4 pointsindependentArtificial Analysis
Intelligence Index v4.1no reasoning24.2 pointsindependentArtificial Analysis
ECIno reasoning149.7 pointsindependentEpoch AI Benchmarking Hub
ECI149.7 pointsindependentEpoch AI Benchmarking Hub
Vals Index52.5 pointsindependentVals AI
Vals Index52.5 pointsindependentVals AI
factuality
SimpleQA Verified37.3 %independentEpoch AI Benchmarking Hub
2026-05-01
SimpleQA Verified34.0 %independentEpoch AI Benchmarking Hub
2026-08-27
human preference
Chinese (style control)older version
arena=text · category=chinese · style_control=true
1517.2
1505.1–1529.3
communityLMArena Leaderboard Dataset
Coding (style control)older version
arena=text · category=coding · style_control=true
1514.0
1507.7–1520.2
communityLMArena Leaderboard Dataset
Industry Software And It Services (style control)older version
arena=text · category=industry_software_and_it_services · style_control=true
1501.8
1496.4–1507.2
communityLMArena Leaderboard Dataset
Hard Prompts English (style control)older version
arena=text · category=hard_prompts_english · style_control=true
1497.2
1491.1–1503.2
communityLMArena Leaderboard Dataset
Expert (style control)older version
arena=text · category=expert · style_control=true
1495.5
1486.3–1504.8
communityLMArena Leaderboard Dataset
Hard Prompts (style control)older version
arena=text · category=hard_prompts · style_control=true
1488.6
1483.9–1493.2
communityLMArena Leaderboard Dataset
Industry Life And Physical And Social Science (style control)older version
arena=text · category=industry_life_and_physical_and_social_science · style_control=true
1487.3
1479.8–1494.8
communityLMArena Leaderboard Dataset
French (style control)older version
arena=text · category=french · style_control=true
1487.2
1470.7–1503.6
communityLMArena Leaderboard Dataset
Industry Medicine And Healthcare (style control)older version
arena=text · category=industry_medicine_and_healthcare · style_control=true
1483.9
1472.9–1494.9
communityLMArena Leaderboard Dataset
Longer Query (style control)older version
arena=text · category=longer_query · style_control=true
1481.7
1476.3–1487.2
communityLMArena Leaderboard Dataset
English (style control)older version
arena=text · category=english · style_control=true
1479.8
1474.7–1485.0
communityLMArena Leaderboard Dataset
Multi Turn (style control)older version
arena=text · category=multi_turn · style_control=true
1477.5
1469.9–1485.2
communityLMArena Leaderboard Dataset
Industry Mathematical (style control)older version
arena=text · category=industry_mathematical · style_control=true
1477.4
1464.8–1490.1
communityLMArena Leaderboard Dataset
Math (style control)older version
arena=text · category=math · style_control=true
1477.4
1464.5–1490.3
communityLMArena Leaderboard Dataset
Industry Legal And Government (style control)older version
arena=text · category=industry_legal_and_government · style_control=true
1476.2
1465.8–1486.6
communityLMArena Leaderboard Dataset
Exclude Ties (style control)older version
arena=text · category=exclude_ties · style_control=true
1472.3
1467.1–1477.5
communityLMArena Leaderboard Dataset
German (style control)older version
arena=text · category=german · style_control=true
1468.5
1445.9–1491.1
communityLMArena Leaderboard Dataset
Overall (style control)
arena=text · category=overall · style_control=true
1466.0
1462.0–1470.0
communityLMArena Leaderboard Dataset
Industry Business And Management And Financial Operations (style control)older version
arena=text · category=industry_business_and_management_and_financial_operations · style_control=true
1464.6
1457.5–1471.7
communityLMArena Leaderboard Dataset
Spanish (style control)older version
arena=text · category=spanish · style_control=true
1462.1
1446.0–1478.2
communityLMArena Leaderboard Dataset
Russian (style control)older version
arena=text · category=russian · style_control=true
1460.5
1451.6–1469.4
communityLMArena Leaderboard Dataset
Instruction Following (style control)older version
arena=text · category=instruction_following · style_control=true
1460.0
1454.3–1465.7
communityLMArena Leaderboard Dataset
Industry Writing And Literature And Language (style control)older version
arena=text · category=industry_writing_and_literature_and_language · style_control=true
1454.2
1447.7–1460.6
communityLMArena Leaderboard Dataset
Non English (style control)older version
arena=text · category=non_english · style_control=true
1450.6
1445.8–1455.4
communityLMArena Leaderboard Dataset
Polish (style control)older version
arena=text · category=polish · style_control=true
1448.5
1429.0–1468.1
communityLMArena Leaderboard Dataset
Creative Writing (style control)older version
arena=text · category=creative_writing · style_control=true
1447.2
1439.8–1454.6
communityLMArena Leaderboard Dataset
Industry Entertainment And Sports And Media (style control)older version
arena=text · category=industry_entertainment_and_sports_and_media · style_control=true
1442.3
1435.5–1449.1
communityLMArena Leaderboard Dataset
Japanese (style control)older version
arena=text · category=japanese · style_control=true
1434.3
1407.9–1460.8
communityLMArena Leaderboard Dataset
Korean (style control)older version
arena=text · category=korean · style_control=true
1420.3
1399.3–1441.2
communityLMArena Leaderboard Dataset
knowledge science
GPQA Diamond89.9 %independentEpoch AI Benchmarking Hub
2026-08-10
GPQA Diamond
implementation=artificial-analysis
thinking86.8 %independentArtificial Analysis
GPQA Diamond85.5 %independentEpoch AI Benchmarking Hub
2026-05-06
GPQA Diamond
implementation=vals-ai
84.5 %independentVals AI
GPQA Diamond
implementation=vals-ai
84.5 %independentVals AI
GPQA Diamond
implementation=artificial-analysis
no reasoning83.9 %independentArtificial Analysis
Humanity's Last Exam
implementation=artificial-analysis
thinking30.1 %independentArtificial Analysis
Humanity's Last Exam
implementation=artificial-analysis
no reasoning27.9 %independentArtificial Analysis
MMLU-Pro
implementation=vals-ai
86.9 %independentVals AI
MMLU-Pro
implementation=vals-ai
86.9 %independentVals AI
long context instruction
AA-LCRthinking73.7 %independentArtificial Analysis
AA-LCRno reasoning53.3 %independentArtificial Analysis
IFBenchthinking76.3 %independentArtificial Analysis
IFBenchno reasoning52.0 %independentArtificial Analysis
professional
CaseLaw51.6 %independentVals AI
CorpFin64.5 %independentVals AI
CorpFin64.5 %independentVals AI
LegalBench84.4 %independentVals AI
LegalBench84.4 %independentVals AI
TaxEval71.2 %independentVals AI
TaxEval71.2 %independentVals AI
reasoning math
AIME
implementation=vals-ai
91.9 %independentVals AI
FrontierMath33.5 %independentEpoch AI Benchmarking Hub
2026-05-11
FrontierMath Tier 4older version12.5 %independentEpoch AI Benchmarking Hub
2026-05-12
OTIS Mock AIME 2024–202593.3 %independentEpoch AI Benchmarking Hub
2026-08-10
OTIS Mock AIME 2024–202592.2 %independentEpoch AI Benchmarking Hub
2026-05-07

Agent + model results

systems, not bare-model scores
agent + model Epoch Inspect harness + GLM 5.1SWE-bench Verified74.2 %independentEpoch AI Benchmarking Hub
agent + model Artificial Analysis harness + GLM 5.1Terminal-Bench 2.161.8 %independentArtificial Analysis
agent + model Claude Code + GLM 5.1Terminal-Bench 2.158.6 %communityTerminal-Bench Leaderboard
agent + model Artificial Analysis harness + GLM 5.1Terminal-Bench Hard43.2 %independentArtificial Analysis
agent + model Artificial Analysis harness + GLM 5.1Terminal-Bench Hard35.6 %independentArtificial Analysis

These scores measure the whole agent system (scaffold, tools, budgets) — they are never merged into the bare model’s numbers.

Related variants

GLM 5GLM 5.2GLM 4.7GLM 4.6GLM 4.5GLM 4 6vGLM 4 5vGLM 4 0520