What it measures
- AutomationBench v1.0.6
AutomationBench v1.0.6
Versioned AutomationBench result; preserve harness notes from the supplied Z.ai report.
How to read the score
% success; higher is better.
Sourced Ranking
| Rank | Model | Provider | Score | Source | Source Type | Verified |
|---|---|---|---|---|---|---|
| 1 | GLM-5.3-Flash | Z.ai | 48.8 | GLM-5.3-Flash official release and benchmark report Accessed 2026-09-04 | official | Yes |
| 2 | GPT-6.1 Sol | OpenAI | 31.7 | GPT-6.1 Sol cost-performance chart transcription Accessed 2026-10-02 | community | Yes |
Limitations
- Scores may not be directly comparable across model reports, harnesses, or task releases.
- Preserve the exact version, evaluation configuration, and reporting source in each result row.
- Vendor and third-party scores are stored as raw evidence and are not automatically used in the five-axis capability radar.
leaderboard
AutomationBench v1.0.6 source record
Preserve the exact version, evaluation configuration, and reporting source in each result row. Vendor and third-party scores are stored as raw evidence and are not automatically used in the five-axis capability radar.