GLM-5.1 delivers a major leap in coding capability, with particularly significant gains in handling long-horizon tasks. Unlike previous models built around minute-level interactions, GLM-5.1 can work independently and continuously on...
Tested on 22 benchmarks with 59.8% average. Top scores: Chatbot Arena Elo — Coding (1529.2%), Chatbot Arena Elo — Overall (1475.3%), OTIS Mock AIME 2024-2025 (92.2%).
Qwen3.6 Plus scores 69.8 (99% as good) at $0.33/1M input · 77% cheaper
Regularly refreshed coding problems that avoid data contamination. New problems added monthly to prevent memorization.
Real-world software engineering tasks from GitHub issues. Models must diagnose bugs and write patches that pass test suites. Human-verified subset of SWE-bench.
Unusual and adversarial machine learning challenges. Tests robustness of reasoning about edge cases in ML systems.
Regularly refreshed reasoning problems testing logical deduction, spatial reasoning, and analytical thinking.
Fresh data analysis tasks testing ability to interpret tables, charts, and statistical data.
Deceptively simple questions that humans find easy but AI models often get wrong. Tests common sense and reasoning gaps.
Mock AIME (American Invitational Mathematics Exam) problems from OTIS. Tests mathematical competition performance.
Regularly updated math problems that test numerical reasoning, algebra, calculus, and combinatorics.
Original research-level math problems created by professional mathematicians. Problems are unpublished and cannot be memorized.
- Typetext
- Context205K tokens (~102 books)
- ReleasedApr 2026
- LicenseOpen Source
- StatusActive
- Cost / Message~$0.007