What will be true of the first model to cross 1400 on lmarena.ai?
Plus
10
Ṁ1219Apr 1
42%
Gemini Exp
3%
ChatGPT 4o
3%
o1
30%
Gemini 2.0
8%
Claude 3.5 Opus
5%
Claude 4
4%
Grok
11%
OpenAI model code named Orion
5%
GPT 5
Will resolve if a model stays at or above 1400 for a week and has a 95% CI with a lower bound of at least 1395 at the end of that week (somewhat arbitrary criteria to ensure the score is based on a sufficient amount of votes)
Will N/A if they change the scoring significantly so that a current model passes 1400.
Current rankings (11/22/24):
Gemini Exp 1121: 1365
ChatGPT 4o Latest (2024-11-20): 1360
Gemini Exp 1114: 1343
o1 preview: 1334
o1 mini: 1308
Gemini 1.5 Pro-002: 1301
Grok 2 0813: 1289
Yi Lightning: 1287
GPT 4o 2024-05-13: 1285
Claude 3.5 Sonnet (20241022): 1282
Update 2025-24-01 (PST): - If a Deepseek model is first to cross 1400, all will resolve to NO (AI summary of creator comment)
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Related questions
Related questions
Who will have the highest ranking model on web.lmarena.ai by March 2025?
Which of these models have an ELO Rating in the LMARENA (formerly known as LMSYS) by the end of January 2025?
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
74% chance
Top score on codeforces by an AI model at the end of 2025
Will an AI model outperform 95% of Manifold users on accuracy before 2026?
56% chance
Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?
63% chance
Will OpenAI models achieve ≥90% on SimpleBench by the end of 2025?
49% chance
When will OpenAI release a more capable LLM?
Who will have the highest ranking model on web.lmarena.ai by end of June 2025?
What year will the first AI exceed 80% on MLE-bench?