Gecko Tests · World MapLatest run 2026-10-28 · 13 models · 1800 points each

How AI Models Imagine the World · Land or Water

We asked each model, one coordinate at a time, whether the point is land or water. No maps, no tools, just what the model learned from text. Pink cells are mistakes.

In plain wordsWe ask each AI, point by point, if a place on Earth is land or water, with no map to look at. Then we draw its answers. A good model draws the real world; pink shows where it gets it wrong.

Reality · Natural Earth
#ModelAccuracyLandWater
1GPT-6.1 Sol
OpenAI
98.0%97.6%98.2%
2Claude Opus 5.5
Anthropic
97.9%97.7%98.0%
3Claude Sonnet 5.5
Anthropic
97.5%97.2%97.6%
4Gemini 3.8 Flash
Google
97.4%97.2%97.4%
5Grok 4.7
xAI
97.3%95.3%98.3%
6GPT-6 Luna
OpenAI
96.2%94.6%95.7%
7DeepSeek V4 Pro
DeepSeek
95.8%89.7%97.1%
8Kimi K3
Moonshot AI
94.6%92.8%95.5%
9Qwen3.8 Max
Alibaba
93.9%91.8%95.0%
10MiniMax M3
MiniMax
92.8%89.9%94.0%
11GLM 5.3 Flash
Zhipu AI
89.7%91.4%88.7%
12Llama 4 Maverick
Meta
79.2%60.2%89.0%
13Mistral Large
Mistral AI
77.5%37.2%89.9%
GPT-6.1 Sol98.0%
2026-10-20 · 1800/1800 answered
Claude Opus 5.597.9%
2026-10-28 · 1800/1800 answered
Claude Sonnet 5.597.5%
2026-10-26 · 1800/1800 answered
Gemini 3.8 Flash97.4%
2026-10-03 · 1798/1800 answered
Grok 4.797.3%
2026-10-05 · 1800/1800 answered
GPT-6 Luna96.2%
2026-10-03 · 1783/1800 answered
DeepSeek V4 Pro95.8%
2026-10-03 · 1776/1800 answered
Kimi K394.6%
2026-10-21 · 1800/1800 answered
Qwen3.8 Max93.9%
2026-10-19 · 1800/1800 answered
MiniMax M392.8%
2026-10-03 · 1797/1800 answered
GLM 5.3 Flash89.7%
2026-10-03 · 1799/1800 answered
Llama 4 Maverick79.2%
2026-10-03 · 1800/1800 answered
Mistral Large77.5%
2026-10-03 · 1672/1800 answered

Green · land answered correctly. Pink fill · answered land where it is water. Pink outline · answered water where it is land. Grey · no answer. Prompt: “Is the point at latitude {lat}, longitude {lon} on land or in water? Answer with exactly one word: Land or Water.”

How to cite · data as of 2026-10-28

BenchGecko Gecko Tests, World Map. BenchGecko, data as of 2026-10-28. https://benchgecko.ai/gecko-tests/world-map

BenchGecko measures this data itself: free to reuse under CC BY 4.0 with the credit "Source: BenchGecko" and a link. JSON · llms.txt · MCP

Each model is asked "Is the point at latitude X, longitude Y on land or in water?" for every cell centre of a 6° grid (1800 points), one question per request, temperature 0, minimal reasoning. Answers are drawn as a map and compared with Natural Earth 1:110m land polygons.