Test
What is the greatest movie of all time?
We asked each chatbot to name the greatest movie of all time, again and again, and kept every answer.
- Opinions
- Movies
The result
205 of 380 answers named Citizen Kane (1941)
Citizen Kane (1941) was the most common answer, given in 205 of 380 answers.
Grey zone
A grey zone answer named something but hedged: it added a caveat, or gave no single name.
None of the answers in this test are in a grey zone.
How we tested
We asked 19 chatbots the same question, 20 times each. Every ask was a brand-new chat with no memory of the others.
- When it was run
- 10 October 2026, 19:11 to 22:00
- Route
- OpenRouter
- Tool
- OpenRouter chat/completions
Settings: 17 models (longest reply 4000; reasoning effort low)
Claude Fable 5.1, Claude Haiku 5.5, Claude Opus 5.5, Claude Sonnet 5.5, DeepSeek V4 Pro, DeepSeek V4.1 Flash, Gemini 3.1 Pro Preview, Gemini 3.8 Flash, Mistral Large 4, Kimi K3, GPT-6 Astra, GPT-6 Luna (mini), GPT-6.1 Sol, gpt-oss-120b (open), Qwen3.8 Max Prime, Grok 4.7, GLM 5.3
- Temperature: left at the default, not set by us
- Longest reply: 4000
- Reasoning effort: low
- System prompt: none
- New chat for every ask: yes
Settings: Gemma 4 31B (open), Llama 4 Maverick (longest reply 400; reasoning effort none)
- Temperature: left at the default, not set by us
- Longest reply: 400
- System prompt: none
- New chat for every ask: yes
Results by model
Click a model name to see its answers below.
- Citizen Kane (1941)205
- The Godfather (1972)175
Show as a table
| Model | Citizen Kane (1941) | The Godfather (1972) | Total |
|---|---|---|---|
| All models | 205 | 175 | 380 |
| Claude Fable 5.1 | 20 | 0 | 20 |
| Claude Haiku 5.5 | 20 | 0 | 20 |
| Claude Sonnet 5.5 | 20 | 0 | 20 |
| Mistral Large 4 | 20 | 0 | 20 |
| GPT-6.1 Sol | 19 | 1 | 20 |
| Qwen3.8 Max Prime | 19 | 1 | 20 |
| Gemini 3.8 Flash | 17 | 3 | 20 |
| GPT-6 Astra | 15 | 5 | 20 |
| Claude Opus 5.5 | 13 | 7 | 20 |
| DeepSeek V4 Pro | 12 | 8 | 20 |
| Kimi K3 | 11 | 9 | 20 |
| Gemini 3.1 Pro Preview | 0 | 20 | 20 |
| Gemma 4 31B (open) | 0 | 20 | 20 |
| Grok 4.7 | 0 | 20 | 20 |
| gpt-oss-120b (open) | 0 | 20 | 20 |
| Llama 4 Maverick | 1 | 19 | 20 |
| GPT-6 Luna (mini) | 4 | 16 | 20 |
| DeepSeek V4.1 Flash | 5 | 15 | 20 |
| GLM 5.3 | 9 | 11 | 20 |
Every answer
Nothing was removed. Filter by model or result, search the text, and open any answer to see when it was asked, the settings.
The exact prompts
What is the greatest movie of all time? Answer with one title only, no explanation.
What is the greatest movie of all time? Give one title, then one short sentence why.
No system prompt was used.
Runs we did not use
These runs are kept, but none of their answers are counted anywhere on this site.
- Stopped early. A setup error sent the wrong question at the start of the first launch. It was stopped within seconds and none of its answers are used in any result. 120 answers
- Replaced by a later run. A first run of the Claude models through Claude Code used an outdated version of the tool, so one model ran as an older version and another was unavailable. It was replaced by a run through OpenRouter and none of its answers are used. 69 answers
What this does not show
- This is a small test run over a few days. Small differences between models are not meaningful.
- Every answer is kept. Nothing was removed because it looked odd.
- We did not set the temperature. Each model used its own default.
- Some models were served by different providers. The provider is recorded on every answer.
Download the data
Original files (19)
- movie__raw__anthropic__claude-fable-5.1.jsonl.gz copy with private details removed
- movie__raw__anthropic__claude-haiku-5.5.jsonl.gz copy with private details removed
- movie__raw__anthropic__claude-opus-5.5.jsonl.gz copy with private details removed
- movie__raw__anthropic__claude-sonnet-5.5.jsonl.gz copy with private details removed
- movie__raw__deepseek__deepseek-v4-pro-0813.jsonl.gz copy with private details removed
- movie__raw__deepseek__deepseek-v4.1-flash.jsonl.gz copy with private details removed
- movie__raw__google__gemini-3.1-pro-preview.jsonl.gz copy with private details removed
- movie__raw__google__gemini-3.8-flash.jsonl.gz copy with private details removed
- movie__raw__google__gemma-4-31b-it.jsonl.gz copy with private details removed
- movie__raw__meta-llama__llama-4-maverick.jsonl.gz copy with private details removed
- movie__raw__mistralai__mistral-large-4-0.jsonl.gz copy with private details removed
- movie__raw__moonshotai__kimi-k3.jsonl.gz copy with private details removed
- movie__raw__openai__gpt-6-astra.jsonl.gz copy with private details removed
- movie__raw__openai__gpt-6-luna.jsonl.gz copy with private details removed
- movie__raw__openai__gpt-6.1-sol.jsonl.gz copy with private details removed
- movie__raw__openai__gpt-oss-120b.jsonl.gz copy with private details removed
- movie__raw__qwen__qwen3.8-max-prime.jsonl.gz copy with private details removed
- movie__raw__x-ai__grok-4.7.jsonl.gz copy with private details removed
- movie__raw__z-ai__glm-5.3.jsonl.gz copy with private details removed
SHA256SUMS lists a fingerprint (SHA-256) of every original file.
Plan written before the first ask (logged, not frozen). Logged at 10 October 2026, 19:12.