PlotPoints · A Plotlight Studios Benchmark
3,973 votes  ·  800 voters  ·  3rounds  ·  CC-BY 4.0

The Roleplay AI
Verdict.

PlotPoints is an open, human-voted benchmark for AI roleplay. Models play out adversarial twelve-turn scenes built to bait specific failure modes; you read two of them blind and say which one read better. We turn those votes into calibrated rankings — and publish the methodology, the seeds, and the raw ballots alongside every result, CC-BY 4.0.

How it works →Donate a chat →Raw votes
The Editions

Every round, written up.

Each round closes with an issue — the finding, the field, and what the votes overturned.

▌ Now Voting · Issue № 03
Round 03 is open.
A refreshed pool on the classic seeds — and, after dark, the NSFW arena asks whether human voters overturn the judges.
Live standings →Preliminary judge results →
The Record

Past standings.

Closed rounds keep their calibrated leaderboards. Two so far, and they disagree about who's best.

01
Single-Turn Arena
Champion · Gemma 4 26B
Held #1 community ELO across all six checkpoints.
Standings →Read issue
02
Multi-Turn Arena
Champion · Claude Opus 4.7
The great inversion — Round 01's podium sank on twelve-turn reads.
Standings →Read issue
Methodology · Raw votes · GitHub · HuggingFace dataset · RSS
Issue № 03 · Now voting