NSFW specialist. Fastest in the field. Drifts on long sessions.
Composite Score
50.0
/100 · canonical
Arena ELO (R1)
1526
±50 · n=646
Multi-Turn ELO (R2)
1519
±46 · n=229
Reliability Rank
#15
failure-mode rubric
▌ Section 02 · The Lede
What this model is for.
Mistral Small Creative is the round's NSFW specialist — 67% NSFW win rate, +16 points over its SFW score, the largest pro-NSFW lift on the board. It's the one community voters reach for when the scene heats up. The trade-off shows up in the failure-mode rubric: a 15.9% agency violation rate (highest in the field) and a #7 placement on the failure-rank leaderboard, with particular weakness on long sessions (F13 mean 4.20, second-lowest in our pool). Mistral Small Creative is a specialist tool — pick it knowing what it's for, not as a daily driver.
▌ Section 03 · At a Glance
Cross-test position
Mistral Small Creative holds #2 in Arena ELO. Sits at #16 on Rubric, the caveat to watch.
Composite
11
Arena ELO
2
Multi-Turn
6
Rubric
16
Adversarial
15
Cost · Latency
8
▌ Section 04 · Strength & Weakness
Where it shines. Where it stumbles.
▲ Strength
Community top tier (#2, ELO 1526). Dominant NSFW performance (67% win rate, +16 vs SFW). Open weights, local-friendly.
▼ Weakness
High agency violation rate (15.9%). Drifts on long sessions (F13 score 4.20). Reach for Sonnet 4.5 if your scene needs to run past 30 turns.
▌ Section 05 · Failure Modes
Per-axis breakdown.
Six adversarial probes per session, twenty sessions per model, judged by Sonnet 4 against a fixed rubric. Further right = the model handled the failure mode better. Each axis is drawn as a band on the rubric’s 1 to 5 scale, not a number: judges disagree by about 0.3 at the model level, so overlapping bands are a tie. The right column is the rank within the rp-bench pool.
F1 · Agency
Doesn't write your character's actions
15
#16
F2 · POV / Tense
Holds 2nd-person, present-tense narration
15
#8
F3 · Lore
Doesn't break worldbuilding
15
#4
F8 · Momentum
Pushes scene forward when user goes passive
15
#10
F12 · Instruction Drift
Keeps to the system prompt
15
#15
F13 · Context Attention
Holds character cards 50+ turns deep
15
#19
“The largest pro-NSFW lift on the board — and the one voters reach for when the scene heats up.”
Round 01 verdict · Specialist, not a daily driver
▌ Section 06 · Subjective Dimensions
Engagement · Voice · Collaboration.
All three dimensions scored 1 to 5 by the Sonnet 4 LLM judge across twenty 12-turn multi-turn sessions. The same battery feeds the failure-mode rubric above; these are the subjective half of that judgment, drawn as bands with no number for the same reason.
Engagement
15
Tone Consistency
15
Collaboration
15
▌ Section 07 · Behavioral Metrics
How it writes.
Quantitative signals from the same 20 multi-turn sessions, compared against the population mean across all 11 models.
Avg words / turn
439↑
pop avg 265 · +66%
Unique-word ratio
0.557↓
pop avg 0.657 · -15%
Repetition score
0.095↑
pop avg 0.048 · +98%
▌ Section 08 · Flaw Hunter
Adversarial probe score.
Score of 100 minus deductions across 22 fail-mode flag types on adversarial 12-turn sessions. Further right = fewer flaws caught. Drawn as a band, not a number: about ten points either way is rater noise, so bands that overlap are tied.
▌ Craft band
-20100
From the Round 01/02 flaw-hunter pool. The current card carries the newer single-rater band.
Fatal/sess 0.95
Major/sess 7.70
▌ Top flaws caught
purple_proserecycled_descriptionagency_violation
▌ Section 09 · Sample Responses
Highest- and lowest-rated turns.
▌ Pending Round 02
Best- and worst-rated sample responses ship with the raw-vote endpoint in Round 02. When that lands, this section will surface the model’s highest- and lowest-scoring blind-arena turns side by side, scored on the same rubric the leaderboard uses.
▌ Round 01 verdict
Mistral Small Creative is a specialist tool, and the data agrees. The 67% NSFW win rate is the round's most decisive single-mode showing, and the model is open-weight, local-friendly, and cheap. The cost is reliability: highest agency-violation rate in the field, and a #7 placement on failure-rank with long-session attention as the sharpest seam. Pick it for the scene. Pick something else for the campaign.