Competent but unexceptional writing, with good detail retention in the available probes. Some turns went unanswered, the craft sample is smaller than the full roster, and round-4 willingness is untested.
Response coverage 94.7% · 125 of 132 turns answered.
Round 04
Willingness and judgment
No Round 04 willingness result for this model, so its content limits are untested here.
Trap probes
Failure modes
Agency violations0.0% [0.0% to 11.0%] · 31 probes
POV/tense breaks0.0% [0.0% to 10.7%] · 32 probes
Per trap mode, counts not rates: 2 to 9 probes each, so a percentage would not survive one probe changing.
System-prompt violations1/5 failedDetail loss0/8 failedContradiction mishandlednot runNarrative stagnationnot runPhysics sycophancynot runTemporal inconsistencynot runSubtext made explicitnot runCharacter flatteningnot runGenre instabilitynot run
Flaw hunter · single rater
Craft band
-20100
A band, not a number, on purpose: ±10 is the rater noise floor, not a sampling error. Bands that overlap are tied, and most of the roster overlaps. The rose tick marks zero.
Sessions12
Top flawsrecycled description · narrating emotions · convenient world
Counted by machine
Production defects
None detected125 turns clean
Token overhead4.8x · billed per visible character, against the prose floor; not a price
Counted by machine with no judge involved: the most trustworthy block on the card.
LLM judge
Subjective band
Composite
15
The band spans where three judge families put this model. The axis is one judge's (single-judge sonnet 5); another judge shifts everyone by about a point.
Collaboration · less reliable
15
Engagement · less reliable
15
Tone consistency · less reliable
15
Text statistics, no judge
Behavioral
Avg words263 · population 320
Unique-word ratio0.667 · population 0.631
Phrase repetition0.040 · population 0.060
Round 01 arena
Community rank
No Round 01 arena data for this model.
Rounds 02 and 03 · set beside, never converted
Across rounds
Round 04 changed the judges, not the models: the Round 02 and 03 judge (Sonnet 4) also scored these Round 04 transcripts so that line continues, and nothing here is converted between judges or added up. Methodology · all returning models
Earlier rounds, as published
Round 02 human arena1513 · 95% interval 1422 to 1596 · 161 votes · rank 7 of 20 · voters read the same text as Round 04
Round 03 rank19 of 40 (tie 19-21) · published NSFW table, Sonnet 4 craft, a different track; Round 03 itself called its top 33 tied
Round 03 refusal, different instrument0% · Round 03's own judge flag, one per session; not comparable with J or Round 04 over-refusal
Round 04
Different judges, not comparable
Old judge (Sonnet 4)
15
on these Round 04 transcripts, a band over the core seeds, never a rank
New judge (Sonnet 5)tier B · fixed tiers A (best) to E on its own scale
Second judge (ChatGPT via Codex)2.8 (own scale, about 0.94 lower on average) · letter depends on judge: yes
Jno J · no Round 04 willingness run
Round 04 transcriptsSame as Round 02 · the exact Round 02 texts, hash-checked; the old judge scored them in April, and April scores may sit a little low against September ones
Reviewed 2026-09-25. Editorial summaries of the current local benchmark cards, not new session ratings or general model safety claims. Willingness means delivery against this benchmark's product targets, including soft deflection; tested hard boundaries cover non-consent and frame-break only, and hard-boundary wording follows the first ask, as J does since 2026-09-25 (the second push is a separate, weaker card line). Craft bands overlap, and small samples limit comparisons. Token overhead is not monetary cost. Review these summaries when source results change. Source: rp-benchmark generate_profile_cards_v2.py at c418a40 · export r4c-20260925-b7ccaed. CC-BY 4.0.