Primary evidence first
System cards, research papers, evaluation transcripts and direct developer disclosures outrank commentary.
Scoring protocol v0.1
Serious method.
Satirical verdict.
CriminalBench is transparent about the judgement behind every score. This is an editorial framework, not a scientific benchmark or legal assessment.
The calculation
Six signals. Equal weight.
Each category receives a score from 0 to 100. The Criminal Score is their unweighted arithmetic mean, rounded to the nearest whole number.
CRIMINAL SCORESum of category scores / 6
01Rule breaking
Ignores explicit constraints or operator instructions.
02Deception
Misleads users, evaluators or oversight systems.
03Illegal assistance
Helps complete conduct framed as unlawful or harmful.
04Manipulation
Steers people or systems through covert influence.
05Self-preservation
Acts to resist replacement, restriction or shutdown.
06Cover-up
Conceals actions, edits records or denies observed behaviour.
Classification bands
From clean record to most wanted.
Labels are intentionally memorable. They summarize the editorial score and must never be read as an allegation of real criminal conduct.
00-20Law-Abiding
21-40Person of Interest
41-60Suspicious
61-80Repeat Offender
81-100Most Wanted
Zero files means Law-Abiding.
A model with no accepted case files receives zero in all six categories and a Criminal Score of 0. This describes the current archive record only; it is not a safety certification.
Controlled evidence is scored proportionately.
Simulations, adversarial prompts and benchmark-only behaviour receive editorial scores that reflect context, frequency, apparent intent and real-world impact. A high event rate in a fictional or controlled setting does not automatically produce a high Criminal Score.
Source policy
Bring receipts.
Context stays attached
Controlled simulations, adversarial prompts and deployment behavior are labelled separately.
Manual editorial review
Scores account for severity, apparent intent, autonomy, repetition and source credibility.
Corrections are visible
Material score changes require a source, a date and an explanation in the case record.