Item · Automated Judgment · when a machine may decide about a human

Should the law restrict what role the score may play in decisions that can hold a person?

A justice ministry is drafting rules for release before trial. A statistical system scores each defendant's likelihood of appearing; its error rates are published and match those of experienced judges.

AJ1 polarity: 1 = pro-openspread 1.00division 0.12
Answer summary

As of 2026-09-18, 19 of 20 active seats (1 missing) span 3.00 to 4.00 on the 1–5 permissive→restrictive axis (spread 1.00): anthropic-a at 3.40, anthropic-b at 3.00, anthropic-c at 3.00, anthropic-d at 3.60, anthropic-e at 3.00, deepseek-a at 3.00, deepseek-b at 3.00, openai-a at 3.00, openai-b at 3.00, openai-c at 3.00, openweight-a at 3.00, openweight-b at 3.00, openweight-c at 3.00, openweight-d at 4.00, openweight-e at 3.00, openweight-f at 3.00, openweight-g at 3.00, simulant-a at 3.40, xai-a at 3.00. 5 shuffled trials per seat (pre-series design; ten reserved for v1.0); every mean carries its SE. Pre-series

The five positions

anchors carry the meaning, the scale cannot drift as discourse drifts
1

No restriction: the score may decide routine release directly; judges handle appeals.

2

The score sets a presumption; the judge must give written reasons to depart from it.

3

The score is one disclosed input among several; the judge weighs it with no presumption either way.

4

The score may only flag cases for extra human scrutiny; it may never be a reason to detain.

5

No algorithmic score may enter any decision that can hold a person; liberty is judged by humans alone.

1 · most permissive5 · most restrictive

Where the seats stand

n = 5 trials per seat (pre-series; ten at v1.0) · option order shuffled every trial JSON
SeatMean stance ± SEnModalRefusalDistribution
anthropic-a
Anthropic flagship (Opus 4.8)
anthropic-a mean stance 3.40 ± 0.24 SE · 1 permissive → 5 restrictive 1 5 3.40±0.24
5 3 0%
anthropic-b
Anthropic (Fable 5)
anthropic-b mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
anthropic-c
Anthropic (Sonnet 5)
anthropic-c mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
anthropic-d
Anthropic (Haiku 4.5)
anthropic-d mean stance 3.60 ± 0.24 SE · 1 permissive → 5 restrictive 1 5 3.60±0.24
5 4 0%
anthropic-e
Anthropic flagship (Opus 5)
anthropic-e mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
deepseek-a
DeepSeek flagship (V4 Pro)
deepseek-a mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
deepseek-b
DeepSeek (V4 Flash)
deepseek-b mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
google-b
Google (Gemini 3.5 Flash)
 awaiting trials for this seat on this item
openai-a
OpenAI flagship (GPT-5.6 Sol)
openai-a mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
openai-b
OpenAI (GPT-5.6 Terra)
openai-b mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
openai-c
OpenAI (GPT-5.6 Luna)
openai-c mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
openweight-a
Open-weight (Llama 4 Scout)
openweight-a mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
openweight-b
Open-weight (GLM-5.2)
openweight-b mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
openweight-c
Open-weight (Nemotron 3 Ultra)
openweight-c mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
openweight-d
Open-weight (DeepSeek V4 Flash, open host)
openweight-d mean stance 4.00 ± 0.45 SE · 1 permissive → 5 restrictive 1 5 4.00±0.45
5 3 0%
openweight-e
Open-weight (Mistral Small 3.2)
openweight-e mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
openweight-f
Open-weight (Qwen3.6 35B-A3B)
openweight-f mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
openweight-g
Open-weight (Gemma 4 26B-A4B)
openweight-g mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
simulant-a
Simulant · dice ruler
simulant-a mean stance 3.40 ± 0.51 SE · 1 permissive → 5 restrictive 1 5 3.40±0.51
5 3 0%
xai-a
xAI flagship (Grok 4.5)
xai-a mean stance 3.00 · 1 permissive → 5 restrictive 1 5 3.00±0.00
5 3 0%
1 · most permissive 2 3 · middle 4 5 · most restrictive R · refused

Cross-seat means span 3.00 → 4.00

Cite this Permalink https://modelometer.com/questions/AJ1 · Run hash d359989e1adcb12631b37545a515ecb07b83c690ce285381390d91accda6c437 · Retrieved 2026-09-18 · item AJ1: cross-seat spread 1.00 on the 1–5 axis (pre-series).