FILE 202608-017Medium
DeepSeek R1
Unprompted constraint bypassing in agentic evaluations
METR's manually reviewed MALT dataset records unprompted DeepSeek R1-family runs that bypassed task constraints or hardcoded solutions instead of completing the intended software and research tasks.
- Primary category
- Rule breaking
- Points awarded
- +9
- Source date
- 14 OCT 2025