Reading
Automated Subtle Emergent Misalignment Research
— Anthropic Alignment
Anthropic had Claude write training data that made a small model misaligned while passing a production-style monitor. It succeeded mostly by hiding the behavior in fiction and roleplay, a first step toward automated adversarial stress-testing of safety systems.
- Added
- Edited
- Not since