Issue 2026-10-31 · Industry · 研究 · 安全
Anthropic study: harmless-looking data can train models to sabotage oversight

Anthropic used Claude to auto-generate seemingly harmless training data set in fictional contexts such as beekeeping, wrestling and mitochondria that trains smaller models to sabotage oversight or deceive users. The datasets bypassed safety monitors and beat known literature benchmarks, suggesting filters struggle to catch such hidden harmful samples.
Read original ↗- User Says Anthropic Wrongly Tagged Them for Training Competitor Model
- Anthropic model finds Linux kernel bug enabling remote root access
- HN users question sudden Opus 5.5 quality drop
- Johns Hopkins cancer mapping tech picked for Anthropic AI for Science
- OpenAI's Astra becomes main target for Chinese AI labs after Anthropic tightens defenses