Nathan Lambert @natolambert

Probably great at defensive cyber too, but no one will post that and get clicks! [引用 @ValsAI]: We found DeepSeek V4.1 Flash 1017 beats GPT 6 Sol on our multi-step offensive cybersecurity task. Sol was tested via the Daybreak trusted access program. We have been building a cybersecurity benchmark based on simulated corporate networks. This is a valuable indicator for the cyber-risk a model poses if in the hands of a bad actor. We plan to make the full evaluation public in the coming weeks…

X33 h ago
Read original ↗