Nathan Lambert is an AI researcher and commentator focused on model capabilities, risks, and evaluation. Recently he said he would help as an independent evaluator while building a nonprofit, and he has commented on how AI labs engage scientific communities and on the role of distillation—its SFT roots and relevance in an era shaped by RL.
One of the coolest at-scale RL resources made public yet! You love to see it. [Quoting @_LuoFuli]: Nearly half a year of silence. We spent it studying one problem: how far RL can scale. MiMo-V2.6 is in the middle of its RL run right now. Three things we scal…
Open-source AI reading list posted on Hacker NewsA public-facing reading list on open models was posted on Hacker News, compiling key writings on why models are released, gradients of openness, business strategy, and risks, aimed at getting readers up to speed.
I would consider helping as an independent evaluator along with the non profit I’m building. Is going to be a crucial role and there aren’t many independent people with substantial technical expertise. I think I represent an important moderate camp on AI capa…
A great read. I have similar feelings about how AI labs approach progress directly and without nurturing of scientific communities & intuition. The math research community went through the transition the fastest, so it was felt most. Other fields next. h…
Big W for people saying that distillation was mostly an SFT artifact, and how its unclear how it would become increasingly influential in an era defined by RL. [Quoting @xeophon]: great that there is now more insights and transparency into where distillation…
The A.I. Daily