Percy Liang @percyliang

The final stretch... [引用 @dlwh]: Marin's 535b is now >80% through pretraining! Here’s loss vs. our scaling-ladder forecasts. The sharp drop comes with the 4K→16K context switch, so we're kind of cheating the forecast. (This was planned.) We'll re-eval at 4k too. https://t.co/YPREnmluJY https://t.co/hU9lhL63yx