The A.I. Daily
Developer posts update on local Yandex 80B finetune
A developer on Reddit shared progress finetuning Yandex's AliceAI-80B-A3B base model. After the first SFT round the model showed chain-of-thought reasoning and conversation ability but was underfit from insufficient instruct data, so the alpha checkpoint won't be released. Next, roughly 5M more general instruct tokens will be added, training locally on three 32GB V100s.