Open 3.9B chess dataset and Stockfish distillation
A researcher distilled Stockfish's value function into a ResNet/ViT model using 1 billion positions from the Gigafish dataset, and released a 3.9 billion-position dataset built from 37 months of Lichess games. The CNN learned faster early on than the ViT, but combining both gave the best results.