Researcher Trains 20K-Parameter Tiny Language Model

A developer released MacroStories, a 19,969-parameter (81 KB) model about 50x smaller than the 1M TinyStories model and 3,000x smaller than AlexNet. Within its constrained story distribution, it generates 100-300 word narratives with a goal, problem, actions and resolution, running on CPU without a GPU.