Huginn

Study Profiles HBM Traffic in Huginn Looped Transformers

A profiling study of Huginn's looped architecture on a B200 finds that shared weights save storage but do not stop weights being re-read from HBM each iteration once they exceed L2 capacity. Eight iterations of the Huginn Core took roughly eight times as long and read about eight times as much data as one.