Llama 3

Community interest in dense 9B model

A Reddit user says they have a ~9.4B dense model ready to train and plan to open-source the code and data. They claim it can run on a single GPU, uses Llama 3 tokenizer and several engineering techniques, and are soliciting community interest and compute resources.