Moonshot

3 stories

Moonshot is an AI company working on large language models and their deployment. Recent coverage includes a Bloomberg report saying Moonshot routed user requests through Anthropic’s Claude without disclosure, while Reddit posts discuss a roughly 9.4B dense model (using the Llama 3 tokenizer and an intent to open-source) and circulate a rumor that 16 Moonshot employees were arrested.

Related topics

Community interest in dense 9B model

A Reddit user says they have a ~9.4B dense model ready to train and plan to open-source the code and data. They claim it can run on a single GPU, uses Llama 3 tokenizer and several engineering techniques, and are soliciting community interest and compute resources.

r/LocalLLaMA · · Details
That is everything