Bonsai LLM

PrismML brings tiny LLMs to Qualcomm smart glasses

PrismML showcased its 1-bit Bonsai LLM at Qualcomm's Snapdragon Summit. The 2-billion-parameter vision-language model runs locally on smart glasses powered by the Snapdragon AR1 Gen 1 Platform. It shrinks larger models 4x while retaining benchmark performance, advancing device-based open-weight AI. No smart glasses running it have been announced yet.