LoRA

2 stories

Every LoRA story collected by The AI Daily, 2 so far, newest first, refreshed hourly.

Researcher Without Institution Seeks arXiv Endorsement for VELM Paper

An independent researcher says he invented VELMs (validated expert language models), combining small pretrained models with hot-swappable LoRA expert modules and a validator toolchain, with a whitepaper posted online. Because arXiv and ResearchGate require endorsers or reviewers, he is asking on Reddit for published researchers to endorse the paper or join as co-author.

r/MachineLearning · 37 h ago

VELM arXiv ResearchGate

Study locates and removes LLM 'slop' style

A study identified a representation direction for assistant style (e.g., em dashes, 'not X but Y') in Qwen3-4B-Instruct, finding that SFT introduces rhetorical structures and DPO doubles the slop score through buzzwords and markdown. Fixed-vector subtraction or distillation into a LoRA cuts the slop score by 83%.

r/MachineLearning · 3 d ago

Qwen3-4B-Instruct OLMo 2 1B LoRA

That is everything