Issue 2026-11-09 · Industry · 研究 · 开源

LoRA-Conditioned Model Skips First Output Line with Short Captions

A LoRA fine-tuned Qwen3-0.6B model for generating LEGO model text skips the first root line when conditioned on short captions (~4 tokens), breaking the grammar. The researcher ruled out saving/decoding and tokenization mismatches, and found prompt expansion fixes it, but seeks the root cause.

r/MachineLearning13 d ago
Read original ↗