LoRA-Conditioned Model Skips First Output Line with Short Captions
A LoRA fine-tuned Qwen3-0.6B model for generating LEGO model text skips the first root line when conditioned on short captions (~4 tokens), breaking the grammar. The researcher ruled out saving/decoding and tokenization mismatches, and found prompt expansion fixes it, but seeks the root cause.