A pattern appeared in 0.3% of my training data and 36% of my model's output. Numbers that far apart never come from the weights. The cause was one example line in my own prompt, and two commands will tell you whether yours has the same problem.
0.3% In, 36% Out: Your Fine-Tuned Model Is Copying Your Prompt Examples