How to Stop a Model Picking the Wrong Fact From a Long Prompt

A model reading a long prompt favors the passage that best matches your question, true or not. Long prompts hurt mostly because they carry more look-alikes, so keep those out and ask questions only the right passage answers.

Read Original

Related