AI Models Waste Context by Copying Input, Researchers Find Fix

1Key Takeaways

• New training method teaches language models to focus on relevant evidence rather than mindlessly reproducing source material.
• Researchers have identified a fundamental flaw in how large language models handle extended text: they waste computational resources by reproducing input verbatim instead of reasoning through problems.
• This behavior, which intensifies as documents grow longer, undermines the effectiveness of advanced AI systems designed to tackle complex tasks across massive datasets.….