Original link: Researchers warn of ‘catastrophic overtraining’ in LLMs / VentureBeat.
Now it is backed by science - more data does not guarantee better LLM's.
Direct link to the paper.