Ex-OpenAI researcher bets $100 billion will flow into training data because scaling alone won't cut it

https://the-decoder.com/wp-content/uploads/2025/08/synthetic_data_illustration-2.png" style="height: auto; margin-bottom: 10px;" width="1536" />

Former OpenAI employee Andrew Ho and Cambridge researcher Adam Hunt see a growing problem with large language models.

Instead of becoming more versatile, the models are becoming more specialized, excelling at coding and math while stagnating or even regressing in other areas.

Ho is leaving OpenAI to start a company focused on specialized training data and predicts that AI labs will need to spend more than $100 billion on targeted data collection.

The article https://the-decoder.com/ex-openai-researcher-bets-100-billion-will-flow-into-training-data-because-scaling-alone-wont-cut-it/">Ex-OpenAI researcher bets $100 billion will flow into training data because scaling alone won't cut it appeared first on https://the-decoder.com">The Decoder.