We're entering the age of large-scale synthetic data

The internet’s finite learning signals are pushing AI toward dependence on synthetic data. OpenAI allocates 20-30% of its compute budget to data generation, collapsing data and compute into a single resource. Lambda is building infrastructure for large-scale synthetic data pipelines.