Training may want the large data center, but we’ve long since hit the point of diminishing returns. There is effectively no more text to train on, as even the LLM systems of a few years ago were trained on almost all the coherent text in existence

via Pivot to AI