Trends in the Dollar Training Cost of Machine Learning Systems – Epoch

I combine training compute and GPU price-performance data to estimate the cost of compute in US dollars for the final training run of 124 machine learning systems published between 2009 and 2022, and find that the cost has grown by approximately 0.5 orders of magnitude per year.

Epoch : An essential notion in real-time programming

Llama 2 Scaling Laws : r/LocalLLaMA

Machine Learning for Finance: Price Prediction with Linear

Report on Frontier Model Training — EA Forum

Trends in the Dollar Training Cost of Machine Learning Systems – Epoch

Trends in the Dollar Training Cost of Machine Learning Systems – Epoch

JRFM, Free Full-Text

Applied Sciences, Free Full-Text

AI Training Costs Continue to Plummet

Artificial Intelligence - Our World in Data