AI This Paper Presents a Comprehensive Empirical Analysis of Algorithmic Progress in Language Model Pre-Training from 2012 to 2023