Introduces the concept of **Capacity Density**, a metric to evaluate LLM quality across different scales. The paper identifies an empirical "Densing Law" where LLM capacity density doubles approximately every three months, suggesting exponential gains in efficiency.

Paper

arXiv: 2412.04315

scalingefficiencyresearch

Related