Densing Law of LLMs
paperIntroduces the concept of **Capacity Density**, a metric to evaluate LLM quality across different scales. The paper identifies an empirical "Densing Law" where LLM capacity density doubles approximately every three months, suggesting exponential gains in efficiency.
Paper
arXiv: 2412.04315