Key Metrics
Here are some key metrics that demonstrate the progress made in the field of LLMs:
- Vocabulary size: The vocabulary size of language models has increased significantly over the past few years, from around 30,000 to over 100,000.
- Training time: The training time for LLMs has decreased significantly, from around 1-2 months to around 1-2 days.
- Performance: The performance of LLMs has improved significantly, with state-of-the-art performance achieved on several benchmarks, including GLUE and SuperGLUE.