![image](https://private-user-images.githubusercontent.com/22694942/398258507-835f1e1b-73e6-405a-b7ad-096d5f5f567a.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkwOTQwNTIsIm5iZiI6MTczOTA5Mzc1MiwicGF0aCI6Ii8yMjY5NDk0Mi8zOTgyNTg1MDctODM1ZjFlMWItNzNlNi00MDVhLWI3YWQtMDk2ZDVmNWY1NjdhLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMDklMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjA5VDA5MzU1MlomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTAwNTRlM2I2MGJiOGFlN2VjNzJkNDJkNDU1ODQzMWQzNTI4OGRkYWNiNjkyNjIwMTRmNTRmYWUxZWRjY2ZhZjAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.gKJT4qHooS5DbDnmaVmnmflON-DQer2y0X6_S4_cGpM)
A community-driven repository of LLM data and benchmarks. Compare and explore language models through our interactive dashboard at llm-stats.com.
Open an issue here. Thank you!
Our repository contains detailed information on hundreds of LLMs:
- Model parameters, context window sizes, licensing details, capabilities, and more
- Provider pricing
- Performance metrics (throughput, latency)
- Standardized benchmark results
We welcome community contributions to keep our data accurate and up-to-date:
-
Update Model Data
- Browse
models/
andproviders/
directories - Submit a PR following our contribution guidelines
- Check
schemas/
for data formats
- Browse
Accuracy is our priority. To ensure reliable information:
- All benchmark data requires verifiable source links
- Community review process for all changes
- Multiple source citations encouraged
- Regular validation of submitted data
There's no guarantee that the data is 100% accurate, but we do our best to ensure it's as accurate as possible.
Built with 💙 by the AI community, for the AI community.
Star this repo if you find it useful!
Star this repo if you find it useful!