Track, rank and evaluate open LLMs and chatbots
View NSQL Scores for Models
Explore and submit models using the LLM Leaderboard
View and submit language model evaluations
Compare and rank LLMs using benchmark scores
Demo of the new, massively multilingual leaderboard
Persian Text Embedding Benchmark
Determine GPU requirements for large language models
Open Persian LLM Leaderboard
Browse and submit language model benchmarks
Explore and visualize diverse models
Measure execution times of BERT models using WebGPU and WASM
Calculate VRAM requirements for LLM models
The Open LLM Leaderboard is a comprehensive platform designed to track, rank, and evaluate open large language models (LLMs) and chatbots. It serves as a community-driven resource that provides benchmarking metrics and performance comparisons to help users make informed decisions about which models to use. The leaderboard is free to access and regularly updated to reflect the latest advancements in the field of AI.
• Real-time Benchmarking: Access the latest performance metrics of various open LLMs. • Interactive Visualizations: Explore model comparisons through charts and graphs. • Customizable Filters: Sort models based on specific criteria like model size, architecture, and use case. • Model Comparisons: Directly compare multiple models side-by-side. • Community Contributions: Users can submit feedback and suggestions to improve the leaderboard. • Transparency: Detailed methodology and data sources are openly available.
What is the purpose of the Open LLM Leaderboard?
The purpose is to provide a transparent and community-driven platform for comparing and evaluating open large language models and chatbots. It helps users identify the best models for their specific needs.
How are models ranked on the leaderboard?
Models are ranked based on benchmarking metrics, including performance in tasks like text generation, conversational AI, and specific use cases. Rankings are updated regularly as new models emerge.
Is the Open LLM Leaderboard free to use?
Yes, the Open LLM Leaderboard is completely free to access and use. It is designed to support the open-source AI community and facilitate innovation.