Display and submit LLM benchmarks
Launch web-based model application
Explore and benchmark visual document retrieval models
Display and filter leaderboard models
Evaluate adversarial robustness using generative models
Calculate GPU requirements for running LLMs
Calculate survival probability based on passenger details
View RL Benchmark Reports
Submit models for evaluation and view leaderboard
Track, rank and evaluate open LLMs and chatbots
Multilingual Text Embedding Model Pruner
Benchmark LLMs in accuracy and translation across languages
Measure over-refusal in LLMs using OR-Bench
The š Multilingual MMLU Benchmark Leaderboard is a platform designed to evaluate and compare the performance of large language models (LLMs) across multiple languages and tasks. It provides a centralized space for researchers and developers to submit, view, and analyze benchmarks of their models, fostering transparency and innovation in the field of multilingual natural language processing.
ā¢ Multilingual Support: Evaluate models across a wide range of languages, enabling a comprehensive understanding of their global capabilities.
ā¢ Customizable Benchmarks: Define and submit custom benchmarks tailored to specific languages, tasks, or use cases.
ā¢ Real-Time Leaderboard: Access up-to-date rankings of models based on their performance across various metrics.
ā¢ Detailed Analytics: Dive into in-depth analysis of model performance, including error distributions, cross-lingual capabilities, and more.
ā¢ Community-Driven: Engage with a community of researchers and practitioners, fostering collaboration and knowledge sharing.
ā¢ Visualization Tools: Utilize interactive charts and graphs to explore and compare model performance effectively.
What does MMLU stand for?
MMLU stands for Multilingual Model Leaders Universe, a benchmarking framework focused on evaluating the capabilities of multilingual models.
Can I submit my own model's benchmarks?
Yes, the platform allows developers to submit benchmarks for their models, provided they adhere to the submission guidelines and data format requirements.
Is the leaderboard updated in real-time?
The leaderboard is updated periodically to reflect the latest submissions and improvements in model performance. While not real-time, it is refreshed regularly to maintain accuracy.