Embedding Leaderboard
Detect harms and risks with Granite Guardian 3.1 8B
Humanize AI-generated text to sound like it was written by a human
ModernBERT for reasoning and zero-shot classification
Explore and interact with HuggingFace LLM APIs using Swagger UI
Display and filter LLM benchmark results
Analyze text using tuned lens and visualize predictions
Generate Shark Tank India Analysis
Similarity
Detect if text was generated by GPT-2
Open LLM(CohereForAI/c4ai-command-r7b-12-2024) and RAG
Analyze text to identify entities and relationships
Search for similar AI-generated patent abstracts
The MTEB Leaderboard is a comprehensive platform designed for evaluating and comparing text embedding models. It enables users to select specific benchmarks and languages to assess the performance of various text embeddings. This tool is particularly useful for researchers and developers in the field of natural language processing (NLP) who need to understand how different models perform across diverse tasks and languages.
• Customizable Benchmarks: Choose from a wide range of evaluation benchmarks tailored to different NLP tasks.
• Multilingual Support: Evaluate embeddings across multiple languages, making it ideal for multilingual NLP studies.
• Model Comparison: Directly compare the performance of different embedding models on the same tasks.
• Automated Evaluation: Streamline the evaluation process with automated pipelines for selected benchmarks.
• Visualization Tools: Access detailed visualizations to better understand model performance and differences.
• Regular Updates: Stay current with the latest models and benchmarks through frequent updates.
1. What languages does MTEB Leaderboard support?
MTEB Leaderboard supports a wide range of languages, including English, Spanish, French, German, Chinese, and many others. The exact list of supported languages can be found on the platform.
2. How do I update my model on the leaderboard?
To update your model on the leaderboard, re-run the evaluation with the new model version and submit the results through the platform's interface.
3. Can I create custom benchmarks?
Currently, MTEB Leaderboard offers pre-defined benchmarks, but there are plans to introduce custom benchmark creation in future updates. For now, you can select from the available benchmarks that best fit your needs.