|
|
--- |
|
|
title: BhashaBench Leaderboard |
|
|
emoji: 🏆 |
|
|
colorFrom: blue |
|
|
colorTo: red |
|
|
sdk: docker |
|
|
hf_oauth: true |
|
|
pinned: true |
|
|
license: apache-2.0 |
|
|
duplicated_from: open-llm-leaderboard/open_llm_leaderboard |
|
|
short_description: Evaluating LLMs on BhashaBench tasks |
|
|
tags: |
|
|
- leaderboard |
|
|
- modality:text |
|
|
- submission:manual |
|
|
- test:public |
|
|
- judge:function |
|
|
- eval:generation |
|
|
- language:English, Hindi |
|
|
- domain:Ayur, Krishi, Finance, Legal |
|
|
--- |
|
|
https://arxiv.org/abs/2510.25409 |
|
|
|
|
|
# Open LLM Leaderboard |
|
|
|
|
|
Modern React interface for comparing Large Language Models (LLMs) in an open and reproducible way. |
|
|
|
|
|
## Features |
|
|
|
|
|
- 📊 Interactive table with advanced sorting and filtering |
|
|
- 🔍 Semantic model search |
|
|
- 📌 Pin models for comparison |
|
|
- 📱 Responsive and modern interface |
|
|
- 🎨 Dark/Light mode |
|
|
- ⚡️ Optimized performance with virtualization |
|
|
|
|
|
## Architecture |
|
|
|
|
|
The project is split into two main parts: |
|
|
|
|
|
### Frontend (React) |
|
|
|
|
|
``` |
|
|
frontend/ |
|
|
├── src/ |
|
|
│ ├── components/ # Reusable UI components |
|
|
│ ├── pages/ # Application pages |
|
|
│ ├── hooks/ # Custom React hooks |
|
|
│ ├── context/ # React contexts |
|
|
│ └── constants/ # Constants and configurations |
|
|
├── public/ # Static assets |
|
|
└── server.js # Express server for production |
|
|
``` |
|
|
|
|
|
### Backend (FastAPI) |
|
|
|
|
|
``` |
|
|
backend/ |
|
|
├── app/ |
|
|
│ ├── api/ # API router and endpoints |
|
|
│ │ └── endpoints/ # Specific API endpoints |
|
|
│ ├── core/ # Core functionality |
|
|
│ ├── config/ # Configuration |
|
|
│ └── services/ # Business logic services |
|
|
│ ├── leaderboard.py |
|
|
│ ├── models.py |
|
|
│ ├── votes.py |
|
|
│ └── hf_service.py |
|
|
└── utils/ # Utility functions |
|
|
``` |
|
|
|
|
|
## Technologies |
|
|
|
|
|
### Frontend |
|
|
|
|
|
- React |
|
|
- Material-UI |
|
|
- TanStack Table & Virtual |
|
|
- Express.js |
|
|
|
|
|
### Backend |
|
|
|
|
|
- FastAPI |
|
|
- Hugging Face API |
|
|
- Docker |
|
|
|
|
|
## Development |
|
|
|
|
|
The application is containerized using Docker and can be run using: |
|
|
|
|
|
```bash |
|
|
docker-compose up |
|
|
``` |
|
|
|
|
|
## Citation |
|
|
|
|
|
Please cite our benchmark if used in your work: |
|
|
|
|
|
```bibtex |
|
|
@misc{devane2025bhashabenchv1comprehensivebenchmark, |
|
|
title={BhashaBench V1: A Comprehensive Benchmark for the Quadrant of Indic Domains}, |
|
|
author={Vijay Devane and Mohd Nauman and Bhargav Patel and Aniket Mahendra Wakchoure and Yogeshkumar Sant and Shyam Pawar and Viraj Thakur and Ananya Godse and Sunil Patra and Neha Maurya and Suraj Racha and Nitish Kamal Singh and Ajay Nagpal and Piyush Sawarkar and Kundeshwar Vijayrao Pundalik and Rohit Saluja and Ganesh Ramakrishnan}, |
|
|
year={2025}, |
|
|
eprint={2510.25409}, |
|
|
archivePrefix={arXiv}, |
|
|
primaryClass={cs.CL}, |
|
|
url={https://arxiv.org/abs/2510.25409}, |
|
|
} |
|
|
``` |
