MILU: A Multi-task Indic Language Understanding Benchmark
Paper • 2411.02538 • Published • 2
Mohammed Safi Ur Rahman Khan
safikhan
AI & ML interests
None yet
Recent Activity
published a dataset 1 day ago
ai4bharat/MATH-500 published a dataset 1 day ago
ai4bharat/gsm8k authored a paper 10 days ago
MILU: A Multi-task Indic Language Understanding BenchmarkOrganizations
authored 5
papers 10 days ago
BhasaAnuvaad: A Speech Translation Dataset for 14 Indian Languages
Paper • 2411.04699 • Published
Pralekha: An Indic Document Alignment Evaluation Benchmark
Paper • 2411.19096 • Published
Can Vision-Language Models Evaluate Handwritten Math?
Paper • 2501.07244 • Published
FairI Tales: Evaluation of Fairness in Indian Contexts with a Focus on Bias and Stereotypes
Paper • 2506.23111 • Published
authored 3
papers 11 days ago
IndicIFEval: A Benchmark for Verifiable Instruction-Following Evaluation in 14 Indic Languages
Paper • 2602.22125 • Published
Seeing Isn't Believing: Uncovering Blind Spots in Evaluator Vision-Language Models
Paper • 2604.21523 • Published • 3
Preferences of a Voice-First Nation: Large-Scale Pairwise Evaluation and Preference Analysis for TTS in Indian Languages
Paper • 2604.21481 • Published • 3
submitted 2
papers to Daily Papers 16 days ago
authored 4
papers over 1 year ago
Airavata: Introducing Hindi Instruction-tuned LLM
Paper • 2401.15006 • Published • 4
IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languages
Paper • 2403.06350 • Published • 1
Finding Blind Spots in Evaluator LLMs with Interpretable Checklists
Paper • 2406.13439 • Published • 2
Cross-Lingual Auto Evaluation for Assessing Multilingual LLMs
Paper • 2410.13394 • Published • 1