Right Answer, Wrong Score: Uncovering the Inconsistencies of LLM Evaluation in Multiple-Choice Question Answering
Paper • 2503.14996 • Published • 3
Alessandro Scirè
alescire94
AI & ML interests
Text Summarization, Factuality, NLG Evaluation
Recent Activity
liked a model 7 days ago
principled-intelligence/gemma-4-E2B-it-text-only liked a model 7 days ago
principled-intelligence/gemma-4-E4B-it-text-only upvoted a collection 7 days ago
ScopeGuard-2601Organizations
authored a
paper 7 months ago
authored 5
papers over 1 year ago
Semantic Role Labeling Meets Definition Modeling: Using Natural Language to Describe Predicate-Argument Structures
Paper • 2212.01094 • Published • 2
Echoes from Alexandria: A Large Resource for Multilingual Book Summarization
Paper • 2306.04334 • Published • 2
Guardians of the Machine Translation Meta-Evaluation: Sentinel Metrics Fall In!
Paper • 2408.13831 • Published • 6
FENICE: Factuality Evaluation of summarization based on Natural language Inference and Claim Extraction
Paper • 2403.02270 • Published • 3
Truth or Mirage? Towards End-to-End Factuality Evaluation with LLM-OASIS
Paper • 2411.19655 • Published • 20