Can I read Livemedbench: A Contamination-Free Medical Benchmark For Llms With Automated Rubric Evaluation on EtoBox?
Livemedbench: A Contamination-Free Medical Benchmark For Llms With Automated Rubric Evaluation by Sanaz Ichsan Rizqi is a document available to read on EtoBox.
What is Livemedbench: A Contamination-Free Medical Benchmark For Llms With Automated Rubric Evaluation about?
LiveMedBench is a novel, contamination-free medical benchmark designed for evaluating Large Language Models (LLMs) in clinical settings, addressing issues of data contamination and temporal misalignment. It features a Multi-Agent Clinical Curation Framework that continuously updates real-world clinical cases and an Automated Rubric-based Evaluation Framework for objective assessment. The benchmark currently includes 2,756 cases across 38 medical specialties and has shown that even top-performing LLMs strugg
- Author
- Sanaz Ichsan Rizqi
- Language
- EN