About this document
MMQA: Multi-Table QA Benchmark by Himanshu Singhal is a document available to read on EtoBox.
The document introduces the Multi-table and Multi-hop Question Answering (MMQA) dataset, designed to evaluate large language models (LLMs) on complex multi-table tasks that require reasoning across multiple tables. It presents a comprehensive evaluation framework that assesses various aspects of LLM capabilities, including Multi-Table Retrieval and Text-to-SQL Generation, revealing significant performance gaps compared to human capabilities. The proposed multi-table retrieval method achieves state-of-the-ar
- Author
- Himanshu Singhal
- Language
- EN