Can I read BURExtract-Llama: An LLM for Clinical Concept Extraction in Breast Ultrasound Reports on EtoBox?

BURExtract-Llama: An LLM for Clinical Concept Extraction in Breast Ultrasound Reports by Chen, Yuxuan; Yang, Haoyan; Pan, Hengkai; Siddiqui, Fardeen; Verdone, Antonio; Zhang, Qingyang; Chopra, Sumit; Zhao, Chen; Shen, Yiqiu is a scholarly article available to read on EtoBox.

What is BURExtract-Llama: An LLM for Clinical Concept Extraction in Breast Ultrasound Reports about?

Breast ultrasound is essential for detecting and diagnosing abnormalities, with radiology reports summarizing key findings like lesion characteristics and malignancy assessments. Extracting this critical information is challenging due to the unstructured nature of these reports, with varied linguistic styles and inconsistent formatting. While proprietary LLMs like GPT-4 are effective, they are costly and raise privacy concerns when handling protected health information. This study presents a pipeline for developing an in-house LLM to extract clinical information from radiology reports. We first use GPT-4 to create a small labeled dataset, then fine-tune a Llama3-8B model on it. Evaluated on clinician-annotated reports, our model achieves an average F1 score of 84.6%, which is on par with GPT-4. Our findings demonstrate the feasibility of developing an in-house LLM that not only matches GPT-4's performance but also offers cost reductions and enhanced data privacy.

Author

Chen, Yuxuan; Yang, Haoyan; Pan, Hengkai; Siddiqui, Fardeen; Verdone, Antonio; Zhang, Qingyang; Chopra, Sumit; Zhao, Chen; Shen, Yiqiu

Published

2024

Language

EN