Can I read Bring Remote Sensing Object Detect Into Nature Language Model: Using SFT Method on EtoBox?

Bring Remote Sensing Object Detect Into Nature Language Model: Using SFT Method by Wang, Fei; Chen, Chengcheng; Chen, Hongyu; Chang, Yugang; Zeng, Weiming is a scholarly article available to read on EtoBox.

What is Bring Remote Sensing Object Detect Into Nature Language Model: Using SFT Method about?

Recently, large language models (LLMs) and vision-language models (VLMs) have achieved significant success, demonstrating remarkable capabilities in understanding various images and videos, particularly in classification and detection tasks. However, due to the substantial differences between remote sensing images and conventional optical images, these models face considerable challenges in comprehension, especially in detection tasks. Directly prompting VLMs with detection instructions often leads to unsatisfactory results. To address this issue, this letter explores the application of VLMs for object detection in remote sensing images. Specifically, we constructed supervised fine-tuning (SFT) datasets using publicly available remote sensing object detection datasets, including SSDD, HRSID, and NWPU-VHR-10. In these new datasets, we converted annotation information into JSON-compliant natural language descriptions, facilitating more effective understanding and training for the VLM. We then evaluate the detection performance of various fine-tuning strategies for VLMs and derive optimized model weights for object detection in remote sensing images. Finally, we evaluate the model's p

Author

Wang, Fei; Chen, Chengcheng; Chen, Hongyu; Chang, Yugang; Zeng, Weiming

Published

2025

Language

EN