Skip to content

Opening book details…

Can I read S2-Net: Self-supervision Guided Feature Representation Learning for Cross-Modality Images on EtoBox?

S2-Net: Self-supervision Guided Feature Representation Learning for Cross-Modality Images by Mei, Shasha is a scholarly article available to read on EtoBox.

What is S2-Net: Self-supervision Guided Feature Representation Learning for Cross-Modality Images about?

Combining the respective advantages of cross-modality images can compensate for the lack of information in the single modality, which has attracted increasing attention of researchers into multi-modal image matching tasks. Meanwhile, due to the great appearance differences between cross-modality image pairs, it often fails to make the feature representations of correspondences as close as possible. In this letter, we design a cross-modality feature representation learning network, S2-Net, which is based on the recently successful detect-and-describe pipeline, originally proposed for visible images but adapted to work with cross-modality image pairs. To solve the consequent problem of optimization difficulties, we introduce self-supervised learning with a well-designed loss function to guide the training without discarding the original advantages. This novel strategy simulates image pairs in the same modality, which is also a useful guide for the training of cross-modality images. Notably, it does not require additional data but significantly improves the performance and is even workable for all methods of the detect-and-describe pipeline. Extensive experiments are conducted to eval

Author
Mei, Shasha
Published
2022
Language
EN

More by Mei, Shasha

Browse all works by Mei, Shasha