Opening book details…
Can I read UniMiSS: Universal Medical Self-supervised Learning via Breaking Dimensionality Barrier on EtoBox?
UniMiSS: Universal Medical Self-supervised Learning via Breaking Dimensionality Barrier by Yutong Xie; Jianpeng Zhang; Yong Xia; Qi Wu is a book available to read on EtoBox.
What is UniMiSS: Universal Medical Self-supervised Learning via Breaking Dimensionality Barrier about?
Self-supervised learning (SSL) opens up huge opportunities for medical image analysis that is well known for its lack of annotations. However, aggregating massive (unlabeled) 3D medical images like computerized tomography (CT) remains challenging due to its high imaging cost and privacy restrictions. In this paper, we advocate bringing a wealth of 2D images like chest X-rays as compensation for the lack of 3D data, aiming to build a universal medical self-supervised representation learning framework, called UniMiSS. The following problem is how to break the dimensionality barrier, i.e., making it possible to perform SSL with both 2D and 3D images? To achieve this, we design a pyramid U-like medical Transformer (MiT). It is composed of the switchable patch embedding (SPE) module and Transformers. The SPE module adaptively switches to either 2D or 3D patch embedding, depending on the input dimension. The embedded patches are converted into a sequence regardless of their original dimensions. The Transformers model the long-term dependencies in a sequence-to-sequence manner, thus enabling UniMiSS to learn representations from both 2D and 3D images. With the MiT as the backbone, we perf
- Author
- Yutong Xie; Jianpeng Zhang; Yong Xia; Qi Wu
- Publisher
- Springer International Publishing
- Published
- 2022
- Language
- EN
- ISBN
- 9788303119803
- Subjects
- Computer Science, Engineering, Stem
More by Yutong Xie; Jianpeng Zhang; Yong Xia; Qi Wu
Browse all works by Yutong Xie; Jianpeng Zhang; Yong Xia; Qi Wu
Similar books
- White Matter Tract Segmentation with Self-supervised Learning — Qi Lu; Yuxing Li; Chuyang Ye (2020)
- SAME: Deformable Image Registration Based on Self-supervised Anatomical Embeddings — Fengze Liu; Ke Yan; Adam P. Harrison; Dazhou Guo; Le Lu; Alan L. Yuille; Lingyun Huang; Guotong Xie; Jing Xiao; Xianghua Ye; Dakai Jin (2021)
- Supervised Deep Learning for Head Motion Correction in PET — Tianyi Zeng; Jiazhen Zhang; Enette Revilla; Eléonore V. Lieffrig; Xi Fang; Yihuan Lu; John A. Onofrey (2022)
- Overcoming Data Scarcity for Coronary Vessel Segmentation Through Self-supervised Pre-training — Marek Kraft; Dominik Pieczyński; Krzysztof ‘Kris’ Siemionow (2021)
- SPeCiaL: Self-supervised Pretraining for Continual Learning — Lucas Caccia; Joelle Pineau (2022)
- Supervised Learning — Kanishka Tyagi; Chinmay Rane; Michael Manry (2022)