Can I read Semi-supervised Learning of Perceptual Video Quality by Generating Consistent Pairwise Pseudo-Ranks on EtoBox?

Semi-supervised Learning of Perceptual Video Quality by Generating Consistent Pairwise Pseudo-Ranks by Mitra, Shankhanil; Jogani, Saiyam; Soundararajan, Rajiv is a scholarly article available to read on EtoBox.

What is Semi-supervised Learning of Perceptual Video Quality by Generating Consistent Pairwise Pseudo-Ranks about?

Designing learning-based no-reference (NR) video quality assessment (VQA) algorithms for camera-captured videos is cumbersome due to the requirement of a large number of human annotations of quality. In this work, we propose a semi-supervised learning (SSL) framework exploiting many unlabelled and very limited amounts of labelled authentically distorted videos. Our main contributions are two-fold. Leveraging the benefits of consistency regularization and pseudo-labelling, our SSL model generates pairwise pseudo-ranks for the unlabelled videos using a student-teacher model on strongweak augmented videos. We design the strong-weak augmentations to be quality invariant to use the unlabelled videos effectively in SSL. The generated pseudo-ranks are used along with the limited labels to train our SSL model. Our primary focus in SSL for NR VQA is to learn the mapping from video feature representations to the quality scores. We compare various feature extraction methods and show that our SSL framework can lead to improved performance on these features. In addition to the existing features, we present a spatial and temporal feature extraction method based on predicting spatial and temporal

Author

Mitra, Shankhanil; Jogani, Saiyam; Soundararajan, Rajiv

Published

2022

Language

EN