Can I read Representation Learning via Adversarially-Contrastive Optimal Transport on EtoBox?

Representation Learning via Adversarially-Contrastive Optimal Transport by Cherian, Anoop; Aeron, Shuchin is a scholarly article available to read on EtoBox.

What is Representation Learning via Adversarially-Contrastive Optimal Transport about?

In this paper, we study the problem of learning compact (low-dimensional) representations for sequential data that captures its implicit spatio-temporal cues. To maximize extraction of such informative cues from the data, we set the problem within the context of contrastive representation learning and to that end propose a novel objective via optimal transport. Specifically, our formulation seeks a low-dimensional subspace representation of the data that jointly (i) maximizes the distance of the data (embedded in this subspace) from an adversarial data distribution under the optimal transport, a.k.a. the Wasserstein distance, (ii) captures the temporal order, and (iii) minimizes the data distortion. To generate the adversarial distribution, we propose a novel framework connecting Wasserstein GANs with a classifier, allowing a principled mechanism for producing good negative distributions for contrastive learning, which is currently a challenging problem. Our full objective is cast as a subspace learning problem on the Grassmann manifold and solved via Riemannian optimization. To empirically study our formulation, we provide experiments on the task of human action recognition in vid

Author

Cherian, Anoop; Aeron, Shuchin

Published

2020

Language

EN