Can I read Egocentric Videoconferencing on EtoBox?

Egocentric Videoconferencing by Elgharib, Mohamed; Mendiratta, Mohit; Thies, Justus; Nießner, Matthias; Seidel, Hans-Peter; Tewari, Ayush; Golyanik, Vladislav; Theobalt, Christian is a scholarly article available to read on EtoBox.

What is Egocentric Videoconferencing about?

We introduce a method for egocentric videoconferencing that enables hands-free video calls, for instance by people wearing smart glasses or other mixed-reality devices. Videoconferencing portrays valuable non-verbal communication and face expression cues, but usually requires a front-facing camera. Using a frontal camera in a hands-free setting when a person is on the move is impractical. Even holding a mobile phone camera in the front of the face while sitting for a long duration is not convenient. To overcome these issues, we propose a low-cost wearable egocentric camera setup that can be integrated into smart glasses. Our goal is to mimic a classical video call, and therefore, we transform the egocentric perspective of this camera into a front facing video. To this end, we employ a conditional generative adversarial neural network that learns a transition from the highly distorted egocentric views to frontal views common in videoconferencing. Our approach learns to transfer expression details directly from the egocentric view without using a complex intermediate parametric expressions model, as it is used by related face reenactment methods. We successfully handle subtle express

Author

Elgharib, Mohamed; Mendiratta, Mohit; Thies, Justus; Nießner, Matthias; Seidel, Hans-Peter; Tewari, Ayush; Golyanik, Vladislav; Theobalt, Christian

Published

2021

Language

EN