Can I read Parallelly Tempered Generative Adversarial Networks on EtoBox?

Parallelly Tempered Generative Adversarial Networks by Sohn, Jinwon; Song, Qifan is a scholarly article available to read on EtoBox.

What is Parallelly Tempered Generative Adversarial Networks about?

A generative adversarial network (GAN) has been a representative backbone model in generative artificial intelligence (AI) because of its powerful performance in capturing intricate data-generating processes. However, the GAN training is well-known for its notorious training instability, usually characterized by the occurrence of mode collapse. Through the lens of gradients' variance, this work particularly analyzes the training instability and inefficiency in the presence of mode collapse by linking it to multimodality in the target distribution. To ease the raised training issues from severe multimodality, we introduce a novel GAN training framework that leverages a series of tempered distributions produced via convex interpolation. With our newly developed GAN objective function, the generator can learn all the tempered distributions simultaneously, conceptually resonating with the parallel tempering in Statistics. Our simulation studies demonstrate the superiority of our approach over existing popular training strategies in both image and tabular data synthesis. We theoretically analyze that such significant improvement can arise from reducing the variance of gradient estimates

Author

Sohn, Jinwon; Song, Qifan

Published

2024

Language

EN