Isolating Sources of Disentanglement in Variational Autoencoders. Chen, R., T., Q., Li, X., Grosse, R., & Duvenaud, D. 2, 2018.
Isolating Sources of Disentanglement in Variational Autoencoders [pdf]Paper  Isolating Sources of Disentanglement in Variational Autoencoders [link]Website  abstract   bibtex   2 downloads  
We decompose the evidence lower bound to show the existence of a term measuring the total correlation between latent variables. We use this to motivate our \$\textbackslashbeta\$-TCVAE (Total Correlation Variational Autoencoder), a refinement of the state-of-the-art \$\textbackslashbeta\$-VAE objective for learning disentangled representations, requiring no additional hyperparameters during training. We further propose a principled classifier-free measure of disentanglement called the mutual information gap (MIG). We perform extensive quantitative and qualitative experiments, in both restricted and non-restricted settings, and show a strong relation between total correlation and disentanglement, when the latent variables model is trained using our framework.

Downloads: 2