Generative Multiplane Images: Making a 2D GAN 3D-Aware

What is really needed to make an existing 2D GAN 3D-aware? To answer this question, we modify a classical GAN, i.e., StyleGANv2, as little as possible. We find that only two modifications are absolutely necessary: 1) a multiplane image style generator branch which produces a set of alpha maps conditioned on their depth; 2) a pose-conditioned discriminator.

Github: https://github.com/apple/ml-gmpi

Paper: https://arxiv.org/abs/2207.10642v1

Dataset: https://paperswithcode.com/dataset/metfaces

Project: https://xiaoming-zhao.github.io/projects/gmpi/

Pretrained checkpoints: https://drive.google.com/drive/folders/1MEIjen0XOIW-kxEMfBUONnKYrkRATSR_

👉 @bigdata_1