variable camera viewpoints

[likojack]

Dear authors,

congrats on the excellent work! I noticed that the camera viewpoints are fixed for all instances. I wonder if you have tried to use variable camera viewpoints instead. Much appreciated if you could shed some light on this topic.

[liuyuan-pal]

Hi, I do not try this because this requires rendering images of arbitrary viewpoints. If random viewpoints are used, the construction of the 3D feature volume should be invariant to the order of the input camera viewpoints. This could be achieved by taking the mean and variance of features from different views. However, I'm not sure this could work well with the VAE of SD or not.