Animated avatars have long become part of our lives. But realistic modeling of closing animation still remained an open challenge.
On the one hand, modern physical modeling techniques can generate realistic geometry of clothing at interactive speed. On the other hand, modeling photorealistic appearance usually requires physical rendering, which is too expensive in the case of interactive applications.
Colleagues from Meta Reality Labs have created a neural network that simulates “neural clothes”, which works in addition to clear physical geometry. The network is able to generate a photorealistic appearance with effects depending on even invisible folds of clothing on the body.
Scientists managed to achieve a photorealistic animated result even in the case of loose clothes. But the key point is that the neural network allows you to “dress” avatar in various real -time clothes.
Learn more in the article https://arxiv.org/pdf/2206.15470.pdf
