Part 1: Machine Learning 2024 – The Newest Developments in 3D Gaussian Splatting | Monodeep Mukherjee | May 2024

Advancements in 3D Neural Rendering: GS-LRM and SAGS Models Compared

Two groundbreaking new models have been introduced in the field of 3D rendering, promising to revolutionize the way we create and visualize digital scenes. The GS-LRM (Large Reconstruction Model) and SAGS (Structure-Aware 3D Gaussian Splatting) are the latest innovations from a group of talented researchers in the tech industry.

The GS-LRM model, developed by Kai Zhang, Sai Bi, Hao Tan, Yuanbo Xiangli, Nanxuan Zhao, Kalyan Sunkavalli, and Zexiang Xu, is a scalable reconstruction model that can predict high-quality 3D Gaussian primitives from just 2-4 sparse images. What sets GS-LRM apart is its ability to handle scenes with large variations in scale and complexity, making it a versatile tool for both object and scene captures. By training the model on Objaverse and RealEstate10K datasets, the researchers have shown that GS-LRM outperforms existing baselines by a significant margin.

On the other hand, the SAGS model, developed by Evangelos Ververas, Rolandos Alexandros Potamias, Jifei Song, Jiankang Deng, and Stefanos Zafeiriou, focuses on structure-aware 3D Gaussian splatting. By encoding the geometry of the scene, SAGS achieves state-of-the-art rendering performance and reduced storage requirements on benchmark datasets. The lightweight version of SAGS showcases a compact representation of the scene with up to 24 times size reduction, without the need for compression strategies.

Both models have been met with excitement and anticipation in the tech community, as they promise to push the boundaries of 3D rendering and open up new possibilities for creative expression. To learn more about these groundbreaking models, visit the project webpages for GS-LRM (https://sai-bi.github.io/project/gs-lrm/) and SAGS (https://eververas.github.io/SAGS/).

LEAVE A REPLY

Please enter your comment!
Please enter your name here