SA-ResGS: Self-Augmented Residual 3D Gaussian Splatting for Next Best View Selection

We propose Self-Augmented Residual 3D Gaussian Splat-ting, a novel framework for stabilizing uncertainty quantification andenhancing uncertainty-aware supervision in Next-Best-View selection foractive scene reconstruction. To efficiently estimate scene coverage, SA-ResGS generates geometry-consistent Self-Augmented point clouds (SA-Points) via triangulation between observed training views and rasterizedextrapolated views. To address the lack of learning signals in underrep-resented regions within sparse, wide-baseline settings, we introduce thefirst skip-connection-inspired residual learning strategy tailored for 3DGS.This mechanism amplifies gradient flow to weakly contributing, high-uncertainty Gaussians. Our contributions are threefold: (1) a physicallygrounded, diversified view selection strategy; (2) an uncertainty-awareresidual supervision scheme that improves gradient flow and learningstability; and (3) implicitly debiased uncertainty quantification resultingfrom constrained view selection and residual supervision. Experiments onNeRF Synthetic, Mip-NeRF 360, and challenging extended benchmarkfrom Deep Blending and Tanks and Temples demonstrate that SA-ResGSconsistently outperforms state-of-the-art competing methods in bothreconstruction quality and view selection robustness.