SparseSurf: Sparse-View 3D Gaussian Splatting for Surface Reconstruction

1Beihang University, 2Macquarie University, 3Southwest Jiaotong University
AAAI 2026

Comparison of sparse-view novel-view synthesis and surface reconstruction on DTU and Mip-NeRF360. Our SparseSurf achieves the best performance on both surface reconstruction and rendering in sparse-view setting.

Abstract

Recent advances in optimizing Gaussian Splatting for scene geometry have enabled efficient reconstruction of detailed surfaces from images. However, when input views are sparse, such optimization is prone to overfitting, leading to suboptimal reconstruction quality. Existing approaches address this challenge by employing flattened Gaussian primitives to better fit surface geometry, combined with depth regularization to alleviate geometric ambiguities under limited viewpoints. Nevertheless, the increased anisotropy inherent in flattened Gaussians exacerbates overfitting in sparse-view scenarios, hindering accurate surface fitting and degrading novel view synthesis performance. In this paper, we propose SparseSurf, a method that reconstructs more accurate and detailed surfaces while preserving high-quality novel view rendering. Our key insight is to introduce Stereo Geometry-Texture Alignment, which bridges rendering quality and geometry estimation, thereby jointly enhancing both surface reconstruction and view synthesis. In addition, we present a Pseudo-Feature Enhanced Geometry Consistency that enforces multi-view geometric consistency by incorporating both training and unseen views, effectively mitigating overfitting caused by sparse supervision. Extensive experiments on the DTU, BlendedMVS, and Mip-NeRF360 datasets demonstrate that our method achieves the state-of-the-art performance.

Video

Method

Overview of our framework. (a) Stereo Geometry-Texture Alignment. We estimate and update stereo-view images to generate binocular priors for geometry supervision. (b) Pseudo-Feature Enhanced Geometry Consistency. To mitigate overfitting and enhance multi-view consistency, we introduce Pseudo-view Feature Consistency and Train-view Feature Alignment.

Reconstruction on DTU with 3 views

Comparisons

More Accurate and Detailed Surface Reconstruction with Sparse Views

High-Quality Novel View Rendering with 3 Views on DTU

High-Quality Novel View Rendering with 24 Views on Mip-NeRF360