Daily Paper Cast
Daily Paper Cast
Jingwen Liang, Gengyu Wang
The Mask Is Not the Object: Volumetric Supervision for 3D Gaussian Segmentation
21 minutes Posted Nov 20, 2026 at 10:55 am.
0:00
21:19
Download MP3
Show notes

🤗 Upvotes: 25 | cs.CV, cs.AI

Authors:

Jeonghwan Cho, Minsu Kim, Junyoung Hong, Seon Joo Kim

Title:

The Mask Is Not the Object: Volumetric Supervision for 3D Gaussian Segmentation

Arxiv:

http://arxiv.org/abs/2611.21383v1

Abstract:

3D Gaussian Splatting enables object-level operations on Gaussian primitives, yet existing segmentation methods are largely trained and evaluated through rendered views. This mismatch can produce accurate rendered masks from incomplete 3D selections since alpha-blended feature supervision concentrates learning on dominant contributors while leaving occluded or low-contribution Gaussians weakly supervised. We propose VODA, a plug-and-play supervision objective that exploits local depth structure to group per-pixel contributors and directly supervises all Gaussians in selected depth clusters, bypassing contribution-weighted gradient delivery. To evaluate volumetric completeness, we introduce Removal-3D, a synthetic object-removal benchmark, and the Removal Depth Error (RDE), a metric comparing predicted and ground-truth depth changes. Across four rendering-based baselines, VODA consistently improves volumetric segmentation on Removal-3D while maintaining or improving performance on LERF and ScanNet. Further analysis shows that VODA recovers lower-contribution Gaussians, while simple gradient reweighting and spatial propagation fail to reproduce comparable gains.