Skip to content

DC4GS: Directional Consistency-Driven Adaptive Density Control for 3D Gaussian Splatting

Conference: NeurIPS 2025 arXiv: 2510.26921 Code: Available (Project Page) Area: 3D Vision / Neural Rendering Keywords: 3D Gaussian Splatting, Adaptive Density Control, Directional Consistency, Primitive Splitting, Scene Reconstruction

TL;DR

This paper proposes DC4GS, an adaptive density control method based on Directional Consistency (DC), which improves primitive splitting decisions and split position selection in 3DGS by exploiting the angular coherence of positional gradients. DC4GS reduces the number of primitives by up to 30% while improving reconstruction quality.

Background & Motivation

3D Gaussian Splatting (3DGS) achieves efficient real-time novel view synthesis via a set of 3D Gaussian primitives. A core component is Adaptive Density Control (ADC), which performs splitting, cloning, and pruning of primitives during training to accommodate complex scene structures.

Key limitations of existing ADC:

Reliance solely on gradient magnitude: Conventional ADC determines whether to split based on the magnitude of positional gradients. However, large gradient magnitude does not always imply a need for splitting — it may simply indicate that consistently directed gradients are pushing the primitive to translate, rather than requiring additional primitives.

Random split positions: When splitting is triggered, child primitives are placed by randomly offsetting along the principal axis of the parent primitive's covariance, causing poor alignment with local structure.

Redundant splitting: Excessive splitting inflates the primitive count, increasing memory and rendering overhead.

The root cause of these issues is that gradient magnitude reflects only "how much change is needed," without capturing "whether the direction of change is consistent."

Method

Overall Architecture

DC4GS introduces a Directional Consistency (DC) metric into two critical steps of ADC:

  1. Split decision: Jointly uses gradient magnitude and directional consistency to determine whether to split.
  2. Split position: Uses directional consistency information to determine the optimal placement of child primitives.

Key Designs

1. Directional Consistency Metric

For each Gaussian primitive, positional gradients are accumulated during training. Directional consistency is measured via the angular coherence of these gradients:

\[DC = \frac{\|\sum_{i=1}^{N} \mathbf{g}_i\|}{\sum_{i=1}^{N} \|\mathbf{g}_i\|}\]

where \(\mathbf{g}_i\) is the positional gradient at training step \(i\). DC ranges in \([0, 1]\): - DC ≈ 1: Gradient directions are highly consistent; the primitive should translate rather than split. - DC ≈ 0: Gradient directions are scattered, indicating complex local structure that warrants splitting to increase representational capacity.

2. DC-Based Split Decision

Conventional ADC split condition: \(\|\bar{\mathbf{g}}\| > \tau\) (average gradient magnitude exceeds threshold)

DC4GS split condition: \(\|\bar{\mathbf{g}}\| > \tau\) and \(DC < \tau_{DC}\)

Splitting is performed only when gradient magnitude is large and directions are inconsistent. If gradient directions are highly consistent (high DC), only translation or cloning is applied even when magnitude is large, avoiding redundant splitting.

3. DC-Based Optimal Split Position

When splitting is required, DC4GS replaces random child placement with gradient-direction-informed positioning:

  • The directional distribution of accumulated gradients is analyzed to identify dominant gradient direction clusters.
  • Child primitives are placed at positions corresponding to these clusters.
  • This ensures child primitives are well-aligned with local structure from initialization, rather than being randomly offset.

This data-driven split positioning places child primitives in more favorable locations from the outset, reducing the number of subsequent optimization iterations required.

Loss & Training

DC4GS does not modify the base rendering and optimization losses of 3DGS (L1 + D-SSIM); only the ADC strategy is changed: - The DC value of each primitive is computed at every densification step. - A DC threshold \(\tau_{DC}\) filters out primitives with consistent gradient directions (no splitting applied). - For primitives that require splitting, optimal child positions are computed based on gradient direction information.

The method integrates seamlessly into existing 3DGS training pipelines without requiring additional training stages.

Key Experimental Results

Main Results

Table 1: Quantitative comparison on Mip-NeRF 360 dataset

Method PSNR ↑ SSIM ↑ LPIPS ↓ #Primitives ↓
3DGS (baseline) 27.21 0.815 0.214 3.26M
Mini-Splatting 27.40 0.820 0.210 2.80M
AbsGS 27.35 0.818 0.212 3.10M
DC4GS (Ours) 27.58 0.823 0.205 2.28M

Using only approximately 70% of the primitives, DC4GS outperforms vanilla 3DGS and other density control methods on all rendering quality metrics.

Table 2: Tanks and Temples / Deep Blending datasets

Method PSNR ↑ SSIM ↑ LPIPS ↓ Primitive Reduction
3DGS 23.14 0.841 0.183
Compact-3DGS 23.25 0.843 0.180 ~15%
DC4GS (Ours) 23.52 0.849 0.173 ~30%

On large outdoor scenes such as Tanks and Temples, DC4GS achieves more pronounced primitive reduction (up to 30%) alongside improved rendering quality.

Ablation Study

Contribution analysis of DC split decision vs. split position

Configuration PSNR ↑ #Primitives ↓
Baseline (3DGS) 27.21 3.26M
+ DC split decision 27.38 2.65M
+ DC split position 27.33 3.10M
+ DC decision + position (DC4GS) 27.58 2.28M

Both components contribute independently: DC-based split decisions primarily reduce redundant primitives, while DC-based split positioning primarily improves reconstruction quality. Their combination yields the best overall performance.

Key Findings

  1. Gradient direction is more informative than magnitude: Conventional ADC relies solely on gradient magnitude; DC4GS demonstrates that directional consistency is a more critical signal — high consistency implies the primitive should translate rather than split.
  2. Significant primitive reduction: Primitives are reduced by up to 30% while maintaining or improving rendering quality, directly lowering storage and inference overhead.
  3. Plug-and-play: DC4GS can directly replace the ADC component of 3DGS without modifying the network architecture or loss functions.
  4. Greater benefit on complex scenes: The discriminative power of the DC signal is more pronounced in outdoor scenes and scenes with rich geometric detail.

Highlights & Insights

  • Concise yet effective observation: The directional consistency of positional gradients — a simple statistic — encodes rich local structural information and constitutes a previously overlooked but highly valuable signal.
  • Reduction without quality loss: Unlike compression-based methods, DC4GS eliminates redundancy at the source through smarter splitting decisions, rather than post-training pruning.
  • Clear theoretical intuition: DC ≈ 1 indicates that gradients from multiple views agree on the optimization direction (the primitive should move); DC ≈ 0 indicates conflicting directions (the primitive should be split into multiple child primitives to fit different structures).
  • Generality: The directional consistency concept is applicable not only to 3DGS but can be extended to other representations requiring adaptive density control.

Limitations & Future Work

  1. Sensitivity to DC threshold: The choice of \(\tau_{DC}\) may vary across scenes; adaptive threshold selection strategies warrant further investigation.
  2. Compatibility with other acceleration methods: Whether DC4GS can be combined with distillation, quantization, and similar approaches remains to be verified.
  3. Dynamic scenes: The current method targets static scenes; extending ADC improvements to dynamic 3DGS is a valuable future direction.
  4. Extreme scene conditions: The reliability of the DC signal may degrade in regions that are extremely sparse or extremely dense.
  • 3DGS (Kerbl et al. 2023): The original 3D Gaussian Splatting framework.
  • Compact-3DGS: Reduces primitives via post-processing compression.
  • Mini-Splatting: A training strategy that constrains the primitive count.
  • AbsGS: An ADC improvement based on absolute gradient magnitudes.
  • NeRF series: An alternative paradigm using implicit representations.

Rating

Dimension Score (1–5)
Novelty 4 — Directional consistency-driven ADC offers a concise and effective new perspective
Technical Quality 4 — The method is clearly motivated and well-reasoned, with comprehensive experiments
Experimental Thoroughness 4 — Multi-dataset validation with ablation analysis
Writing Quality 4 — Motivation and methodology are clearly articulated
Impact 4 — Directly improves a core 3DGS component with high practical value