๐ง 3D Vision¶
๐ง NeurIPS2026 ยท 10 paper notes
๐ฅ Top topics: Few-/Zero-Shot Learning ร2
- Articraft: An Agentic System for Scalable Articulated 3D Asset Generation
-
Articraft reframes articulated 3D asset generation into an agentic code-authoring and test-driven repair loop over a dedicated domain-specific SDK, bypassing heavy rendering-based visual inspection to scalably synthesize physics-ready articulated assets, producing Articraft-10K across 245 categories.
- BrickAnything: Geometry-Conditioned Buildable Brick Generation with Structure-Aware Tokenization
-
BrickAnything presents an autoregressive brick generation framework conditioned on 3D point clouds, which reframes global coordinate prediction into local attachment prediction via structure-aware tree tokenization, and integrates dual-objective Direct Preference Optimization (DPO) with parent-aware validity-constrained decoding to produce geometrically faithful and physically stable brick assemblies.
- CM-EVS: Sparse Panoramic RGB-D-Pose Data for Complete Scene Coverage
-
Addressing the severe viewpoint redundancy, depth inconsistency, and unreproducible sampling policies in panoramic 3D visual learning, this paper proposes COVER, a training-free conflict-aware ERP viewpoint curator, and CM-EVS, a panoramic RGB-D-pose dataset that achieves compact, provenance-tracked indoor scene coverage with a median of only ~25 frames under guaranteed submodular approximation bounds.
- Direct Conditional Parameterization for N-Dimensional Splatting
-
Addressing the per-primitive matrix inversion and Schur complement bottleneck in N-dimensional splatting, this work introduces direct conditional parameterization that decouples opacity precision and spatial regression with scale priors, speeding up production slicing by ~7x while ensuring rigorous bijection with joint Gaussian covariances.
- GReFEM: Multimodal LLMs as Zero-Shot Semantic Assistants for Physics-Guided 3D Mesh Refinement
-
GReFEM introduces a zero-shot framework combining multimodal LLMs with physics-guided prompting, trained orthographic view selection, and 2D-to-3D ray projection to steer adaptive 3D volumetric finite element meshing without requiring PDE solves or offline simulation data.
- Less Decoder is More Encoder: Geometric Representation Learning from Novel View Synthesis
-
SNAP identifies that poor geometric representation in novel view synthesis stems from overly expressive decoders and low-level RGB targets, and proposes a pose-conditioned local decoder bottlenecked to a single patch alongside latent feature supervision to learn transferable 3D spatial representations without dense 3D annotations.
- Point Cloud Sequence Encoding for Material-conditioned Graph Network Simulators
-
This paper proposes PEACH, an in-context learning framework that uses a novel 4D spatio-temporal point cloud sequence encoder to extract compact material representations from raw point cloud observations, conditioning a mesh-based graph network simulator to predict full deformable dynamics for unseen materials without any test-time optimization, while demonstrating zero-shot sim-to-real transfer.
- RayTun3R: Online Camera Adaptation in 3D Foundation Models
-
Addressing the severe performance degradation of pretrained 3D foundation models under non-pinhole fisheye optics, RayTun3R reveals an intrinsic pinhole bias in the Jacobian of positional encodings and introduces an ultra-lightweight online camera adapter (~10K parameters) modifying only polar coordinate residuals alongside zero-cost geometric rectifications while keeping the backbone completely frozen.
- TrackFish3D: Self-Supervised 3D Tracking of Schooling Fish from Multi-view Videos
-
TrackFish3D addresses dense multi-camera 3D multi-object tracking of schooling fish with identical appearances and zero annotations by turning calibrated multi-view geometry into self-supervision, achieving 95.8%โ96.6% MOTA on SynFish and 81.1% on real zebrafish without any identity supervision or visual appearance backbones.
- UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image
-
UnfoldArt resolves articulation ambiguity through hierarchical global-local multi-agent debate and recovers occluded interior geometry by pairing motion-conditioned video generation with 3D latent inpainting, generating interactable articulated URDF assets zero-shot from a single image or text.