Skip to content

๐ŸงŠ 3D Vision

๐Ÿง  NeurIPS2026 ยท 10 paper notes

๐Ÿ”ฅ Top topics: Few-/Zero-Shot Learning ร—2

Articraft: An Agentic System for Scalable Articulated 3D Asset Generation

Articraft reframes articulated 3D asset generation into an agentic code-authoring and test-driven repair loop over a dedicated domain-specific SDK, bypassing heavy rendering-based visual inspection to scalably synthesize physics-ready articulated assets, producing Articraft-10K across 245 categories.

BrickAnything: Geometry-Conditioned Buildable Brick Generation with Structure-Aware Tokenization

BrickAnything presents an autoregressive brick generation framework conditioned on 3D point clouds, which reframes global coordinate prediction into local attachment prediction via structure-aware tree tokenization, and integrates dual-objective Direct Preference Optimization (DPO) with parent-aware validity-constrained decoding to produce geometrically faithful and physically stable brick assemblies.

CM-EVS: Sparse Panoramic RGB-D-Pose Data for Complete Scene Coverage

Addressing the severe viewpoint redundancy, depth inconsistency, and unreproducible sampling policies in panoramic 3D visual learning, this paper proposes COVER, a training-free conflict-aware ERP viewpoint curator, and CM-EVS, a panoramic RGB-D-pose dataset that achieves compact, provenance-tracked indoor scene coverage with a median of only ~25 frames under guaranteed submodular approximation bounds.

Direct Conditional Parameterization for N-Dimensional Splatting

Addressing the per-primitive matrix inversion and Schur complement bottleneck in N-dimensional splatting, this work introduces direct conditional parameterization that decouples opacity precision and spatial regression with scale priors, speeding up production slicing by ~7x while ensuring rigorous bijection with joint Gaussian covariances.

GReFEM: Multimodal LLMs as Zero-Shot Semantic Assistants for Physics-Guided 3D Mesh Refinement

GReFEM introduces a zero-shot framework combining multimodal LLMs with physics-guided prompting, trained orthographic view selection, and 2D-to-3D ray projection to steer adaptive 3D volumetric finite element meshing without requiring PDE solves or offline simulation data.

Less Decoder is More Encoder: Geometric Representation Learning from Novel View Synthesis

SNAP identifies that poor geometric representation in novel view synthesis stems from overly expressive decoders and low-level RGB targets, and proposes a pose-conditioned local decoder bottlenecked to a single patch alongside latent feature supervision to learn transferable 3D spatial representations without dense 3D annotations.

Point Cloud Sequence Encoding for Material-conditioned Graph Network Simulators

This paper proposes PEACH, an in-context learning framework that uses a novel 4D spatio-temporal point cloud sequence encoder to extract compact material representations from raw point cloud observations, conditioning a mesh-based graph network simulator to predict full deformable dynamics for unseen materials without any test-time optimization, while demonstrating zero-shot sim-to-real transfer.

RayTun3R: Online Camera Adaptation in 3D Foundation Models

Addressing the severe performance degradation of pretrained 3D foundation models under non-pinhole fisheye optics, RayTun3R reveals an intrinsic pinhole bias in the Jacobian of positional encodings and introduces an ultra-lightweight online camera adapter (~10K parameters) modifying only polar coordinate residuals alongside zero-cost geometric rectifications while keeping the backbone completely frozen.

TrackFish3D: Self-Supervised 3D Tracking of Schooling Fish from Multi-view Videos

TrackFish3D addresses dense multi-camera 3D multi-object tracking of schooling fish with identical appearances and zero annotations by turning calibrated multi-view geometry into self-supervision, achieving 95.8%โ€“96.6% MOTA on SynFish and 81.1% on real zebrafish without any identity supervision or visual appearance backbones.

UnfoldArt: Zero-Shot Recovery of Full Articulated 3D Objects from Text or Image

UnfoldArt resolves articulation ambiguity through hierarchical global-local multi-agent debate and recovers occluded interior geometry by pairing motion-conditioned video generation with 3D latent inpainting, generating interactable articulated URDF assets zero-shot from a single image or text.