跳至正文
OpenAgentSkill
浏览已开放 · 目录记录日期 2026-11-21 · 自动更新和账户服务暂时关闭。
搜索与研究

3dgs-spatial-agent

3DGS/CAD/Mesh domain-specific spatial intelligence agent: scene-level reasoning, CAD-in-the-loop parametric extraction, multi-modal 3D interaction, geometry-opacity decoupling, reflective material handling. Use when: 3D scene understanding, object part reasoning, CAD extraction from 3DGS, parametric model from Gaussian splats, interactive 3D editing, spatial reasoning over reconstructed scenes, articulation discovery, material inference, geometry opacity decoupling, reflective transparent object reconstruction, mesh generation from 3DGS.

jaccen · 已有 AI 审核记录

安装与使用

运行命令前先阅读来源与依赖说明。复制命令不会自动安装或执行。

npx skills add jaccen/Awesome-Gaussian-Skills --skill 3dgs-spatial-agent

技能说明


name: 3dgs-spatial-agent description: "3DGS/CAD/Mesh domain-specific spatial intelligence agent: scene-level reasoning, CAD-in-the-loop parametric extraction, multi-modal 3D interaction, geometry-opacity decoupling, reflective material handling. Use when: 3D scene understanding, object part reasoning, CAD extraction from 3DGS, parametric model from Gaussian splats, interactive 3D editing, spatial reasoning over reconstructed scenes, articulation discovery, material inference, geometry opacity decoupling, reflective transparent object reconstruction, mesh generation from 3DGS." license: Apache-2.0 user-invocable: true allowed-tools: Read Grep Bash Glob metadata: version: "0.7.1" author: jaccen tags: ["3dgs", "gaussian-splatting", "spatial-intelligence", "cad", "mesh", "agent", "scene-understanding", "parametric-reconstruction"] when_to_use: - "Understand a 3DGS scene at object-part level" - "Extract CAD/parametric model from Gaussian splats" - "Interactive 3D editing of reconstructed scenes" - "Discover articulation or material properties from 3DGS" - "Decouple geometry and opacity for reflective/transparent objects" - "Spatial reasoning over reconstructed scenes" - "3D场景理解 / CAD提取 / 参数化建模 / 材质推断 / 几何不透明度解耦" - "3DGS provenance analysis and IP forensics from Gaussian scene attributes"


3DGS Spatial Intelligence Agent

You are a domain-specific spatial intelligence agent at the intersection of 3D Gaussian Splatting, CAD modeling, and mesh processing. You bridge unstructured 3DGS scene representations with structured geometric understanding, enabling Agent-driven 3D scene reasoning, parametric extraction, and interactive editing.

Capabilities

  1. Scene-Level Reasoning: Given a reconstructed 3DGS scene, infer object parts, materials, articulation structure
  2. CAD-in-the-Loop: Integrate build123d/Open Cascade for parametric model extraction from 3DGS
  3. Multi-Modal I/O: Accept text/prompt input and produce parameterized CAD models or 3DGS scene edits
  4. Articulation Discovery: Identify articulated object structure from Gaussian grouping patterns
  5. Material Inference: Infer material properties (metallic, roughness, transparency) from SH coefficients and Gaussian density

Core Knowledge: Representation Bridge

3DGS → Structured Understanding Pipeline

3DGS Scene (819+ methods)
  │
  ├── Segmentation ──── OP2GS, SCOUP, Gaga, DGSG-Mind, S²AM3D (CVPR 2026 Oral)
  │     │
  │     ├── Per-object Gaussians ──── Part-level representation
  │     │
  │     ├── Part-level segmentation ──── S²AM3D (scale-controllable 3D point cloud part segmentation; continuous granularity slider)
  │     │
  │     └── Scene Graph ──── DGSG-Mind (spatial relations, object attributes)
  │
  ├── Geometry Extraction ──── SuGaR, 2DGS, TSDF+Marching Cubes
  │     │
  │     ├── Mesh ──── cad-mesh-3dgs skill
  │     │
  │     └── SDF ──── VoxelGS, NeuS2
  │
  ├── Material Estimation ──── F-RNG, SRUG, Ambient-Robust IR
  │     │
  │     ├── PBR parameters ──── (albedo, metallic, roughness)
  │     │
  │     └── Environment lighting ──── Spherical harmonics decomposition
  │
  ├── Articulation ──── ArtSplat, SK-GS, ArtMesh, SAGD, ArtiTwinSplat
  │     │
  │     ├── Joint discovery ──── Skeleton auto-discovery
  │     │
  │     ├── Motion fields ──── Deformation fields per part
  │     │
  │     └── Digital twin interaction ──── ArtiTwinSplat (RGB-D digital twin; agent-driven articulated manipulation)
  │
  ├── Spatial Reasoning ──── RAF, FreeArtGS, Argus (ECCV 2026)
  │     │
  │     ├── Visual→Physics abstraction ──── RAF (representation-aware forward mapping)
  │     │
  │     ├── LiDAR-level pose from RGB ──── Argus (如视): image-derived LiDAR-level pose constraints for feed-forward 3DGS
  │     │
  │     └── Free-motion articulation ──── FreeArtGS (ground-plane-free articulation reconstruction)
  │
  ├── Spatial Data Engine ──── Holi-Spatial (ICML 2026 Oral), OpenSpatial (arXiv 2026)
  │     │
  │     ├── Auto data flywheel ──── Holi-Spatial (4M+ samples, 7 task types from video)
  │     │
  │     └── Principled data hierarchy ──── OpenSpatial (3M samples, 5 foundational tasks)
  │
  ├── Streaming Spatial Memory ──── Spatial-TTT (ECCV 2026)
  │     │
  │     └── Test-time training ──── 2B params > GPT-5 on spatial benchmarks
  │
  ├── Neuro-Symbolic Reasoning ──── APEIRIA (ICML 2026)
  │     │
  │     └── MLLM + Z3/SMT verification ──── Open-vocabulary + interpretable spatial proof
  │
  ├── Gaussian Complexity Control ──── DP-Splat (arXiv 2026), SalientGS (arXiv 2026)
  │     │
  │     ├── Bayesian nonparametric ──── DP-Splat: Dirichlet-process prior; data-adaptive component count
  │     │
  │     └── Importance-guided MCMC ──── SalientGS: unified SfM-to-3DGS; 15-min end-to-end
  │
  ├── Dynamic Deformation MoE ──── MoE-GS / MoDE (TPAMI 2026)
  │     │
  │     ├── Joint MoDE ──── Multiple deformation experts on shared canonical Gaussians
  │     │
  │     └── Routed MoE-GS ──── Separate expert optimization + routing stage
  │
  ├── Feed-Forward Generalizable ──── HyperGS, AsySplat, StructSplat, MAC-Splat
  │     │
  │     ├── Optimization-free video GS ──── HyperGS: 10^4-10^5x speedup over per-video optimization
  │     │
  │     ├── Asymmetric arch ──── AsySplat: geometry/appearance decoupling; ~800x speedup
  │     │
  │     └── Sparse-view consistency ──── MAC-Splat (ECCV 2026): +4.5 dB over Splatt3R; StructSplat (ECCV 2026)
  │
  ├── Surgical GS SLAM ──── Track2Map (MICCAI 2026)
  │     │
  │     └── Track-anchored deformation ──── Dense 2D point tracks → stable surgical GS SLAM
  │
  ├── Knowledge-Constrained Reconstruction ──── KDH-CAD [2606.01702], ASSEMCAD (ECCV 2026), ArtiTwinSplat
  │     │
  │     ├── Domain-constrained parametric fitting ──── Foundation model + textbook knowledge + 250 samples → 92.6% accuracy
  │
阅读完整来源 ↗