neural-reality-capture
Use this skill for provider-independent reality capture that turns photographed or video-derived real places, objects, aerial sites, interiors, or people into photogrammetric meshes, NeRFs, or 3D Gaussian splats. It guides representation choice, capture planning, calibration and scale, reconstruction or training, cleanup, compression and LOD, coordinate and interchange handoff, visual/geometric QA, archival records, and property, location, people, and cultural rights checks. Do not use it for text-to-3D generation, synthetic asset invention, guaranteed metrology, or broad downstream finishing after handoff.
calesthio · 已有 AI 审核记录
安装与使用
运行命令前先阅读来源与依赖说明。复制命令不会自动安装或执行。
npx skills add calesthio/generative-media-skills --skill neural-reality-capture技能说明
name: neural-reality-capture description: Use this skill for provider-independent reality capture that turns photographed or video-derived real places, objects, aerial sites, interiors, or people into photogrammetric meshes, NeRFs, or 3D Gaussian splats. It guides representation choice, capture planning, calibration and scale, reconstruction or training, cleanup, compression and LOD, coordinate and interchange handoff, visual/geometric QA, archival records, and property, location, people, and cultural rights checks. Do not use it for text-to-3D generation, synthetic asset invention, guaranteed metrology, or broad downstream finishing after handoff.
Neural Reality Capture
Neural reality capture is the production craft of reconstructing or rendering a real subject from many overlapping observations. In this skill, the deliverable is one of three families:
- a photogrammetric mesh with textures, usually for game, VFX, GIS, cultural heritage, ecommerce, or DCC handoff;
- a NeRF or related neural radiance field, usually for high-quality novel-view rendering from known camera poses;
- a 3D Gaussian splat scene, usually for real-time free-viewpoint playback with radiance-field appearance.
Stay provider-independent. Choose tools by evidence, constraints, and handoff needs, not by brand habit. Do not promise metrology unless the request includes surveyed control, calibrated capture, uncertainty reporting, and a qualified measurement workflow. Do not expand into text-to-3D, generative resculpting, animation rigging, material lookdev beyond captured handoff, or broad finishing work that belongs downstream.
Evidence Labels
Use these labels in plans, reviews, and troubleshooting:
- Paper fact: a claim from a peer-reviewed paper or original technical report, such as the original NeRF or 3D Gaussian Splatting papers.
- Standard fact: a claim from a specification or standard, such as Khronos glTF or OpenUSD documentation.
- Official documentation fact: a claim from tool, capture, or production documentation maintained by the relevant organization.
- Empirical observation: a result from a documented test or reconstruction run.
- Production heuristic: a practical rule that usually improves capture or handoff, but is not a guarantee.
When the user asks for a recommendation, combine fact and heuristic explicitly: "Standard fact: glTF 2.0 uses meters and a right-handed coordinate system. Production heuristic: deliver GLB for lightweight web review and USD for layered VFX or DCC assembly."
Representation Choice
Choose the representation from the final use, not from capture novelty.
Photogrammetric mesh
Use a mesh when the asset must be edited, decimated, baked, collision-tested, physically placed, measured with documented caveats, 3D printed, or delivered to engines and DCC tools as conventional geometry.
Strengths:
- explicit topology, UVs, textures, normals, and material channels;
- established interchange through OBJ, FBX, Alembic, glTF/GLB, and USD;
- compatible with cleanup, retopology, collision, LOD, baking, and engine import;
- can be scaled and georeferenced with markers, scale bars, GCPs, or surveyed control.
Risks:
- reflective, transparent, hair-like, thin, repetitive, or textureless surfaces reconstruct poorly;
- topology and UVs are often production-unfriendly until cleaned;
- baked textures can hide geometric defects;
- high accuracy requires controlled capture, calibration, control points, and QA, not only many photos.
NeRF
Use a NeRF when photorealistic novel-view rendering matters more than mesh editability, especially for bounded inward-facing captures, view-dependent appearance, transparency-like effects, and difficult glossy appearance that a quick mesh bake would mishandle.
Paper fact: the original NeRF paper, Representing Scenes as Neural Radiance Fields for View Synthesis (ECCV 2020), represents a scene with a continuous 5D function of spatial location and viewing direction that outputs volume density and view-dependent radiance. It optimizes from input images with known camera poses and renders by differentiable volume rendering along camera rays. Verified 2026-07-11 from the authors' project page and paper.
Strengths:
- strong novel-view appearance for captured radiance;
- handles view-dependent effects better than many naive texture bakes;
- useful for virtual tours, hero renders, volumetric previews, and reference playback.
Risks:
- camera poses and image consistency still matter;
- dynamic objects, exposure shifts, rolling shutter, motion blur, and focus changes become learned artifacts;
- mesh extraction is possible in some workflows but is not the primary representation and may be noisy;
- delivery is less standardized than mesh delivery, and runtime support depends on the target.
3D Gaussian splat
Use a Gaussian splat when real-time free-viewpoint playback of a captured scene is the priority and the target viewer supports splats. It is often a strong choice for rooms, streets, cultural sites, products with complex appearance, and location previews where interactive viewing beats editable topology.
Paper fact: the 2023 SIGGRAPH paper 3D Gaussian Splatting for Real-Time Radiance Field Rendering starts from sparse points produced during camera calibration, represents scenes with optimized 3D Gaussians, includes interleaved optimization and density control, and uses a visibility-aware splatting renderer to achieve high-quality real-time rendering in their evaluated conditions. Verified 2026-07-11 from the authors' Inria project page and paper.
Strengths:
- fast interactive viewing compared with many neural-field renderers;
- strong appearance preservation for complex captured scenes;
- works well when the final deliverable is an immersive viewer rather than editable geometry.
Risks:
- splats are not conventional solid meshes;
- collision, CAD, 3D printing, and DCC editing require conversion or a separ