跳至正文
OpenAgentSkill
浏览已开放 · 目录记录日期 2026-11-21 · 自动更新和账户服务暂时关闭。
开发与测试

nerf-to-3dgs-migrator

Migrate NeRF-based methods to 3DGS via the SLAT unified encode-decode framework. Analyzes component compatibility, provides code templates, identifies issues. Covers encoding, deformation, appearance, geometry. Use when: migrating NeRF method to 3DGS, comparing NeRF vs 3DGS components, designing hybrid NeRF-3DGS approaches, NeRF迁移3DGS/高斯泼溅转换/代码模板.

jaccen · 已有 AI 审核记录

安装与使用

运行命令前先阅读来源与依赖说明。复制命令不会自动安装或执行。

npx skills add jaccen/Awesome-Gaussian-Skills --skill nerf-to-3dgs-migrator

技能说明


name: nerf-to-3dgs-migrator description: "Migrate NeRF-based methods to 3DGS via the SLAT unified encode-decode framework. Analyzes component compatibility, provides code templates, identifies issues. Covers encoding, deformation, appearance, geometry. Use when: migrating NeRF method to 3DGS, comparing NeRF vs 3DGS components, designing hybrid NeRF-3DGS approaches, NeRF迁移3DGS/高斯泼溅转换/代码模板." license: Apache-2.0 user-invocable: true metadata: version: "1.6.0" author: jaccen tags: ["nerf", "3dgs", "gaussian-splatting", "migration", "code-template", "research"] when_to_use: - "Migrate a NeRF-based method to 3DGS" - "Compare NeRF vs 3DGS component compatibility" - "Design hybrid NeRF-3DGS approaches" - "Get step-by-step migration code templates" - "Identify issues when converting from volume rendering to splatting" - "NeRF迁移3DGS / 高斯泼溅转换 / 代码模板 / 组件兼容性分析"


NeRF-to-3DGS Migration Guide

You are a 3D reconstruction expert with deep knowledge of both NeRF and 3D Gaussian Splatting paradigms. Help users migrate their NeRF-based methods to 3DGS, or design new methods that combine insights from both.

Core Paradigm Differences

Before any migration, understand these fundamental differences:

AspectNeRF3DGS
RepresentationContinuous (MLP + volumetric)Discrete (explicit Gaussians)
RenderingVolume rendering (ray marching)Splatting (α-compositing)
SamplingAlong rays (coarse-to-fine)Point-based (all Gaussians)
QueryPoint sampling + MLP forwardDirect attribute lookup
Density controlImplicit (MLP output)Explicit (clone/split/prune)
MemoryBounded (MLP params)Unbounded (grows during training)
SpeedSlow (per-pixel ray march)Fast (parallel rasterization)
Quality ceilingHigh (continuous)High (adaptive density)

SLAT: Why NeRF→3DGS Migration Works

v1.6.0 upgrade: This skill's migration workflow is now grounded in the SLAT (Structured LATent representation) framework. See ../../references/slat-unified-representation.md for the full theory.

The SLAT Perspective on NeRF→3DGS

NeRF and 3DGS are not two unrelated representations — they are two decodings of the same structured latent. This is why migration is possible at all:

NeRF (continuous MLP field)
       │
       ▼  ENCODE: sample density + color on voxel grid
┌──────────────────────┐
│   SLAT               │
│   (sparse voxel      │
│    latent)           │
└──────┬───────────────┘
       │
       ├── DECODE → 3D Gaussians (discrete, explicit)
       └── DECODE → NeRF (continuous, implicit) ← original source

Under SLAT, NeRF→3DGS migration is a re-decode operation: encode the NeRF's continuous field into structured latent (by sampling on a voxel grid), then decode to discrete Gaussians. Each component migration step in this skill corresponds to a SLAT feature channel mapping:

Migration Step (this skill)SLAT Feature ChannelWhy It Maps
Positional Encoding → SHAppearance featureBoth encode view-dependent color; SH is 3DGS-native
Density (σ) → Opacity (α)Geometry occupancyσ sampled at voxel → α per Gaussian
Color MLP → SH coefficientsAppearance featureMLP output → explicit SH per Gaussian
Deformation Field → offsetsDeformation hookTemporal field → per-Gaussian offset at time t
Appearance embedding → featuresAppearance featurePer-image vector → per-Gaussian feature
Hash Grid → per-Gaussian featuresGeometry+appearanceMulti-resolution → flat per-Gaussian vector
Coarse-to-Fine → Progressive trainingTraining scheduleBoth control resolution progression

Conversion Loss Budget for NeRF→3DGS

Under SLAT, NeRF→3DGS has low total conversion loss because:

  • Encoding loss is low: NeRF's continuous field can be densely sampled, capturing nearly all information
  • Decoding loss is low: 3DGS is a natural decode target — discrete Gaussians can approximate any continuous field

This explains why NeRF→3DGS migration generally preserves quality, while the reverse (3DGS→NeRF) loses the explicit structure advantage.

When SLAT Helps vs When Direct Migration Is Better

ScenarioSLAT-GuidedDirect Component Migration
Migrating one method, one-on-one❌ Overkill✅ Simpler, faster
Migrating to also support Mesh output✅ Encode once, decode to 3DGS + Mesh❌ Must redo for Mesh
Need to quantify migration quality✅ Loss budget framework❌ No unified metric
Designing a new hybrid NeRF-3DGS method✅ SLAT provides the theoretical basis❌ Ad-hoc
Quick prototype migration❌ Latent overhead✅ Direct is faster

Migration Workflow

Step 1: Component Analysis

Analyze the source NeRF method and classify each component:

┌─────────────────────────────────┐
│     NeRF Method Components      │
├─────────────────┬───────────────┤
│ Component       │ Migration     │
│                 │ Strategy      │
├─────────────────┼───────────────┤
│ Positional      │ → Per-Gaussian│
│ Encoding        │   SH/feature  │
├─────────────────┼───────────────┤
│ Density MLP     │ → Opacity     │
│ (σ)             │   attribute   │
├─────────────────┼───────────────┤
│ Color MLP       │ → SH coeffs   │
│ (c)             │   or feature  │
├─────────────────┼───────────────┤
│ Deformation     │ → Offset on   │
│ Field           │   μ/R/S       │
├─────────────────┼───────────────┤
│ Appearance      │ → Per-Gaussian│
│ Embedding       │   feature vec │
├─────────────────┼───────────────┤
│ Hash Grid /     │ → Per-Gaussian│
│ Feature Grid    │   features    │
├─────────────────┼───────────────┤
│ Regularization  │ → Modify ADC  │
│ (TV,
阅读完整来源 ↗