⚡️The spatial perception framework for rapidly building smart robots and spaces

[ECCV 2022] This is the official implementation of BEVFormer, a camera-only framework for autonomous driving perception, e.g., 3D object detection and semantic map segmentation.

An open framework to simulate and deploy perception-based PX4/ArduPilot drone swarms with ROS2, YOLO, LiDAR, NVIDIA Jetson

The first open-source Artificial Narrow Intelligence generalist agentic framework Computer-Using-Agent that fully operates graphical-user-interfaces (GUIs) by using only natural language. Uses Visualization-of-Thought and Chain-of-Thought reasoning to elicit spatial reasoning and perception, emulates, plans and simulates synthetic HID interactions.

Perception and AI components for autonomous mobile robotics.

A universal, industry-neutral taxonomy of cognitive core skills (perception, memory, reasoning, planning, action, verification, learning, governance) for LLMs, SLMs, AI agents, and world models — with schemas, 159 skill cards, benchmarks, and CI.

Notebook-based book "Introduction to Robotics and Perception" by Frank Dellaert and Seth Hutchinson

Perception toolkit for sim2real training and validation in Unity

Gibson Environments: Real-World Perception for Embodied Agents

LSD (LiDAR SLAM & Detection) is an open source perception architecture for autonomous vehicle/robotic

[CVPR 2024 & NeurIPS 2024] EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI

[IROS 2024] 📈 RISE: 3D Perception Makes Real-World Robot Imitation Simple and Effective