#1 PDF Application on GitHub that lets you edit PDFs on any device anywhere

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Omnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents — swap harnesses without rewriting, enforce policies and sandboxing, and collaborate in real time from any device.

[MLsys2026]: RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.

[MLsys2026]: RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

Cross-platform GUI written in Rust using ADB to debloat non-rooted Android devices. Improve your privacy, the security and battery life of your device.

On-device Speech AI for Apple Silicon

On-device wake word detection powered by deep learning

On-device AI across mobile, embedded and edge for PyTorch

NVIDIA device plugin for Kubernetes

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.