AI Agent Skills

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and…

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

An agentic company research tool powered by LangGraph and Tavily that conducts deep diligence on companies using a multi-agent framework. It leverages Google's Gemini 2.…

Vietnamese TTS with instant voice cloning • On-device • Real-time CPU inference • 24kHz audio quality • Chuyển văn bản thành giọng nói tiếng Việt • Text to speech tiếng…

A general-purpose probabilistic programming system with programmable inference

基于PaddleOCR重构，并且脱离PaddlePaddle深度学习训练框架的轻量级OCR，推理速度超快 —— A lightweight OCR system based on PaddleOCR, decoupled from the PaddlePaddle deep learning training framework, wi…

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

A probabilistic programming language in TensorFlow. Deep generative models, variational inference.

Tengine is a lite, high performance, modular inference engine for embedded device

14-stage Fusion Pipeline for LLM token compression — reversible compression, AST-aware code analysis, intelligent content routing. Zero LLM inference cost. MIT licensed.

Offline inference engine for art, real-time voice conversations, LLM powered chatbots and automated workflows

Hummingbird compiles trained ML models into tensor computation for faster inference.

PaddleOCR inference in PyTorch. Converted from [PaddleOCR](https://github.com/PaddlePaddle/PaddleOCR)

Mobile-native local AI Agent framework for iPhone with a fully offline local path, on-device models, native iOS Skills, and optional Mac Gateway inference

GPT-SoVITS ONNX Inference Engine & Model Converter

Images to inference with no labeling (use foundation models to train supervised models).