OnnxStream
vitoplantamura
Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and…
Ml AutomationSkill source unconfirmed
2.1KGitHub
OPENAGENTSKILL / DIRECTORY
AI Agent Skills
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Results · “inference-server”
17–25 / 25
More filters · 1
Candidates in this shortlist, not the full registry. GitHub stars belong to repositories, not individual skills.
Results: 25
MNN
alibaba
MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
Ml AutomationSkill source unconfirmed
15.9KGitHub
Llama Cookbook
meta-llama
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to e…
18.4KGitHub
DALI
NVIDIA
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference appl…
Ml AutomationSkill source unconfirmed
5.7KGitHub
Sahi
obss
Framework agnostic sliced/tiled inference + interactive ui + error analysis plots
Ml AutomationSkill source unconfirmed
5.3KGitHub
TransformerEngine
NVIDIA
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, t…
Ml AutomationSkill source unconfirmed
3.4KGitHub
Deepdetect
jolibrain
Deep Learning Server and CLI for Torch and TensorRT
Ml AutomationSkill source unconfirmed
2.5KGitHub
OpenMLDB
4paradigm
OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.
Ml AutomationSkill source unconfirmed
1.7KGitHub
Gen.Jl
probcomp
A general-purpose probabilistic programming system with programmable inference
Ml AutomationSkill source unconfirmed
1.8KGitHub