AI Agent Skills

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inferen…

ALICE (Automated Learning and Intelligence for Causation and Economics) is a Microsoft Research project aimed at applying Artificial Intelligence concepts to economic de…

Fast ML inference & training for ONNX models in Rust

Framework agnostic sliced/tiled inference + interactive ui + error analysis plots

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, t…

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and…

A general-purpose probabilistic programming system with programmable inference

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

Tengine is a lite, high performance, modular inference engine for embedded device

Offline inference engine for art, real-time voice conversations, LLM powered chatbots and automated workflows

Hummingbird compiles trained ML models into tensor computation for faster inference.

Implementation of Vision Mamba from the paper: "Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model" It's 2.8x faster than DeiT a…

An explainable inference software supporting annotated, real valued, graph based and temporal logic