AI Agent Skills

Bayesian inference with probabilistic programming.

Open-source inference server and production cluster for all the models your agent needs.

Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

Large-scale LLM inference engine

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

PySonar2: a semantic indexer for Python with interprocedual type inference

[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and traini…

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Run agents like Hermes and OpenClaw more securely inside NVIDIA OpenShell with managed inference

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to e…

Open source alternative to AWS. Elastic compute, block storage (non replicated), firewall and load balancer, managed Postgres, K8s, AI inference, and IAM services.

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference appl…