AI Agent Skills

Fast ML inference & training for ONNX models in Rust

Bayesian inference with probabilistic programming.

Open-source inference server and production cluster for all the models your agent needs.

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstan…

Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

Large-scale LLM inference engine

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

PySonar2: a semantic indexer for Python with interprocedual type inference

[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀

Deploy a ML inference service on a budget in less than 10 lines of code.

Scalable data processing for ML workloads. Streaming execution across CPU/GPU, supports Parquet/CSV/JSON/images. Integrates with Ray Train, PyTorch, TensorFlow. Scales f…

llm-d Router: The intelligent entry point for inference requests

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and traini…

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Run agents like Hermes and OpenClaw more securely inside NVIDIA OpenShell with managed inference