AI Agent Skills

Fast ML inference & training for ONNX models in Rust

Bayesian inference with probabilistic programming.

Open-source inference server and production cluster for all the models your agent needs.

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstan…

Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

Large-scale LLM inference engine

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

PySonar2: a semantic indexer for Python with interprocedual type inference

[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀

Deploy a ML inference service on a budget in less than 10 lines of code.

RNN+Transformer hybrid with O(n) inference. Linear time, infinite context, no KV cache. Train like GPT (parallel), infer like RNN (sequential). Linux Foundation AI proje…

Scalable data processing for ML workloads. Streaming execution across CPU/GPU, supports Parquet/CSV/JSON/images. Integrates with Ray Train, PyTorch, TensorFlow. Scales f…

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and traini…

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Run agents like Hermes and OpenClaw more securely inside NVIDIA OpenShell with managed inference