AI Agent Skills

Achieve state of the art inference performance with modern accelerators on Kubernetes

A portable accelerated SQL query, search, and LLM-inference engine, written in Rust, for data-grounded AI apps and agents.

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

Fast ML inference & training for ONNX models in Rust

Open-source inference server and production cluster for all the models your agent needs.

A Python package for Bayesian forecasting with object-oriented design and probabilistic models under the hood.

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstan…

Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

Large-scale LLM inference engine

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

PySonar2: a semantic indexer for Python with interprocedual type inference

[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀

Deploy a ML inference service on a budget in less than 10 lines of code.

RNN+Transformer hybrid with O(n) inference. Linear time, infinite context, no KV cache. Train like GPT (parallel), infer like RNN (sequential). Linux Foundation AI proje…

inference.sh Agent skills for using our API to give your agents access to hundreds of apps and other agents