AI Agent Skills

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Run agents like Hermes and OpenClaw more securely inside NVIDIA OpenShell with managed inference

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to e…

Open source alternative to AWS. Elastic compute, block storage (non replicated), firewall and load balancer, managed Postgres, K8s, AI inference, and IAM services.

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Open-Source Chrome extension for AI-powered web automation. Run multi-agent workflows using your own LLM API key. Alternative to OpenAI Operator.

External Secrets Operator reads information from a third-party service like AWS Secrets Manager and automatically injects the values as Kubernetes Secrets.

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference appl…

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Progressive delivery Kubernetes operator (Canary, A/B Testing and Blue/Green deployments)

Framework agnostic sliced/tiled inference + interactive ui + error analysis plots

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, t…