AI Agent Skills

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Generate type-safe code from SQL

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to e…

Open source alternative to AWS. Elastic compute, block storage (non replicated), firewall and load balancer, managed Postgres, K8s, AI inference, and IAM services.

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference appl…

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Framework agnostic sliced/tiled inference + interactive ui + error analysis plots

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

Type safe SQL builder with code generation and automatic query result data mapping

Build a complete Nature-style Chinese PPTX presentation from a scientific paper, preprint, PDF, article text, figure legends, or reading notes. Use for journal club, gro…

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, t…

Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

Lightweight Image Video Action Generation Inference Framework

OpenMLDB is an open-source machine learning database that provides a feature platform computing consistent features for training and inference.