AI Agent Skills

Efficient Deep Learning Systems course materials (HSE, YSDA)

A blazing fast inference solution for text embeddings models

Uplift modeling and causal inference with machine learning algorithms

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all throug…

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

Unify Efficient Fine-tuning of RAG Retrieval, including Embedding, ColBERT, ReRanker.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Achieve state of the art inference performance with modern accelerators on Kubernetes

Open-source inference server and production cluster for all the models your agent needs.

Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

Large-scale LLM inference engine

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and traini…

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to e…

🦛 CHONK docs with Chonkie ✨ — The lightweight ingestion library for fast, efficient and robust RAG pipelines

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading