AI Agent Skills

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured funct…

A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.

CPU inference for the DeepSeek family of large language models in C++

LlamaIndex is the leading document agent and OCR platform

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to e…

从零编写游戏引擎教程 Writing a game engine tutorial from scratch

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

TensorRT C++ API Tutorial

YOLOv8 TensorRT C++ Implementation

Real-time 3D full-body reconstruction from a single camera, Multiperson BVH output, Pure C++ runtime, ONNX + ggml, 70-joint skeleton with hands.

聚宝盆(Cornucopia): 中文金融系列开源可商用大模型，并提供一套高效轻量化的垂直领域LLM训练框架(Pretraining、SFT、RLHF、Quantize等)

A high-performance C++ orderbook engine with microsecond-level latency, supporting multiple ordertypes, price-time priority matching and real time data integration from…

Port of OpenAI's Whisper model in C/C++

OpenAI C++ is a community-maintained library for the Open AI API

A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.