Langfuse alternatives for AI agents.

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

The platform for LLM evaluations and AI agent testing

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

🐢 Open-Source Evaluation & Testing library for LLM Agents

The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

AI Observability & Evaluation

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

⚙️🦀 Build modular and scalable LLM Applications in Rust

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.

Community maintained hardware plugin for vLLM on Ascend

Observal is a unified platform for agent distribution, observability and insights.