Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
$ npx skills add comet-ml/opikAlternatives
Compare similar skills by workflow fit, trust score, quality, GitHub adoption, maintenance, and install readiness.
Current skill
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
$ npx skills add comet-ml/opikπ’ Open-Source Evaluation & Testing library for LLM Agents
$ npx skills add Giskard-AI/giskard-ossπ§ Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 π
$ npx skills add Helicone/heliconeThe open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
$ npx skills add Agenta-AI/agentaThe platform for LLM evaluations and AI agent testing
$ npx skills add langwatch/langwatchThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
$ npx skills add mlflow/mlflowLaminar - open-source observability platform purpose-built for AI agents. YC S24.
$ npx skills add lmnr-ai/lmnrβοΈπ¦ Build modular and scalable LLM Applications in Rust
$ npx skills add 0xPlaygrounds/rigNext-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.
$ npx skills add coze-dev/coze-loopBISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.
$ npx skills add dataelement/bishengObserval is a unified platform for agent distribution, observability and insights.
$ npx skills add BlazeUp-AI/ObservalPython SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
$ npx skills add raga-ai-hub/RagaAI-CatalystBuild, Manage and Deploy AI/ML Systems
$ npx skills add Netflix/metaflowAI Observability & Evaluation
$ npx skills add Arize-ai/phoenixEvidently is ββan open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
$ npx skills add evidentlyai/evidentlyPlano is an AI-native proxy and data plane for agentic apps β with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic.
$ npx skills add katanemo/planoHow to choose
Use an alternative when it has a clearer install path, higher trust score, fresher maintenance, or better platform fit for your current agent stack. Keep Promptfoo if it already passes your workflow test and repository review.
Next step
Open the compare page, test the install commands in a sandbox, and check each repository before using a skill in production.