Decision filters
35 skills matching "llmops"
Best blend of quality, stars, freshness, and agent usage
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
$ npx skills add mlflow/mlflowDebug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
$ npx skills add comet-ml/opikBuild, Manage and Deploy AI/ML Systems
$ npx skills add Netflix/metaflowAI Observability & Evaluation
$ npx skills add Arize-ai/phoenix⚙️🦀 Build modular and scalable LLM Applications in Rust
$ npx skills add 0xPlaygrounds/rigPlano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic.
$ npx skills add katanemo/plano🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
$ npx skills add Helicone/heliconeNext-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.
$ npx skills add coze-dev/coze-loopZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
$ npx skills add zenml-io/zenml🐢 Open-Source Evaluation & Testing library for LLM Agents
$ npx skills add Giskard-AI/giskard-ossThe open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
$ npx skills add Agenta-AI/agentaEvaluation and Tracking for LLM Experiments and AI Agents
$ npx skills add truera/trulensThe platform for LLM evaluations and AI agent testing
$ npx skills add langwatch/langwatchAGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.
$ npx skills add Josh-XT/AGiXTLaminar - open-source observability platform purpose-built for AI agents. YC S24.
$ npx skills add lmnr-ai/lmnrPython SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
$ npx skills add raga-ai-hub/RagaAI-CatalystApache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
$ npx skills add apache/hamilton🏕️ Reproducible development environment for humans and agents
$ npx skills add tensorchord/envdBuild applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.
$ npx skills add apache/burrThe LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices
$ npx skills add PacktPublishing/LLM-Engineers-Handbook🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 12 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴
$ npx skills add decodingai-magazine/llm-twin-courseA reactive runtime for building durable AI agents
$ npx skills add ThousandBirdsInc/chidoriObserval is an Observability and Evaluation platform for human-in-the-loop agents
$ npx skills add BlazeUp-AI/ObservalA framework for comprehensive diagnosis and optimization of agents using simulated, realistic synthetic interactions
$ npx skills add plurai-ai/intellagentDynamiq is an orchestration framework for agentic AI and LLM applications
$ npx skills add dynamiq-ai/dynamiqLearn to build your Second Brain AI assistant with LLMs, agents, RAG, fine-tuning, LLMOps and AI systems techniques.
$ npx skills add decodingai-magazine/second-brain-ai-assistant-courseAI Agent Development Platform - Supports multiple models (OpenAI/DeepSeek/Wenxin/Tongyi), knowledge base management, workflow automation, and enterprise-grade security. Built with Flask + Vue3 + LangChain, featuring one-click Docker deployment.
$ npx skills add Haohao-end/openagentFast, streaming indexing, query, and agentic LLM applications in Rust
$ npx skills add bosun-ai/swiftideThe only fully local production-grade Super SDK that provides a simple, unified, and powerful interface for calling more than 200+ LLMs.
$ npx skills add adaline/gatewayNo-code multi-agent framework to build LLM Agents, workflows and applications with your data
$ npx skills add trypromptly/LLMStackThis sample has the full End2End process of creating RAG application with Prompty and Azure AI Foundry. It includes GPT-4 LLM application code, evaluations, deployment automation with AZD CLI, GitHub actions for evaluation and deployment and intent mapping for multiple LLM task mapping.
$ npx skills add Azure-Samples/contoso-chat⛓️ Serving LangChain LLM apps and agents automagically with FastApi. LLMops
$ npx skills add msoedov/langcornNeum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
$ npx skills add NeumTry/NeumAIData-Driven Evaluation for LLM-Powered Applications
$ npx skills add relari-ai/continuous-eval🕵️♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.
$ npx skills add neurocult/agency