AI Agent Skills

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

🐢 Open-Source Evaluation & Testing library for LLM Agents

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from developmen…

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

Open source APM: OpenTelemetry traces, metrics, and logs

M3 monorepo - Distributed TSDB, Aggregator and Query Engine, Prometheus Sidecar, Graphite Compatible, Metrics Platform

Evaluation and Tracking for LLM Experiments and AI Agents

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

eBPF-based autoinstrumentation of web applications and network metrics

✨ Open-source DORA metrics platform for engineering teams ✨

AI equity research agent with resilient workflows, Redis Lua single-flight, pgvector RAG, versioned reports, evidence tracing, and RAG evaluation.

Monoscope lets you ingest and explore your logs, traces and metrics. We store these in S3 compatible buckets. Query in natural language via LLMs.

Observe FastAPI app with three pillars of observability: Traces (Tempo), Metrics (Prometheus), Logs (Loki) on Grafana through OpenTelemetry.

A top-like tool for your Kubernetes cluster metrics

Create a structured post-earnings equity research update with key metrics, estimate changes, charts, and thesis review.