design-ai-benchmarking
Aperivue
Design and validity review for studies that benchmark one or more AI systems against a human-expert panel as the reference. Covers the evaluation question and arm defini…
288GitHub
OPENAGENTSKILL / DIRECTORY
AI Agent Skills
Find a skill for your next task. Explore tools for Codex, Claude Code, Cursor and more.
Results · “benchmarking”
1–16 / 35
More filters
Candidates in this shortlist, not the full registry. GitHub stars belong to repositories, not individual skills.
Results: 35
Cleverhans
cleverhans-lab
An adversarial example library for constructing attacks, building defenses, and benchmarking both
Ml AutomationSkill source unconfirmed
6.4KGitHub
855GitHub
Lidar Slam Ros2
rsasaki0109
ROS 2 LiDAR SLAM for pointcloud-map authoring, benchmarking, and Autoware-compatible map workflows.
Robotics IotSkill source unconfirmed
823GitHub
evaluating-code-models
sangrokjung
Evaluates code generation models across HumanEval, MBPP, MultiPL-E, and 15+ benchmarks with pass@k metrics. Use when benchmarking code models, comparing coding abilities…
825GitHub
Bocoel
rentruewang
Bayesian Optimization as a Coverage Tool for Evaluating LLMs. Accurate evaluation (benchmarking) that's 10 times faster with just a few lines of modular code.
Ml AutomationSkill source unconfirmed
289GitHub
Leaderboard
SpeechColab
SpeechIO Leaderboard: a large, robust, comprehensive, benchmarking platform for Automatic Speech Recognition.
Media AutomationSkill source unconfirmed
545GitHub
441GitHub
Place Recognition Evaluation
4ku
Benchmarking and evaluation framework for place recognition methods, featuring SuperPoint+SuperGlue, LoGG3D-Net, Scan Context, DBoW2, MixVPR, STD
Robotics IotBlocked
126GitHub
Agentops
AgentOps-AI
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK,…
5.8KGitHub
Evalscope
modelscope
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
DataSkill source unconfirmed
3KGitHub
Docext
NanoNets
An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit. (https://idp-leaderboard.org/)
Document ProcessingSkill source unconfirmed
2KGitHub
Video ChatGPT
mbzuai-oryx
[ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrai…
1.5KGitHub
golang-benchmark
samber
Golang benchmarking, profiling, and performance measurement. Use when writing, running, or comparing Go benchmarks, profiling hot paths with pprof, interpreting CPU/memo…
3KGitHub
WindowsAgentArena
microsoft
Windows Agent Arena (WAA) 🪟 is a scalable OS platform for testing and benchmarking of multi-modal AI agents.
AutomationSkill source unconfirmed
867GitHub
ecommerce-competitor-analysis
nexscope-ai
Cross-platform ecommerce competitor analysis and strategic intelligence. Multi-channel presence evaluation, strategy assessment, positioning analysis, and competitive be…
846GitHub