Agent resolve quality

Resolve evals for real agent tasks.

A regression dashboard for whether OpenAgentSkill recommends the right reusable skill for high-intent tasks across coding, research, finance, documents, automation, and sports analytics.

96%
Pass rate
46
Cases
44
Passed
2
Review

Needs tuning

Failed or weak matches

Use these rows to improve ranking terms and supply coverage.

short-world-cup-query

world cup

0

Full suite

Standard resolve cases

Each case checks expected slugs, terms, and minimum top score.

Pass

china-saas-localization-no-false-positive

Localize a SaaS product for launch in China

No result
0
Pass

chinese-china-market-localization-no-false-positive

中国市场本地化

No result
0
Pass

generic-web-scraping

Scrape competitor pricing pages and extract structured data

685
Pass

browser-automation

Control a browser, fill forms, and verify a web app workflow

757
Pass

github-pr-review

Review pull requests, inspect repository changes, and summarize GitHub issues

766
Pass

rag-documents

Build a RAG workflow over PDFs and retrieve reliable context

594
Pass

data-analysis

Analyze CSV data, create charts, and explain trends

554
Pass

content-automation

Turn product updates into blog posts, newsletters, and social copy

No result
0
Pass

security-scan

Scan a codebase for vulnerabilities, exposed secrets, and dependency risks

457
Pass

database-sql

Inspect a database schema, write SQL, and explain query results

498
Pass

stock-news-analysis

Analyze stock news from the last 30 days and summarize market risks

805
Pass

sec-filing-summary

Summarize SEC filings and prepare investor notes

626
Pass

quant-backtest

Backtest a trading strategy and explain drawdowns

836
Pass

world-cup-dashboard

Build a World Cup dashboard from football match data

No result
0
Review

short-world-cup-query

world cup

No result
0
Pass

football-xg-analysis

Compare football teams using expected goals and event data

No result
0
Pass

pdf-table-extraction

Extract tables from PDF reports and convert them to markdown

704
Pass

office-to-markdown

Convert Word, PowerPoint, and spreadsheet files into clean markdown

836
Pass

youtube-research

Research recent YouTube videos and produce a grounded summary

628
Pass

reddit-market-scan

Scan Reddit discussions for product feedback and market signals

538
Pass

hacker-news-monitoring

Monitor Hacker News and summarize trending developer discussions

506
Pass

pull-request-tests

Inspect a pull request and generate focused regression tests

548
Pass

repo-architecture

Explain a repository architecture and identify risky modules

697
Pass

form-automation

Fill forms in a browser and verify the submitted result

549
Pass

rag-citations

Build a RAG answer with citations from a document collection

666
Pass

vector-search

Index documents and retrieve context with vector search

628
Pass

seo-keyword-brief

Research SEO keywords and generate article briefs

493
Pass

social-launch-copy

Turn a product launch into social posts and newsletter copy

No result
0
Pass

crm-cleanup

Clean CRM exports and prepare a growth report

618
Pass

spreadsheet-analysis

Analyze spreadsheet data and produce charts with explanation

554
Pass

database-migration-review

Review a database migration for schema and query risks

594
Pass

secret-scanning

Scan a repository for exposed API keys and secrets

481
Pass

dependency-vulnerability

Audit dependencies for vulnerabilities and summarize remediation

No result
0
Pass

contract-review

Review a contract and summarize risky clauses

468
Review

education-tutor

Create an adaptive tutor that explains a topic step by step

303
Pass

video-generation-workflow

Create a video generation workflow for short creative clips

787
Pass

image-design-workflow

Generate image design prompts and refine visual assets

672
Pass

workflow-automation

Connect repeated operational tasks across APIs and tools

359
Pass

scheduled-agent-run

Run an agent task on a schedule and report results

446
Pass

customer-support-triage

Triage customer support messages and draft replies

446
Pass

api-docs-generation

Generate API documentation from source code and examples

584
Pass

data-visualization

Create data visualizations from analytics exports

594