跳至正文
OpenAgentSkill
浏览已开放 · 目录记录日期 2026-11-21 · 自动更新和账户服务暂时关闭。
数据与分析

anti-slop-analytics

Review sports figures, tables, notebooks, and reports for chartjunk, fake certainty, cropped axes, baseline erasure, metric laundering, and weak reproducibility. Use when asked to clean up or audit analytical presentation.

WalrusQuant · 已有 AI 审核记录

安装与使用

运行命令前先阅读来源与依赖说明。复制命令不会自动安装或执行。

npx skills add WalrusQuant/sports-analytic-skills --skill anti-slop-analytics

技能说明


name: anti-slop-analytics description: > Review sports figures, tables, notebooks, and reports for chartjunk, fake certainty, cropped axes, baseline erasure, metric laundering, and weak reproducibility. Use when asked to clean up or audit analytical presentation. license: MIT metadata: version: "0.12.0"

Anti-Slop Analytics

Outcome

Produce an item-by-item keep, fix, or kill review. Every retained figure or table must make a defensible claim and disclose its population, period, denominator, comparison baseline, uncertainty, and reproduction pointer.

Pretty is optional. Honest is required. Presentation cannot rescue a weak design, a losing model, or an unverifiable calculation.

When to use this skill

Use it when reviewing:

  • exploratory or diagnostic plots;
  • model-comparison and calibration figures;
  • dashboards, notebooks, reports, papers, or public posts;
  • requests to make results look cleaner, stronger, or more impressive;
  • any visual whose design may conceal a weak baseline or unstable result.

If no visual or table exists, create the analytical artifact first. Use sports-visualization for figure construction, validation-design for the evaluation itself, and results-reporting for the full narrative. This skill audits presentation; it does not repair the underlying study by relabeling it.

Inputs and evidence

Request or inspect:

  • the figure, table, notebook, or report;
  • the one claim each item is intended to support;
  • the underlying user-owned data or metrics artifact when available;
  • the decision context and audience;
  • the plotting command, script, or notebook cell;
  • relevant filters, exclusions, and fold definitions.

If evidence is missing, audit what is visible and mark unverifiable properties as unknown. Never infer provenance, sample size, uncertainty, or held-out status from visual polish.

Audit workflow

  1. Inventory every figure and table with a filename or stable identifier.
  2. Write the single decision-relevant claim each item is meant to support.
  3. Verify sport, competition, grain, period, population, sample size, exclusions, and denominator.
  4. Confirm that the plotted quantity matches the title, caption, and claim.
  5. Check that a relevant null, naive model, or incumbent baseline is visible.
  6. Inspect axes, transformations, scales, bins, smoothing, color, ordering, facets, and annotations.
  7. Separate training, in-sample, held-out, and forward-looking evidence.
  8. Inspect statistical honesty: uncertainty, multiplicity, selection, missing segments, and sensitivity to the chosen time window.
  9. Trace the item to a user-owned data file, metrics file, notebook, or command.
  10. Assign keep, fix, or kill; prescribe the smallest honest replacement.

Failure catalog

FailureWhy it failsPreferred replacement
Certainty without nhides evidence volumereport denominator and interval or fold spread
Cropped quantitative axisexaggerates small changeszero or a justified domain range with disclosure
Cherry-picked time windowturns a hot streak into a general claimfull relevant period plus sensitivity window
Baseline erasureprevents judging incremental valueplot candidate beside locked baseline
Metric launderingpromotes a flattering secondary metriclead with the predeclared primary metric
Training as validationoverstates generalizationclearly labeled held-out or walk-forward results
Ranking without uncertaintytreats noisy order as stableintervals, rank distributions, or stability summaries
Accuracy without base ratehides class imbalance and probability qualitybaseline plus log-loss or Brier score
Mean without distributionhides tails, skew, and fold lossesquantiles, interval, distribution, or fold table
Unlabeled smoothingconceals a transformationstate method, window, and parameters
Dual axesmanufactures visual correlation through scalingaligned panels or indexed series
Giant correlation heatmapsubstitutes volume for a hypothesisselected relationships with purpose and uncertainty
Decorative 3-D, pie, or gradientsadds non-data ink and distorts comparisonflat marks, direct labels, or a small table
Screenshot-only evidencecannot be reproduced or checkedexported artifact plus source and command
Probability framed as destinyconverts uncertainty into a lockprobability plus calibration and decision context
Sport context removedmakes grain and population ambiguoussport, competition, grain, and period in label/caption

For additional examples, read references/slop_catalog.md when classifying a suspect item and references/replacements.md when choosing a redraw.

Verdict rubric

VerdictUse whenRequired action
keepclaim, scope, baseline, uncertainty, and provenance are clearretain; tighten caption only if needed
fixcalculation is usable but the presentation can misleadspecify exact axis, label, baseline, or encoding repair
killwrong grain, wrong evidence, unverifiable, redundant, or decision-irrelevantremove or replace with a new artifact

If a decorative chart can be fixed only by changing its core claim, kill it and redraw from the underlying evidence.

Sports-specific checks

  • A doubled team-game panel has two rows per contest. Do not report its overall win rate as home advantage; filter home rows or return to game grain.
  • Team and player rankings often have unequal schedules and sample sizes. Show opportunity, exposure, or shrinkage rather than raw order alone.
  • Season averages can hide rule, schedule, roster, or measurement changes. Label eras and test whether the conclusion survives them.
  • Probabilities require calibration evidence. Discrimination alone does not show that a displayed 70% forecast
阅读完整来源 ↗