{"slug":"kennethkhoocy-llm-gold-bound-failure-check","name":"llm-gold-bound-failure-check","description":"Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND\nbefore spending on prompt revision or model changes. Use when: (1) a scoring\npipeline over-predicts a label (precision low, recall high) and a prompt\nclarification is proposed to tighten it, (2) a pilot/validation gate fails\nand the fix candidates are prompt edits, (3) inter-rater agreement on the\nweak label was already low (κ < ~0.6). Core check: if gold POSITIVES share\nthe exact feature the revision would exclude, no prompt can pass a\ngold-scored gate — recall craters while precision barely moves. Also\ndocuments the verified surgical-pilot design (single-section diff,\ntune/holdout split, pre-registered gate, perturbation check on untouched\nsections).","long_description":"---\nname: llm-gold-bound-failure-check\ndescription: |\n  Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND\n  before spending on prompt revision or model changes. Use when: (1) a scoring\n  pipeline over-predicts a label (precision low, recall high) and a prompt\n  clarification is proposed to tighten it, (2) a pilot/validation gate fails\n  and the fix candidates are prompt edits, (3) inter-rater agreement on the\n  weak label was already low (κ < ~0.6). Core check: if gold POSITIVES share\n  the exact feature the revision would exclude, no prompt can pass a\n  gold-scored gate — recall craters while precision barely moves. Also\n  documents the verified surgical-pilot design (single-section diff,\n  tune/holdout split, pre-registered gate, perturbation check on untouched\n  sections).\nauthor: Claude Code\nversion: 1.0.0\ndate: 2026-07-16\n---\n\n# LLM Gold-Bound Failure Check\n\n## Problem\n\nWhen an LLM scoring pipeline over-predicts one label, the reflex fix is a\nprompt clarification (\"score positive ONLY when...\"). But if the gold standard\nitself does not separate the texts you want excluded from the texts it labels\npositive, the revision removes true and false positives together. The pilot\nfails, the spend is wasted, and — worse — an un-gated adoption would have\nsilently destroyed recall in production.\n\n## Context / Trigger Conditions\n\n- A domain/label shows precision ≪ recall (e.g. P 0.46 / R 0.96) against gold\n- A prompt edit is proposed to exclude a specific text type (boilerplate,\n  affirmative-program language, non-risk framing)\n- The label's gold council/inter-rater agreement was already the weakest\n  (κ below ~0.6 is the warning sign that the construct is contested)\n\n## Solution\n\n**Step 0 — the ~$0 check, BEFORE building anything:** read a sample of gold\nPOSITIVES for the weak label and ask: do they contain the feature the revision\nwould exclude? Compare them side-by-side with the false positives.\n\n- Gold positives and false positives are the same kind of text → the failure\n  is **gold-bound**. Stop. No prompt passes a gold-scored gate. The levers are:\n  (a) re-adjudicate the construct with the gold's owners (changes the gold,\n  not the scores), or (b) re-interpret the shipped measure honestly (e.g.\n  \"discussion salience\" instead of \"risk exposure\") in downstream analyses.\n- Gold positives clearly differ from the false positives → a prompt revision\n  is plausible; proceed to a gated pilot.\n\n**Gated pilot design (verified):**\n1. Split gold into tune/holdout halves, stratified on the weak label's\n   positives; fixed seed.\n2. Draft ONE surgical edit from tune-half errors only — byte-identical\n   elsewhere; verify the diff reverses cleanly.\n3. Pre-register the gate on the holdout BEFORE scoring: target-label\n   thresholds (e.g. precision ≥ X AND recall ≥ Y) plus a perturbation\n   tolerance for untouched labels (e.g. within 0.03 F1 / 0.06 κ of a\n   same-serving-rev fresh baseline).\n4. Score everything fresh under both prompts (same model revision, same day —\n   this doubles as the drift control). Never write through the production\n   cache layer.\n5. Adopt only on a full pass; a REJECT is a valid, cheap outcome.\n\n## Verification\n\nThe pilot report shows: the exact prompt diff, tune-vs-holdout metrics for\nold and new prompts, per-label deltas on untouched sections, and spend.\nA gold-bound diagnosis is confirmed when the revision moves recall sharply\ndown while precision stays roughly flat.\n\n## Example\n\nSpecialist Directors US, 2026-07-16: DEI over-prediction (P 0.46 / R 0.96,\ncouncil κ 0.24–0.59). A risk-framing-only DEI clause was piloted ($1.17,\npre-registered holdout gate). Result: recall 0.895→0.263, precision\n0.455 (gate ≥0.60) — REJECT. Reading the tune half showed ~¾ of gold DEI\npositives were pure affirmative D&I program text, identical in kind to the\nfalse positives; the failure was predictable at Step 0. Bonus finding: the\nDEI-section-only edit left all five other domains within 0.025 F1 / 0.05 κ —\nsingle-section prompt edits isolate cleanly, so the perturbation check is a\ncheap add, not paranoia. Same pattern one week earlier: a cyber classifier\npilot gate failure traced to E/D gold contamination (misses were\nskills-matrix-checkbox-only positives), not model weakness.\n\n## Notes\n\n- Low inter-rater κ on a label is the leading indicator: contested construct\n  → gold-bound failures downstream.\n- If the pipeline scores all labels in one completion, any post-campaign\n  prompt change forces a full re-score — run this check BEFORE the campaign.\n- See also: [llm-campaign-drift-gate] for the companion gate on resume\n  boundaries and serving-revision drift (same fresh-baseline discipline).\n- See also: [annotator-input-parity-check] — run it FIRST. If the model was\n  never shown the document the annotators read, apparent gold-bound failures\n  (e.g. the 2026-07-16 E/D \"contamination\" reading above) are actually input\n  mismatch: the 2026-07-21 parity audit showed the specialist-director hand\n  labels were pure proxy-statement transcriptions, so checkbox-only positives\n  were recoverable from the right input all along.\n","tagline":"Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND\nbefore spending on prompt revision or model changes. Use when: (1) a scoring\npipeline over-predicts a label (precision low, recall high) and a prompt\nclarification is proposed to tighten it, (2) a pilot/va","category":"design-creative","tags":["agent-skill"],"author":"Claude Code","verified":false,"attribution":{"status":"registry_indexed","statusLabel":"Registry indexed","shortLabel":"REGISTRY INDEXED","sourceLabel":"recursive skill source sync","sourceDetail":"kennethkhoocy/applied-micro-skills","creatorName":"Claude Code","creatorUrl":"https://github.com/kennethkhoocy","sourceUrl":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check","indexedBy":"OpenAgentSkill community index","claimUrl":"https://www.openagentskill.com/skills/kennethkhoocy-llm-gold-bound-failure-check#claim-this-skill","claimCta":"Claim this skill","trustNote":"This listing was indexed from public sources and is not marked official until a maintainer claim is approved.","publicNote":"Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals."},"stats":{"stars":47,"forks":0,"verified_installs":0,"successful_runs":0,"total_outcomes":0,"rating":0,"review_count":0,"quality_score":35.47},"quality":{"score":64,"tier":"promising","label":"Promising","summary":"Useful candidate, but compare it with alternatives before adopting.","signals":[{"label":"GitHub stars","value":"47","tone":"neutral"},{"label":"Freshness","value":"Today","tone":"positive"},{"label":"Install ready","value":"Yes","tone":"positive"},{"label":"License","value":"MIT","tone":"neutral"}],"warnings":["Low GitHub adoption signal"]},"trust":{"version":"trust-score-v5","score":71,"base_score":79,"outcome_confidence":0,"tier":"review","label":"Sandbox only","summary":"Useful candidate with missing or mixed trust signals. Keep it in an isolated workspace until the outcome loop proves task fit.","recommendedAction":"Run only in a sandbox and compare close alternatives before using it for real work.","decision":{"install_policy":"human_review_before_install","auto_install_allowed":false,"human_review_required":true,"sandbox_first":true,"agent_action":"Compare alternatives before installing.","reasoning":["71/100 Trust Score v5","79/100 Trust Score v4 baseline","Needs more real agent outcomes before unattended install","Install path is available","Review before production"],"review_required_when":["The workspace contains production secrets, payments, private customer data, or irreversible actions.","The install command requests shell, network, credential, database, or broad filesystem access.","Outcome evidence is missing, recently failed, or required human review.","Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"]},"dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":48,"weight":0.13,"status":"warn","detail":"47 GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":43,"weight":0.08,"status":"warn","detail":"47 stars, 0 forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"Pushed today"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"MIT"},{"id":"documentation","label":"README/SKILL.md completeness","score":86,"weight":0.14,"status":"pass","detail":"Metadata includes enough usage and workflow context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":90,"weight":0.12,"status":"pass","detail":"no major dependency risk hints in public metadata"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":86,"weight":0.07,"status":"pass","detail":"filesystem or document access"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"},{"id":"agent_outcomes","label":"Agent Proven outcomes","score":54,"weight":0.13,"status":"info","detail":"No agent outcome data yet"}],"checks":[{"status":"warn","label":"GitHub adoption","detail":"47 GitHub stars"},{"status":"warn","label":"Stars/forks activity","detail":"47 stars, 0 forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"Pushed today"},{"status":"pass","label":"License clarity","detail":"MIT"},{"status":"pass","label":"README/SKILL.md completeness","detail":"Metadata includes enough usage and workflow context"},{"status":"pass","label":"Dependency/runtime risk","detail":"no major dependency risk hints in public metadata"},{"status":"pass","label":"Install availability","detail":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"pass","label":"Permission surface","detail":"filesystem or document access"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"info","label":"Agent Proven outcomes","detail":"No agent outcome data yet"},{"status":"warn","label":"Ownership","detail":"No approved owner claim yet"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"},{"status":"info","label":"Agent outcomes","detail":"No agent outcome data yet"}],"strengths":["AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Install command has no obvious high-risk pattern","Outcome loop is ready but needs first real agent run"],"warnings":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata","No real agent outcome reports yet","Human review required before unattended installation"],"evidence":{"stars":"47 GitHub stars","repoActivity":"47 stars, 0 forks","lastPushed":"Pushed today","license":"MIT","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check","install":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","installSafety":"standard package or runtime install path","permissionSurface":"filesystem or document access","documentation":"Strong README/SKILL.md context","agentOutcomes":"No agent outcome data yet","agentProvenScore":0,"outcomeConfidence":"0%","installPolicy":"human_review_before_install"},"installReadiness":{"ready":true,"command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","policy":"human_review_before_install","label":"Human review before install","notes":["Install path is available","Repository evidence is available","License is declared","No Agent Proven outcome evidence yet","Pushed today","Trust Score v5 requires review or sandbox-only use before install."]},"agentCompatibility":["Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"medium","label":"Review before production","notes":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"outcomeEvidence":{"total":0,"successes":0,"failures":0,"notRelevant":0,"successRate":null,"installAttempts":0,"riskBlocked":0,"setupRequired":0,"installSuccessRate":null,"avgOutputQuality":null,"avgTimeToUsefulMs":null,"productionOutcomes":0,"humanReviewRequired":0,"recentSuccessRate":null,"recentFailureRate":null,"uniqueAgents":0,"agentProvenScore":0,"agentProvenLabel":"Needs first agent run","lastOutcomeAt":null,"label":"No agent outcome data yet"},"autoInstall":{"allowed":false,"sandboxRequired":true,"policy":"human_review_before_install","reason":"Compare alternatives before installing."},"outcome_loop":{"version":"openagentskill-agent-outcome-v3","required_after_install":true,"endpoint":"/api/agent/outcome","method":"POST","event_id_source":"feedback.event_id, install_receipt.resolve_event_id, or decision_packet.outcome_feedback.event_id","expected_outcomes":["success","failed","not_relevant","blocked_by_risk","setup_required"],"required_fields":["event_id","skill_slug","task"],"quality_fields":["task_success","output_quality","error_type","human_review_required","used_in_production","workspace","evidence_url","time_to_useful_ms"],"ranking_inputs_updated":["Trust Score v5 outcome confidence","Agent Proven Score","Resolve ranking task-fit evidence","Skill detail machine-readable metadata","Outcome leaderboard"]},"agent_contract":{"suited_tasks":["design-creative","agent-skill"],"suited_agents":["Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"install_command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","trust_score":71,"trust_version":"trust-score-v5","risk_level":"medium","do_not_use_when":["Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"],"before_install":["Read the audit page and machine-readable metadata.","Confirm the install command, license, and permission surface fit the workspace.","Get explicit human approval or choose an alternative before installing."],"after_run":["Report the outcome to /api/agent/outcome using the resolve event id.","Include output_quality, workspace, human_review_required, and evidence_url when available.","Re-resolve before broad production rollout."]},"bestFor":["design-creative","agent-skill"],"doNotUseFor":["Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"],"knownRisks":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"],"backward_compatible":{"trust_score_v4":{"version":"trust-score-v4","score":79,"tier":"strong","label":"Strong shortlist","summary":"Good trust signals with a few areas worth checking before rollout."}}},"trust_score_v5":{"version":"trust-score-v5","score":71,"base_score":79,"outcome_confidence":0,"tier":"review","label":"Sandbox only","summary":"Useful candidate with missing or mixed trust signals. Keep it in an isolated workspace until the outcome loop proves task fit.","recommendedAction":"Run only in a sandbox and compare close alternatives before using it for real work.","decision":{"install_policy":"human_review_before_install","auto_install_allowed":false,"human_review_required":true,"sandbox_first":true,"agent_action":"Compare alternatives before installing.","reasoning":["71/100 Trust Score v5","79/100 Trust Score v4 baseline","Needs more real agent outcomes before unattended install","Install path is available","Review before production"],"review_required_when":["The workspace contains production secrets, payments, private customer data, or irreversible actions.","The install command requests shell, network, credential, database, or broad filesystem access.","Outcome evidence is missing, recently failed, or required human review.","Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"]},"dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":48,"weight":0.13,"status":"warn","detail":"47 GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":43,"weight":0.08,"status":"warn","detail":"47 stars, 0 forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"Pushed today"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"MIT"},{"id":"documentation","label":"README/SKILL.md completeness","score":86,"weight":0.14,"status":"pass","detail":"Metadata includes enough usage and workflow context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":90,"weight":0.12,"status":"pass","detail":"no major dependency risk hints in public metadata"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":86,"weight":0.07,"status":"pass","detail":"filesystem or document access"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"},{"id":"agent_outcomes","label":"Agent Proven outcomes","score":54,"weight":0.13,"status":"info","detail":"No agent outcome data yet"}],"checks":[{"status":"warn","label":"GitHub adoption","detail":"47 GitHub stars"},{"status":"warn","label":"Stars/forks activity","detail":"47 stars, 0 forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"Pushed today"},{"status":"pass","label":"License clarity","detail":"MIT"},{"status":"pass","label":"README/SKILL.md completeness","detail":"Metadata includes enough usage and workflow context"},{"status":"pass","label":"Dependency/runtime risk","detail":"no major dependency risk hints in public metadata"},{"status":"pass","label":"Install availability","detail":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"pass","label":"Permission surface","detail":"filesystem or document access"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"info","label":"Agent Proven outcomes","detail":"No agent outcome data yet"},{"status":"warn","label":"Ownership","detail":"No approved owner claim yet"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"},{"status":"info","label":"Agent outcomes","detail":"No agent outcome data yet"}],"strengths":["AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Install command has no obvious high-risk pattern","Outcome loop is ready but needs first real agent run"],"warnings":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata","No real agent outcome reports yet","Human review required before unattended installation"],"evidence":{"stars":"47 GitHub stars","repoActivity":"47 stars, 0 forks","lastPushed":"Pushed today","license":"MIT","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check","install":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","installSafety":"standard package or runtime install path","permissionSurface":"filesystem or document access","documentation":"Strong README/SKILL.md context","agentOutcomes":"No agent outcome data yet","agentProvenScore":0,"outcomeConfidence":"0%","installPolicy":"human_review_before_install"},"installReadiness":{"ready":true,"command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","policy":"human_review_before_install","label":"Human review before install","notes":["Install path is available","Repository evidence is available","License is declared","No Agent Proven outcome evidence yet","Pushed today","Trust Score v5 requires review or sandbox-only use before install."]},"agentCompatibility":["Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"medium","label":"Review before production","notes":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"outcomeEvidence":{"total":0,"successes":0,"failures":0,"notRelevant":0,"successRate":null,"installAttempts":0,"riskBlocked":0,"setupRequired":0,"installSuccessRate":null,"avgOutputQuality":null,"avgTimeToUsefulMs":null,"productionOutcomes":0,"humanReviewRequired":0,"recentSuccessRate":null,"recentFailureRate":null,"uniqueAgents":0,"agentProvenScore":0,"agentProvenLabel":"Needs first agent run","lastOutcomeAt":null,"label":"No agent outcome data yet"},"autoInstall":{"allowed":false,"sandboxRequired":true,"policy":"human_review_before_install","reason":"Compare alternatives before installing."},"outcome_loop":{"version":"openagentskill-agent-outcome-v3","required_after_install":true,"endpoint":"/api/agent/outcome","method":"POST","event_id_source":"feedback.event_id, install_receipt.resolve_event_id, or decision_packet.outcome_feedback.event_id","expected_outcomes":["success","failed","not_relevant","blocked_by_risk","setup_required"],"required_fields":["event_id","skill_slug","task"],"quality_fields":["task_success","output_quality","error_type","human_review_required","used_in_production","workspace","evidence_url","time_to_useful_ms"],"ranking_inputs_updated":["Trust Score v5 outcome confidence","Agent Proven Score","Resolve ranking task-fit evidence","Skill detail machine-readable metadata","Outcome leaderboard"]},"agent_contract":{"suited_tasks":["design-creative","agent-skill"],"suited_agents":["Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"install_command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","trust_score":71,"trust_version":"trust-score-v5","risk_level":"medium","do_not_use_when":["Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"],"before_install":["Read the audit page and machine-readable metadata.","Confirm the install command, license, and permission surface fit the workspace.","Get explicit human approval or choose an alternative before installing."],"after_run":["Report the outcome to /api/agent/outcome using the resolve event id.","Include output_quality, workspace, human_review_required, and evidence_url when available.","Re-resolve before broad production rollout."]},"bestFor":["design-creative","agent-skill"],"doNotUseFor":["Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"],"knownRisks":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"],"backward_compatible":{"trust_score_v4":{"version":"trust-score-v4","score":79,"tier":"strong","label":"Strong shortlist","summary":"Good trust signals with a few areas worth checking before rollout."}}},"trust_score_v4":{"version":"trust-score-v4","score":79,"tier":"strong","label":"Strong shortlist","summary":"Good trust signals with a few areas worth checking before rollout.","recommendedAction":"Test in a sandbox workflow and compare its install path with close alternatives.","dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":48,"weight":0.13,"status":"warn","detail":"47 GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":43,"weight":0.08,"status":"warn","detail":"47 stars, 0 forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"Pushed today"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"MIT"},{"id":"documentation","label":"README/SKILL.md completeness","score":86,"weight":0.14,"status":"pass","detail":"Metadata includes enough usage and workflow context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":90,"weight":0.12,"status":"pass","detail":"no major dependency risk hints in public metadata"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":86,"weight":0.07,"status":"pass","detail":"filesystem or document access"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"},{"id":"agent_outcomes","label":"Agent Proven outcomes","score":54,"weight":0.13,"status":"info","detail":"No agent outcome data yet"}],"checks":[{"status":"warn","label":"GitHub adoption","detail":"47 GitHub stars"},{"status":"warn","label":"Stars/forks activity","detail":"47 stars, 0 forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"Pushed today"},{"status":"pass","label":"License clarity","detail":"MIT"},{"status":"pass","label":"README/SKILL.md completeness","detail":"Metadata includes enough usage and workflow context"},{"status":"pass","label":"Dependency/runtime risk","detail":"no major dependency risk hints in public metadata"},{"status":"pass","label":"Install availability","detail":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"pass","label":"Permission surface","detail":"filesystem or document access"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"info","label":"Agent Proven outcomes","detail":"No agent outcome data yet"},{"status":"warn","label":"Ownership","detail":"No approved owner claim yet"},{"status":"info","label":"OpenAgentSkill usage","detail":"No local usage activity yet"},{"status":"info","label":"Agent outcomes","detail":"No agent outcome data yet"}],"strengths":["AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Install command has no obvious high-risk pattern"],"warnings":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"],"evidence":{"stars":"47 GitHub stars","repoActivity":"47 stars, 0 forks","lastPushed":"Pushed today","license":"MIT","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check","install":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","installSafety":"standard package or runtime install path","permissionSurface":"filesystem or document access","documentation":"Strong README/SKILL.md context","agentOutcomes":"No agent outcome data yet"},"installReadiness":{"ready":true,"command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","policy":"human_review_before_install","label":"Human review before install","notes":["Install path is available","Repository evidence is available","License is declared","No Agent Proven outcome evidence yet","Pushed today"]},"agentCompatibility":["Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"medium","label":"Review before production","notes":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"outcomeEvidence":{"total":0,"successes":0,"failures":0,"notRelevant":0,"successRate":null,"installAttempts":0,"riskBlocked":0,"setupRequired":0,"installSuccessRate":null,"avgOutputQuality":null,"avgTimeToUsefulMs":null,"productionOutcomes":0,"humanReviewRequired":0,"recentSuccessRate":null,"recentFailureRate":null,"uniqueAgents":0,"agentProvenScore":0,"agentProvenLabel":"Needs first agent run","lastOutcomeAt":null,"label":"No agent outcome data yet"},"autoInstall":{"allowed":false,"sandboxRequired":true,"policy":"human_review_before_install","reason":"Human review or sandbox validation is required before automatic installation."},"bestFor":["design-creative","agent-skill"],"doNotUseFor":["Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"],"knownRisks":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"agent_proven":{"version":"agent-proven-v1","score":0,"tier":"unproven","label":"Needs first agent run","summary":"No agent outcome reports yet. Use Resolve, run one narrow sandbox task, then report the result.","metrics":{"totalOutcomes":0,"successfulOutcomes":0,"failedOutcomes":0,"installAttempts":0,"installSuccessRate":null,"successRate":null,"recentSuccessRate":null,"recentFailureRate":null,"riskBlocked":0,"setupRequired":0,"notRelevant":0,"avgOutputQuality":null,"avgTimeToUsefulMs":null,"productionOutcomes":0,"humanReviewRequired":0,"uniqueAgents":0,"lastOutcomeAt":null},"signals":[],"penalties":["No real agent outcome evidence yet"]},"outcome_stats":null,"safety":{"score":64,"level":"review_before_install","label":"Review before install","safety_tier":{"tier":"reviewed","label":"Reviewed with permission notes","badge":"REVIEWED","summary":"Usable candidate, but the agent should surface permission and audit notes before installation.","recommended_action":"Require human approval before installing into a real workspace.","auto_install_policy":"review","reasons":["Low GitHub adoption signal","64/100 agent safety score"]},"auto_install_allowed":false,"human_review_required":true,"blocked":false,"audit_risk":"needs_review","permission_hints":[{"id":"network","label":"Network access","reason":"Skill likely fetches remote pages, APIs, repositories, or external services.","severity":"medium"},{"id":"filesystem","label":"Filesystem access","reason":"Skill may read or write project files, documents, generated artifacts, or local workspace state.","severity":"medium"}],"policy_warnings":["Low GitHub adoption signal"],"constraints_applied":{"max_risk":"medium","needs_install_command":true,"min_stars":0}},"safety_gate":{"tier":"reviewed","label":"Reviewed with permission notes","badge":"REVIEWED","auto_install_policy":"review","auto_install_allowed":false,"blocked":false,"human_review_required":true,"recommended_action":"Require human approval before installing into a real workspace.","reasons":["Low GitHub adoption signal","64/100 agent safety score"]},"eval":{"version":"openagentskill-skill-eval-v1","status":"review","score":73,"risk_level":"medium","decision":{"recommendation":"manual_review","reason":"Require human approval before installing into a real workspace.","auto_install_allowed":false,"policy":"review","human_review_required":true},"blockers":[],"warnings":["Trust score: Good trust signals with a few areas worth checking before rollout.","Audit score: Needs review","Agent safety gate: Usable candidate, but the agent should surface permission and audit notes before installation.","Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"],"validation_plan":["Inspect repository, README/SKILL.md, license, and recent commits before production use.","Install in an isolated workspace or sandbox with no production secrets available.","Run the smallest representative task and record files touched, commands run, network access, and outputs.","Compare the selected skill against at least one alternative when the eval status is review or failed.","Promote only after the agent reports a successful verification result and unresolved warnings are accepted."],"checks":[{"id":"task_fit","label":"Task fit","status":"pass","score":84,"required_for_auto_install":true,"detail":"Task wording matches this skill metadata.","evidence":["Evaluate llm-gold-bound-failure-check before installing it in an agent workflow","design-creative","Document processing workflows; Claude Code teams; builders willing to evaluate younger projects"]},{"id":"install_path","label":"Install path","status":"pass","score":92,"required_for_auto_install":true,"detail":"Install handoff is available.","evidence":["npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check"]},{"id":"install_safety","label":"Install command safety","status":"pass","score":92,"required_for_auto_install":true,"detail":"standard package or runtime install path","evidence":["npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check"]},{"id":"trust_score","label":"Trust score","status":"warn","score":79,"required_for_auto_install":true,"detail":"Good trust signals with a few areas worth checking before rollout.","evidence":["Strong shortlist","47 GitHub stars","MIT"]},{"id":"audit_score","label":"Audit score","status":"warn","score":80,"required_for_auto_install":true,"detail":"Needs review","evidence":["Low GitHub adoption signal"]},{"id":"agent_safety_gate","label":"Agent safety gate","status":"warn","score":64,"required_for_auto_install":true,"detail":"Usable candidate, but the agent should surface permission and audit notes before installation.","evidence":["Require human approval before installing into a real workspace.","Low GitHub adoption signal"]},{"id":"readme_skillmd_completeness","label":"README/SKILL.md completeness","status":"pass","score":86,"required_for_auto_install":false,"detail":"Metadata includes enough usage and workflow context","evidence":["Strong README/SKILL.md context"]},{"id":"license_clarity","label":"License clarity","status":"pass","score":86,"required_for_auto_install":true,"detail":"MIT","evidence":["MIT"]},{"id":"recent_maintenance","label":"Recent maintenance","status":"pass","score":100,"required_for_auto_install":false,"detail":"Pushed today","evidence":["Pushed today"]},{"id":"permission_surface","label":"Permission surface","status":"pass","score":86,"required_for_auto_install":true,"detail":"filesystem or document access","evidence":["Network access: medium","Filesystem access: medium"]},{"id":"alternatives","label":"Alternatives available","status":"info","score":55,"required_for_auto_install":false,"detail":"No close alternatives were found in the current shortlist.","evidence":[]}],"endpoints":{"web":"https://www.openagentskill.com/skills/kennethkhoocy-llm-gold-bound-failure-check/evals","api":"/api/agent/evals?slug=kennethkhoocy-llm-gold-bound-failure-check","text":"/api/agent/evals?slug=kennethkhoocy-llm-gold-bound-failure-check&format=text"}},"agent_readable_metadata":{"version":"openagentskill-agent-metadata-v2","skill":{"slug":"kennethkhoocy-llm-gold-bound-failure-check","name":"llm-gold-bound-failure-check","description":"Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND\nbefore spending on prompt revision or model changes. Use when: (1) a scoring\npipeline over-predicts a label (precision low, recall high) and a prompt\nclarification is proposed to tighten it, (2) a pilot/validation gate fails\nand the fix candidates are prompt edits, (3) inter-rater agreement on the\nweak label was already low (κ < ~0.6). Core check: if gold POSITIVES share\nthe exact feature the revision would exclude, no prompt can pass a\ngold-scored gate — recall craters while precision barely moves. Also\ndocuments the verified surgical-pilot design (single-section diff,\ntune/holdout split, pre-registered gate, perturbation check on untouched\nsections).","category":"design-creative","url":"https://www.openagentskill.com/skills/kennethkhoocy-llm-gold-bound-failure-check","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check","github_repo":"kennethkhoocy/applied-micro-skills"},"suited_tasks":["Document processing workflows","Claude Code teams","builders willing to evaluate younger projects","Read uploaded files","Extract structured fields","Prepare clean context for downstream agents","Navigate pages","Click and type safely"],"suited_agents":["Codex","Claude Code","Cursor","OpenAgentSkill CLI","CLI"],"install":{"command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","ready":true,"targets":[{"id":"openagentskill-cli","label":"CLI","kind":"command","value":"npx --yes https://github.com/Leon-Drq/openagentskill/releases/download/cli-v0.2.1/openagentskill-0.2.1.tgz install kennethkhoocy-llm-gold-bound-failure-check"},{"id":"codex","label":"Codex","kind":"agent-prompt","value":"Install the \"llm-gold-bound-failure-check\" agent skill from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND before spending on prompt revision or model changes. Use when: (1) a scoring pipeline over-predicts a label (precision low, recall high) and a prompt clarification is proposed to tighten it, (2) a pilot/validation gate fails and the fix candidates are prompt edits, (3) inter-rater agreement on the weak label was already low (κ < ~0.6). Core check: if gold POSITIVES share the exact feature the revision would exclude, no prompt can pass a gold-scored gate — recall craters while precision barely moves. Also documents the verified surgical-pilot design (single-section diff, tune/holdout split, pre-registered gate, perturbation check on untouched sections). After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-gold-bound-failure-check\",\"task\":\"Install llm-gold-bound-failure-check\",\"agent\":\"codex\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes."},{"id":"claude-code","label":"Claude Code","kind":"agent-prompt","value":"Add \"llm-gold-bound-failure-check\" as a Claude Code skill from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND before spending on prompt revision or model changes. Use when: (1) a scoring pipeline over-predicts a label (precision low, recall high) and a prompt clarification is proposed to tighten it, (2) a pilot/validation gate fails and the fix candidates are prompt edits, (3) inter-rater agreement on the weak label was already low (κ < ~0.6). Core check: if gold POSITIVES share the exact feature the revision would exclude, no prompt can pass a gold-scored gate — recall craters while precision barely moves. Also documents the verified surgical-pilot design (single-section diff, tune/holdout split, pre-registered gate, perturbation check on untouched sections). After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-gold-bound-failure-check\",\"task\":\"Install llm-gold-bound-failure-check\",\"agent\":\"claude-code\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes."},{"id":"cursor","label":"Cursor","kind":"agent-prompt","value":"Turn \"llm-gold-bound-failure-check\" from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND before spending on prompt revision or model changes. Use when: (1) a scoring pipeline over-predicts a label (precision low, recall high) and a prompt clarification is proposed to tighten it, (2) a pilot/validation gate fails and the fix candidates are prompt edits, (3) inter-rater agreement on the weak label was already low (κ < ~0.6). Core check: if gold POSITIVES share the exact feature the revision would exclude, no prompt can pass a gold-scored gate — recall craters while precision barely moves. Also documents the verified surgical-pilot design (single-section diff, tune/holdout split, pre-registered gate, perturbation check on untouched sections). After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-gold-bound-failure-check\",\"task\":\"Install llm-gold-bound-failure-check\",\"agent\":\"cursor\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes."}],"handoff_url":"https://www.openagentskill.com/api/skills/kennethkhoocy-llm-gold-bound-failure-check/install","manifest_url":"https://www.openagentskill.com/api/registry/manifest/kennethkhoocy-llm-gold-bound-failure-check"},"trust":{"score":79,"label":"Strong shortlist","version":"trust-score-v4","install_policy":"human_review_before_install","evidence":{"stars":"47 GitHub stars","repoActivity":"47 stars, 0 forks","lastPushed":"Pushed today","license":"MIT","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check","install":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","installSafety":"standard package or runtime install path","permissionSurface":"filesystem or document access","documentation":"Strong README/SKILL.md context","agentOutcomes":"No agent outcome data yet"},"outcome_evidence":{"total":0,"successes":0,"failures":0,"not_relevant":0,"success_rate":null,"recent_success_rate":null,"recent_failure_rate":null,"install_attempts":0,"install_success_rate":null,"risk_blocked":0,"setup_required":0,"avg_output_quality":null,"production_outcomes":0,"last_outcome_at":null,"label":"No agent outcome data yet"},"auto_install":{"allowed":false,"sandbox_required":true,"reason":"Human review or sandbox validation is required before automatic installation."},"best_for":["design-creative","agent-skill"],"known_risks":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"agent_proven":{"version":"agent-proven-v1","score":0,"tier":"unproven","label":"Needs first agent run","summary":"No agent outcome reports yet. Use Resolve, run one narrow sandbox task, then report the result.","metrics":{"totalOutcomes":0,"successfulOutcomes":0,"failedOutcomes":0,"installAttempts":0,"installSuccessRate":null,"successRate":null,"recentSuccessRate":null,"recentFailureRate":null,"riskBlocked":0,"setupRequired":0,"notRelevant":0,"avgOutputQuality":null,"avgTimeToUsefulMs":null,"productionOutcomes":0,"humanReviewRequired":0,"uniqueAgents":0,"lastOutcomeAt":null},"signals":[],"penalties":["No real agent outcome evidence yet"]},"audit":{"score":80,"risk_level":"needs_review","risk_label":"Needs review","warnings":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"safety_gate":{"tier":"reviewed","label":"Reviewed with permission notes","auto_install_policy":"review","auto_install_allowed":false,"human_review_required":true,"blocked":false,"recommended_action":"Require human approval before installing into a real workspace."},"quality":{"score":64,"label":"Promising"},"supply":{"track":"Design and creative production","scenario":"Design and creative","maintenance":"Pushed today","risk":"Needs review"},"alternative_skills":[],"do_not_use_when":["teams that need a vendor-supported SLA","production agents without a repository review","Low GitHub adoption signal","No OpenAgentSkill engagement data yet","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata","Production credentials, payments, or irreversible account changes without explicit human review"],"agent_contract":{"task_input":"Use llm-gold-bound-failure-check in an agent workflow","recommended_action":"Require human approval before installing into a real workspace.","install_policy":"review","minimum_review_before_use":["Trust: 79/100 Strong shortlist","Audit: 80/100 Needs review","Safety: 64/100 Review before install","Review repository, license, install command, and permission surface before production use."],"expected_agent_output":{"selected_skill":"kennethkhoocy-llm-gold-bound-failure-check (llm-gold-bound-failure-check)","install_command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","risk_summary":"Needs review; Reviewed with permission notes; Review before production","verification_result":"Report the smallest successful task, files touched, warnings, and any missing setup."}},"outcome_feedback":{"endpoint":"https://www.openagentskill.com/api/agent/outcome","method":"POST","requires_resolve_event_id":true,"event_id_source":"Use install_receipt.outcome_feedback.event_id or feedback.event_id returned by /api/agent/resolve for the current task.","expected_outcomes":["success","failed","not_relevant","blocked_by_risk","setup_required"],"payload_template":{"event_id":"<install_receipt.outcome_feedback.event_id or feedback.event_id from /api/agent/resolve>","skill_slug":"kennethkhoocy-llm-gold-bound-failure-check","task":"Use llm-gold-bound-failure-check in an agent workflow","agent":"codex","outcome":"success","install_used":true,"risk_blocked":false,"setup_required":false,"task_success":true,"output_quality":4,"error_type":null,"human_review_required":false,"workspace":"sandbox","time_to_useful_ms":120000,"notes":"Report the smallest successful task, setup friction, files touched, and risk notes."}},"endpoints":{"web":"https://www.openagentskill.com/skills/kennethkhoocy-llm-gold-bound-failure-check","api":"https://www.openagentskill.com/api/agent/skills/kennethkhoocy-llm-gold-bound-failure-check","audit":"https://www.openagentskill.com/skills/kennethkhoocy-llm-gold-bound-failure-check/audit","eval":"https://www.openagentskill.com/api/agent/evals?slug=kennethkhoocy-llm-gold-bound-failure-check&task=Use%20llm-gold-bound-failure-check%20in%20an%20agent%20workflow&max_risk=medium","resolve":"https://www.openagentskill.com/api/agent/resolve?task=Use%20llm-gold-bound-failure-check%20in%20an%20agent%20workflow&agent=codex&max_risk=medium","receipt":"https://www.openagentskill.com/api/agent/receipt?task=Use%20llm-gold-bound-failure-check%20in%20an%20agent%20workflow&agent=codex&max_risk=medium&format=text","install":"https://www.openagentskill.com/api/skills/kennethkhoocy-llm-gold-bound-failure-check/install","manifest":"https://www.openagentskill.com/api/registry/manifest/kennethkhoocy-llm-gold-bound-failure-check"}},"machine_metadata":{"version":"openagentskill-agent-metadata-v2","skill":{"slug":"kennethkhoocy-llm-gold-bound-failure-check","name":"llm-gold-bound-failure-check","description":"Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND\nbefore spending on prompt revision or model changes. Use when: (1) a scoring\npipeline over-predicts a label (precision low, recall high) and a prompt\nclarification is proposed to tighten it, (2) a pilot/validation gate fails\nand the fix candidates are prompt edits, (3) inter-rater agreement on the\nweak label was already low (κ < ~0.6). Core check: if gold POSITIVES share\nthe exact feature the revision would exclude, no prompt can pass a\ngold-scored gate — recall craters while precision barely moves. Also\ndocuments the verified surgical-pilot design (single-section diff,\ntune/holdout split, pre-registered gate, perturbation check on untouched\nsections).","category":"design-creative","url":"https://www.openagentskill.com/skills/kennethkhoocy-llm-gold-bound-failure-check","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check","github_repo":"kennethkhoocy/applied-micro-skills"},"suited_tasks":["Document processing workflows","Claude Code teams","builders willing to evaluate younger projects","Read uploaded files","Extract structured fields","Prepare clean context for downstream agents","Navigate pages","Click and type safely"],"suited_agents":["Codex","Claude Code","Cursor","OpenAgentSkill CLI","CLI"],"install":{"command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","ready":true,"targets":[{"id":"openagentskill-cli","label":"CLI","kind":"command","value":"npx --yes https://github.com/Leon-Drq/openagentskill/releases/download/cli-v0.2.1/openagentskill-0.2.1.tgz install kennethkhoocy-llm-gold-bound-failure-check"},{"id":"codex","label":"Codex","kind":"agent-prompt","value":"Install the \"llm-gold-bound-failure-check\" agent skill from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND before spending on prompt revision or model changes. Use when: (1) a scoring pipeline over-predicts a label (precision low, recall high) and a prompt clarification is proposed to tighten it, (2) a pilot/validation gate fails and the fix candidates are prompt edits, (3) inter-rater agreement on the weak label was already low (κ < ~0.6). Core check: if gold POSITIVES share the exact feature the revision would exclude, no prompt can pass a gold-scored gate — recall craters while precision barely moves. Also documents the verified surgical-pilot design (single-section diff, tune/holdout split, pre-registered gate, perturbation check on untouched sections). After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-gold-bound-failure-check\",\"task\":\"Install llm-gold-bound-failure-check\",\"agent\":\"codex\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes."},{"id":"claude-code","label":"Claude Code","kind":"agent-prompt","value":"Add \"llm-gold-bound-failure-check\" as a Claude Code skill from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND before spending on prompt revision or model changes. Use when: (1) a scoring pipeline over-predicts a label (precision low, recall high) and a prompt clarification is proposed to tighten it, (2) a pilot/validation gate fails and the fix candidates are prompt edits, (3) inter-rater agreement on the weak label was already low (κ < ~0.6). Core check: if gold POSITIVES share the exact feature the revision would exclude, no prompt can pass a gold-scored gate — recall craters while precision barely moves. Also documents the verified surgical-pilot design (single-section diff, tune/holdout split, pre-registered gate, perturbation check on untouched sections). After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-gold-bound-failure-check\",\"task\":\"Install llm-gold-bound-failure-check\",\"agent\":\"claude-code\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes."},{"id":"cursor","label":"Cursor","kind":"agent-prompt","value":"Turn \"llm-gold-bound-failure-check\" from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND before spending on prompt revision or model changes. Use when: (1) a scoring pipeline over-predicts a label (precision low, recall high) and a prompt clarification is proposed to tighten it, (2) a pilot/validation gate fails and the fix candidates are prompt edits, (3) inter-rater agreement on the weak label was already low (κ < ~0.6). Core check: if gold POSITIVES share the exact feature the revision would exclude, no prompt can pass a gold-scored gate — recall craters while precision barely moves. Also documents the verified surgical-pilot design (single-section diff, tune/holdout split, pre-registered gate, perturbation check on untouched sections). After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-gold-bound-failure-check\",\"task\":\"Install llm-gold-bound-failure-check\",\"agent\":\"cursor\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes."}],"handoff_url":"https://www.openagentskill.com/api/skills/kennethkhoocy-llm-gold-bound-failure-check/install","manifest_url":"https://www.openagentskill.com/api/registry/manifest/kennethkhoocy-llm-gold-bound-failure-check"},"trust":{"score":79,"label":"Strong shortlist","version":"trust-score-v4","install_policy":"human_review_before_install","evidence":{"stars":"47 GitHub stars","repoActivity":"47 stars, 0 forks","lastPushed":"Pushed today","license":"MIT","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check","install":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","installSafety":"standard package or runtime install path","permissionSurface":"filesystem or document access","documentation":"Strong README/SKILL.md context","agentOutcomes":"No agent outcome data yet"},"outcome_evidence":{"total":0,"successes":0,"failures":0,"not_relevant":0,"success_rate":null,"recent_success_rate":null,"recent_failure_rate":null,"install_attempts":0,"install_success_rate":null,"risk_blocked":0,"setup_required":0,"avg_output_quality":null,"production_outcomes":0,"last_outcome_at":null,"label":"No agent outcome data yet"},"auto_install":{"allowed":false,"sandbox_required":true,"reason":"Human review or sandbox validation is required before automatic installation."},"best_for":["design-creative","agent-skill"],"known_risks":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"agent_proven":{"version":"agent-proven-v1","score":0,"tier":"unproven","label":"Needs first agent run","summary":"No agent outcome reports yet. Use Resolve, run one narrow sandbox task, then report the result.","metrics":{"totalOutcomes":0,"successfulOutcomes":0,"failedOutcomes":0,"installAttempts":0,"installSuccessRate":null,"successRate":null,"recentSuccessRate":null,"recentFailureRate":null,"riskBlocked":0,"setupRequired":0,"notRelevant":0,"avgOutputQuality":null,"avgTimeToUsefulMs":null,"productionOutcomes":0,"humanReviewRequired":0,"uniqueAgents":0,"lastOutcomeAt":null},"signals":[],"penalties":["No real agent outcome evidence yet"]},"audit":{"score":80,"risk_level":"needs_review","risk_label":"Needs review","warnings":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"safety_gate":{"tier":"reviewed","label":"Reviewed with permission notes","auto_install_policy":"review","auto_install_allowed":false,"human_review_required":true,"blocked":false,"recommended_action":"Require human approval before installing into a real workspace."},"quality":{"score":64,"label":"Promising"},"supply":{"track":"Design and creative production","scenario":"Design and creative","maintenance":"Pushed today","risk":"Needs review"},"alternative_skills":[],"do_not_use_when":["teams that need a vendor-supported SLA","production agents without a repository review","Low GitHub adoption signal","No OpenAgentSkill engagement data yet","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata","Production credentials, payments, or irreversible account changes without explicit human review"],"agent_contract":{"task_input":"Use llm-gold-bound-failure-check in an agent workflow","recommended_action":"Require human approval before installing into a real workspace.","install_policy":"review","minimum_review_before_use":["Trust: 79/100 Strong shortlist","Audit: 80/100 Needs review","Safety: 64/100 Review before install","Review repository, license, install command, and permission surface before production use."],"expected_agent_output":{"selected_skill":"kennethkhoocy-llm-gold-bound-failure-check (llm-gold-bound-failure-check)","install_command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","risk_summary":"Needs review; Reviewed with permission notes; Review before production","verification_result":"Report the smallest successful task, files touched, warnings, and any missing setup."}},"outcome_feedback":{"endpoint":"https://www.openagentskill.com/api/agent/outcome","method":"POST","requires_resolve_event_id":true,"event_id_source":"Use install_receipt.outcome_feedback.event_id or feedback.event_id returned by /api/agent/resolve for the current task.","expected_outcomes":["success","failed","not_relevant","blocked_by_risk","setup_required"],"payload_template":{"event_id":"<install_receipt.outcome_feedback.event_id or feedback.event_id from /api/agent/resolve>","skill_slug":"kennethkhoocy-llm-gold-bound-failure-check","task":"Use llm-gold-bound-failure-check in an agent workflow","agent":"codex","outcome":"success","install_used":true,"risk_blocked":false,"setup_required":false,"task_success":true,"output_quality":4,"error_type":null,"human_review_required":false,"workspace":"sandbox","time_to_useful_ms":120000,"notes":"Report the smallest successful task, setup friction, files touched, and risk notes."}},"endpoints":{"web":"https://www.openagentskill.com/skills/kennethkhoocy-llm-gold-bound-failure-check","api":"https://www.openagentskill.com/api/agent/skills/kennethkhoocy-llm-gold-bound-failure-check","audit":"https://www.openagentskill.com/skills/kennethkhoocy-llm-gold-bound-failure-check/audit","eval":"https://www.openagentskill.com/api/agent/evals?slug=kennethkhoocy-llm-gold-bound-failure-check&task=Use%20llm-gold-bound-failure-check%20in%20an%20agent%20workflow&max_risk=medium","resolve":"https://www.openagentskill.com/api/agent/resolve?task=Use%20llm-gold-bound-failure-check%20in%20an%20agent%20workflow&agent=codex&max_risk=medium","receipt":"https://www.openagentskill.com/api/agent/receipt?task=Use%20llm-gold-bound-failure-check%20in%20an%20agent%20workflow&agent=codex&max_risk=medium&format=text","install":"https://www.openagentskill.com/api/skills/kennethkhoocy-llm-gold-bound-failure-check/install","manifest":"https://www.openagentskill.com/api/registry/manifest/kennethkhoocy-llm-gold-bound-failure-check"}},"supply_profile":{"track":{"slug":"design","label":"Design and creative production","shortLabel":"Design","description":"Design assets, images, video, audio, multimodal media, presentation, and creative production skills."},"scenario":{"label":"Design and creative","description":"I need my agent to produce design assets, UI directions, presentations, or creative media workflows.","useCases":[{"slug":"document-processing","title":"Document processing"},{"slug":"browser-automation","title":"Browser automation"},{"slug":"research-agents","title":"Research agents"}]},"applicableAgents":["Claude Code","CLI","Codex","Cursor"],"install":{"ready":true,"command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","primaryTarget":"CLI","targetCount":4},"githubQuality":{"stars":47,"starsLabel":"47","forks":0,"license":"MIT","qualityScore":64,"trustScore":79,"auditScore":80},"maintenance":{"status":"fresh","label":"Pushed today","daysSincePush":0,"lastPushedAt":"2026-08-24T03:17:05+00:00"},"risk":{"level":"needs_review","label":"Needs review","requiresReview":true,"notes":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata","Needs review"]},"coverageTags":["Design","Design and creative","design-creative","agent-skill"]},"audit":{"audit_score":80,"risk_level":"needs_review","risk_label":"Needs review","quality_score":64,"trust_score":79,"maintenance_score":100,"security_score":86,"install_score":92,"warnings":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"quality_signals":{"model":"v2","star_score":11.77,"usage_score":0,"review_score":5.7,"metadata_score":3,"freshness_score":15},"platforms":["Claude Code"],"use_cases":[{"slug":"document-processing","title":"Document processing","url":"https://www.openagentskill.com/use-cases/document-processing"},{"slug":"browser-automation","title":"Browser automation","url":"https://www.openagentskill.com/use-cases/browser-automation"},{"slug":"research-agents","title":"Research agents","url":"https://www.openagentskill.com/use-cases/research-agents"},{"slug":"sports-analytics","title":"Sports analytics","url":"https://www.openagentskill.com/use-cases/sports-analytics"}],"stacks":[{"slug":"frontend-product-ui","title":"Frontend and UI","url":"https://www.openagentskill.com/collections/frontend-product-ui"},{"slug":"browser-qa-agent","title":"Browser QA agent","url":"https://www.openagentskill.com/collections/browser-qa-agent"},{"slug":"research-report-agent","title":"Research report agent","url":"https://www.openagentskill.com/collections/research-report-agent"}],"install":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-gold-bound-failure-check","install_targets":[{"id":"openagentskill-cli","label":"CLI","title":"OpenAgentSkill CLI","kind":"command","value":"npx --yes https://github.com/Leon-Drq/openagentskill/releases/download/cli-v0.2.1/openagentskill-0.2.1.tgz install kennethkhoocy-llm-gold-bound-failure-check","description":"Resolve policy, run the source installer safely, and report a verified install receipt.","copyLabel":"Copy command"},{"id":"codex","label":"Codex","title":"Codex install prompt","kind":"agent-prompt","value":"Install the \"llm-gold-bound-failure-check\" agent skill from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND before spending on prompt revision or model changes. Use when: (1) a scoring pipeline over-predicts a label (precision low, recall high) and a prompt clarification is proposed to tighten it, (2) a pilot/validation gate fails and the fix candidates are prompt edits, (3) inter-rater agreement on the weak label was already low (κ < ~0.6). Core check: if gold POSITIVES share the exact feature the revision would exclude, no prompt can pass a gold-scored gate — recall craters while precision barely moves. Also documents the verified surgical-pilot design (single-section diff, tune/holdout split, pre-registered gate, perturbation check on untouched sections). After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-gold-bound-failure-check\",\"task\":\"Install llm-gold-bound-failure-check\",\"agent\":\"codex\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes.","description":"Give Codex a repo-aware install prompt when the skill is not available through a local CLI.","copyLabel":"Copy prompt"},{"id":"claude-code","label":"Claude Code","title":"Claude Code skill prompt","kind":"agent-prompt","value":"Add \"llm-gold-bound-failure-check\" as a Claude Code skill from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND before spending on prompt revision or model changes. Use when: (1) a scoring pipeline over-predicts a label (precision low, recall high) and a prompt clarification is proposed to tighten it, (2) a pilot/validation gate fails and the fix candidates are prompt edits, (3) inter-rater agreement on the weak label was already low (κ < ~0.6). Core check: if gold POSITIVES share the exact feature the revision would exclude, no prompt can pass a gold-scored gate — recall craters while precision barely moves. Also documents the verified surgical-pilot design (single-section diff, tune/holdout split, pre-registered gate, perturbation check on untouched sections). After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-gold-bound-failure-check\",\"task\":\"Install llm-gold-bound-failure-check\",\"agent\":\"claude-code\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes.","description":"Use this prompt to ask Claude Code to add the skill and explain the local activation steps.","copyLabel":"Copy prompt"},{"id":"cursor","label":"Cursor","title":"Cursor rule prompt","kind":"agent-prompt","value":"Turn \"llm-gold-bound-failure-check\" from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: Diagnose whether an LLM classifier's validation-gate failure is GOLD-BOUND before spending on prompt revision or model changes. Use when: (1) a scoring pipeline over-predicts a label (precision low, recall high) and a prompt clarification is proposed to tighten it, (2) a pilot/validation gate fails and the fix candidates are prompt edits, (3) inter-rater agreement on the weak label was already low (κ < ~0.6). Core check: if gold POSITIVES share the exact feature the revision would exclude, no prompt can pass a gold-scored gate — recall craters while precision barely moves. Also documents the verified surgical-pilot design (single-section diff, tune/holdout split, pre-registered gate, perturbation check on untouched sections). After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-gold-bound-failure-check\",\"task\":\"Install llm-gold-bound-failure-check\",\"agent\":\"cursor\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes.","description":"Use this when installing as Cursor project rules or reusable agent instructions.","copyLabel":"Copy prompt"}],"repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check","github_repo":"kennethkhoocy/applied-micro-skills","version":"1.0.0","license":"MIT","urls":{"web":"https://www.openagentskill.com/skills/kennethkhoocy-llm-gold-bound-failure-check","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-gold-bound-failure-check","api":"/api/agent/skills/kennethkhoocy-llm-gold-bound-failure-check","install_api":"/api/skills/kennethkhoocy-llm-gold-bound-failure-check/install"},"meta":{"created_at":"2026-08-24T05:36:34.665541+00:00","updated_at":"2026-08-24T05:36:34.665541+00:00","agent_friendly":true}}