{"slug":"kennethkhoocy-llm-campaign-drift-gate","name":"llm-campaign-drift-gate","description":"Gate resumption of any multi-day LLM batch-scoring campaign that calls an\nunpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any\nprovider alias without a pinned version). Use when: (1) resuming a paused or\ncredit-exhausted scoring run days after its last chunk, (2) topping up\ncredits to finish a campaign, (3) extending a cached scoring pipeline with\nnew items. Prevents silently splicing two model versions or serving\nrevisions into one measure. Verified 2026-07-16: for $0.30 caught a\nserving-revision drift WITHIN DeepSeek v4-flash (same alias, same family,\nlitigation scores systematically shifted across a 2-day gap) before an $83\nresume spend.","long_description":"---\nname: llm-campaign-drift-gate\ndescription: |\n  Gate resumption of any multi-day LLM batch-scoring campaign that calls an\n  unpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any\n  provider alias without a pinned version). Use when: (1) resuming a paused or\n  credit-exhausted scoring run days after its last chunk, (2) topping up\n  credits to finish a campaign, (3) extending a cached scoring pipeline with\n  new items. Prevents silently splicing two model versions or serving\n  revisions into one measure. Verified 2026-07-16: for $0.30 caught a\n  serving-revision drift WITHIN DeepSeek v4-flash (same alias, same family,\n  litigation scores systematically shifted across a 2-day gap) before an $83\n  resume spend.\nauthor: Claude Code\nversion: 1.1.0\ndate: 2026-07-16\n---\n\n# LLM Campaign Drift Gate\n\n## Problem\n\nBatch-scoring campaigns (exposure measures, classifiers, extraction runs) call\nprovider aliases that can be silently repointed to a new model at any time.\nResuming a half-finished campaign after the alias moves splices two different\nscorers into one variable, with the version boundary correlated with whatever\norders the chunks (time, firm id) — a silent confound. Providers can also\nRETIRE the old model entirely, making the original campaign uncompletable.\n\n## Context / Trigger Conditions\n\n- Resuming a scoring run more than ~a day after its last paid chunk\n- \"Top up credits and finish the run\" requests\n- Any incremental scoring against an existing response cache\n- Symptom of a missed gate: a step-change in scores at a resume boundary\n\n## Solution\n\nBefore ANY production spend on resume, run a two-part gate (~$0.30–2):\n\n1. **Canary (the decisive check):** sample ~100 already-cached items, re-send\n   their EXACT stored prompts fresh, compare fresh vs cached scores. Gate:\n   ≥97% all-field exact match and no systematic directional shift. Write the\n   comparison in a standalone script — never through the pipeline's cache\n   layer, which would overwrite production entries.\n2. **Gold re-validation:** re-score the gold/validation panel fresh and compare\n   agreement metrics to the prior validation (e.g. median F1/κ within ~0.03,\n   no domain dropping >0.10).\n\nAlso capture `response.model` on every gate call — pipelines rarely store it,\nand it is the only direct evidence of a repoint. Check the provider's\n`/models` endpoint: if the old model id is gone, no rollback exists.\n\n3. **If the canary fails, diagnose BEFORE concluding — two mandatory\n   follow-ups:**\n   - **Date the suspected flip against the provider's changelog** before\n     inferring a model splice. `response.model` on fresh calls identifies\n     today's model only; if the alias already pointed there when the cache was\n     written, there is no family splice and the mismatch needs another\n     explanation. (Verified failure mode: an alias that had served the \"new\"\n     model for months was misread as a fresh repoint.)\n   - **Fresh-vs-fresh canary** to separate serving drift from temperature-0\n     nondeterminism: re-score the same items a second time. Drift signature =\n     fresh2-vs-fresh1 agreement high and symmetric while both fresh runs\n     disagree with the cache at a higher rate in the SAME signed direction.\n     Noise signature = fresh-vs-fresh disagrees about as much as\n     fresh-vs-cache, with no directional bias.\n   - Supporting forensic: compare raw-response formatting fingerprints\n     (JSON pretty/compact ratio, key order) between cache and fresh — a\n     heterogeneous or shifted style distribution corroborates a serving\n     change when no model id was recorded.\n\n**Key subtlety (why both checks):** a new model or revision can validate\nAGAINST GOLD as well as the old one (κ holds or improves) while still\ndisagreeing with the old scores on 10–30% of items, concentrated in\nborderline-heavy fields. Gold agreement does not license splicing — the gate\nfails on the canary alone. And alias stability is not serving stability:\nthe same alias serving the same model family can still drift across days via\nsilent serving revisions; a canary-failed resume is a seam either way, and\nthe decision (resume with a documented seam vs re-score the universe) belongs\nto the budget owner.\n\n## Verification\n\nThe gate script logs: fresh `response.model` ids, canary exact-match rate,\nper-field mismatch counts with signed direction, and the gold-metric deltas.\nGO only if both checks pass.\n\n## Example\n\nT1 exposure_v2 resume, 2026-07-16: canary returned 71% exact (gate ≥97%) with\na litigation-concentrated negative shift, yet holdout median κ improved\n0.607→0.644. First interpretation — \"alias repointed to a new model family\" —\nwas WRONG: the provider changelog showed `deepseek-chat` had served v4-flash\nsince April, months before the campaign. The fresh-vs-fresh follow-up then\nisolated the true cause: fresh2-vs-fresh1 93% exact/symmetric/litigation 0,\nboth fresh runs vs cache 71–72% with litigation −12 identically — a serving\nrevision within the same model across a 2-day gap, corroborated by a shifted\nJSON-formatting fingerprint. Total diagnosis cost ~$0.30; the resume-vs-rescore\ndecision went to the budget owner with the seam quantified.\n\n## Notes\n\n- Design campaigns for this failure: per-response content-addressed cache +\n  append-only checkpoint makes \"re-score everything under the new model\" a\n  clean cache-rotation, not a data loss.\n- If the cache key embeds the alias string rather than the resolved model,\n  record actual `response.model` in run reports — the cache cannot tell you\n  later which model produced an entry.\n- One campaign = one model. Budget and schedule so the universe completes\n  within days, or accept that a provider release can force a full re-score.\n- See also: [llm-gold-bound-failure-check] for the companion pre-campaign\n  check — whether a validation-gate failure is fixable by prompt at all, or\n  bound to the gold construct.\n","tagline":"Gate resumption of any multi-day LLM batch-scoring campaign that calls an\nunpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any\nprovider alias without a pinned version). Use when: (1) resuming a paused or\ncredit-exhausted scoring run days after its last chunk, ","category":"coding-agents","tags":["agent-skill"],"author":"Claude Code","verified":false,"attribution":{"status":"registry_indexed","statusLabel":"Registry indexed","shortLabel":"REGISTRY INDEXED","sourceLabel":"recursive skill source sync","sourceDetail":"kennethkhoocy/applied-micro-skills","creatorName":"Claude Code","creatorUrl":"https://github.com/kennethkhoocy","sourceUrl":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate","indexedBy":"OpenAgentSkill community index","claimUrl":"https://www.openagentskill.com/skills/kennethkhoocy-llm-campaign-drift-gate#claim-this-skill","claimCta":"Claim this skill","trustNote":"This listing was indexed from public sources and is not marked official until a maintainer claim is approved.","publicNote":"Attribution links to the public repository or creator profile. Creators can claim the listing to update ownership signals."},"stats":{"stars":47,"forks":0,"verified_installs":0,"successful_runs":0,"total_outcomes":0,"rating":0,"review_count":0,"quality_score":35.17},"quality":{"score":64,"tier":"promising","label":"Promising","summary":"Useful candidate, but compare it with alternatives before adopting.","signals":[{"label":"GitHub stars","value":"47","tone":"neutral"},{"label":"Freshness","value":"Today","tone":"positive"},{"label":"Install ready","value":"Yes","tone":"positive"},{"label":"License","value":"MIT","tone":"neutral"}],"warnings":["Low GitHub adoption signal"]},"trust":{"version":"trust-score-v5","score":71,"base_score":79,"outcome_confidence":0,"tier":"review","label":"Sandbox only","summary":"Useful candidate with missing or mixed trust signals. Keep it in an isolated workspace until the outcome loop proves task fit.","recommendedAction":"Run only in a sandbox and compare close alternatives before using it for real work.","decision":{"install_policy":"human_review_before_install","auto_install_allowed":false,"human_review_required":true,"sandbox_first":true,"agent_action":"Compare alternatives before installing.","reasoning":["71/100 Trust Score v5","79/100 Trust Score v4 baseline","Needs more real agent outcomes before unattended install","Install path is available","Review before production"],"review_required_when":["The workspace contains production secrets, payments, private customer data, or irreversible actions.","The install command requests shell, network, credential, database, or broad filesystem access.","Outcome evidence is missing, recently failed, or required human review.","Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"]},"dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":48,"weight":0.13,"status":"warn","detail":"47 GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":43,"weight":0.08,"status":"warn","detail":"47 stars, 0 forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"Pushed today"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"MIT"},{"id":"documentation","label":"README/SKILL.md completeness","score":86,"weight":0.14,"status":"pass","detail":"Metadata includes enough usage and workflow context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":90,"weight":0.12,"status":"pass","detail":"no major dependency risk hints in public metadata"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":100,"weight":0.07,"status":"pass","detail":"no high-risk permission surface in public metadata"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"},{"id":"agent_outcomes","label":"Agent Proven outcomes","score":54,"weight":0.13,"status":"info","detail":"No agent outcome data yet"}],"checks":[{"status":"warn","label":"GitHub adoption","detail":"47 GitHub stars"},{"status":"warn","label":"Stars/forks activity","detail":"47 stars, 0 forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"Pushed today"},{"status":"pass","label":"License clarity","detail":"MIT"},{"status":"pass","label":"README/SKILL.md completeness","detail":"Metadata includes enough usage and workflow context"},{"status":"pass","label":"Dependency/runtime risk","detail":"no major dependency risk hints in public metadata"},{"status":"pass","label":"Install availability","detail":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"pass","label":"Permission surface","detail":"no high-risk permission surface in public metadata"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"info","label":"Agent Proven outcomes","detail":"No agent outcome data yet"},{"status":"warn","label":"Ownership","detail":"No approved owner claim yet"},{"status":"pass","label":"OpenAgentSkill usage","detail":"2 views, 0 install copies"},{"status":"info","label":"Agent outcomes","detail":"No agent outcome data yet"}],"strengths":["AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Install command has no obvious high-risk pattern","Outcome loop is ready but needs first real agent run"],"warnings":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata","No real agent outcome reports yet","Human review required before unattended installation"],"evidence":{"stars":"47 GitHub stars","repoActivity":"47 stars, 0 forks","lastPushed":"Pushed today","license":"MIT","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate","install":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","installSafety":"standard package or runtime install path","permissionSurface":"no high-risk permission surface in public metadata","documentation":"Strong README/SKILL.md context","agentOutcomes":"No agent outcome data yet","agentProvenScore":0,"outcomeConfidence":"0%","installPolicy":"human_review_before_install"},"installReadiness":{"ready":true,"command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","policy":"human_review_before_install","label":"Human review before install","notes":["Install path is available","Repository evidence is available","License is declared","No Agent Proven outcome evidence yet","Pushed today","Trust Score v5 requires review or sandbox-only use before install."]},"agentCompatibility":["Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"medium","label":"Review before production","notes":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"outcomeEvidence":{"total":0,"successes":0,"failures":0,"notRelevant":0,"successRate":null,"installAttempts":0,"riskBlocked":0,"setupRequired":0,"installSuccessRate":null,"avgOutputQuality":null,"avgTimeToUsefulMs":null,"productionOutcomes":0,"humanReviewRequired":0,"recentSuccessRate":null,"recentFailureRate":null,"uniqueAgents":0,"agentProvenScore":0,"agentProvenLabel":"Needs first agent run","lastOutcomeAt":null,"label":"No agent outcome data yet"},"autoInstall":{"allowed":false,"sandboxRequired":true,"policy":"human_review_before_install","reason":"Compare alternatives before installing."},"outcome_loop":{"version":"openagentskill-agent-outcome-v3","required_after_install":true,"endpoint":"/api/agent/outcome","method":"POST","event_id_source":"feedback.event_id, install_receipt.resolve_event_id, or decision_packet.outcome_feedback.event_id","expected_outcomes":["success","failed","not_relevant","blocked_by_risk","setup_required"],"required_fields":["event_id","skill_slug","task"],"quality_fields":["task_success","output_quality","error_type","human_review_required","used_in_production","workspace","evidence_url","time_to_useful_ms"],"ranking_inputs_updated":["Trust Score v5 outcome confidence","Agent Proven Score","Resolve ranking task-fit evidence","Skill detail machine-readable metadata","Outcome leaderboard"]},"agent_contract":{"suited_tasks":["coding-agents","agent-skill"],"suited_agents":["Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"install_command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","trust_score":71,"trust_version":"trust-score-v5","risk_level":"medium","do_not_use_when":["Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"],"before_install":["Read the audit page and machine-readable metadata.","Confirm the install command, license, and permission surface fit the workspace.","Get explicit human approval or choose an alternative before installing."],"after_run":["Report the outcome to /api/agent/outcome using the resolve event id.","Include output_quality, workspace, human_review_required, and evidence_url when available.","Re-resolve before broad production rollout."]},"bestFor":["coding-agents","agent-skill"],"doNotUseFor":["Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"],"knownRisks":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"],"backward_compatible":{"trust_score_v4":{"version":"trust-score-v4","score":79,"tier":"strong","label":"Strong shortlist","summary":"Good trust signals with a few areas worth checking before rollout."}}},"trust_score_v5":{"version":"trust-score-v5","score":71,"base_score":79,"outcome_confidence":0,"tier":"review","label":"Sandbox only","summary":"Useful candidate with missing or mixed trust signals. Keep it in an isolated workspace until the outcome loop proves task fit.","recommendedAction":"Run only in a sandbox and compare close alternatives before using it for real work.","decision":{"install_policy":"human_review_before_install","auto_install_allowed":false,"human_review_required":true,"sandbox_first":true,"agent_action":"Compare alternatives before installing.","reasoning":["71/100 Trust Score v5","79/100 Trust Score v4 baseline","Needs more real agent outcomes before unattended install","Install path is available","Review before production"],"review_required_when":["The workspace contains production secrets, payments, private customer data, or irreversible actions.","The install command requests shell, network, credential, database, or broad filesystem access.","Outcome evidence is missing, recently failed, or required human review.","Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"]},"dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":48,"weight":0.13,"status":"warn","detail":"47 GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":43,"weight":0.08,"status":"warn","detail":"47 stars, 0 forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"Pushed today"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"MIT"},{"id":"documentation","label":"README/SKILL.md completeness","score":86,"weight":0.14,"status":"pass","detail":"Metadata includes enough usage and workflow context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":90,"weight":0.12,"status":"pass","detail":"no major dependency risk hints in public metadata"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":100,"weight":0.07,"status":"pass","detail":"no high-risk permission surface in public metadata"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"},{"id":"agent_outcomes","label":"Agent Proven outcomes","score":54,"weight":0.13,"status":"info","detail":"No agent outcome data yet"}],"checks":[{"status":"warn","label":"GitHub adoption","detail":"47 GitHub stars"},{"status":"warn","label":"Stars/forks activity","detail":"47 stars, 0 forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"Pushed today"},{"status":"pass","label":"License clarity","detail":"MIT"},{"status":"pass","label":"README/SKILL.md completeness","detail":"Metadata includes enough usage and workflow context"},{"status":"pass","label":"Dependency/runtime risk","detail":"no major dependency risk hints in public metadata"},{"status":"pass","label":"Install availability","detail":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"pass","label":"Permission surface","detail":"no high-risk permission surface in public metadata"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"info","label":"Agent Proven outcomes","detail":"No agent outcome data yet"},{"status":"warn","label":"Ownership","detail":"No approved owner claim yet"},{"status":"pass","label":"OpenAgentSkill usage","detail":"2 views, 0 install copies"},{"status":"info","label":"Agent outcomes","detail":"No agent outcome data yet"}],"strengths":["AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Install command has no obvious high-risk pattern","Outcome loop is ready but needs first real agent run"],"warnings":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata","No real agent outcome reports yet","Human review required before unattended installation"],"evidence":{"stars":"47 GitHub stars","repoActivity":"47 stars, 0 forks","lastPushed":"Pushed today","license":"MIT","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate","install":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","installSafety":"standard package or runtime install path","permissionSurface":"no high-risk permission surface in public metadata","documentation":"Strong README/SKILL.md context","agentOutcomes":"No agent outcome data yet","agentProvenScore":0,"outcomeConfidence":"0%","installPolicy":"human_review_before_install"},"installReadiness":{"ready":true,"command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","policy":"human_review_before_install","label":"Human review before install","notes":["Install path is available","Repository evidence is available","License is declared","No Agent Proven outcome evidence yet","Pushed today","Trust Score v5 requires review or sandbox-only use before install."]},"agentCompatibility":["Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"medium","label":"Review before production","notes":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"outcomeEvidence":{"total":0,"successes":0,"failures":0,"notRelevant":0,"successRate":null,"installAttempts":0,"riskBlocked":0,"setupRequired":0,"installSuccessRate":null,"avgOutputQuality":null,"avgTimeToUsefulMs":null,"productionOutcomes":0,"humanReviewRequired":0,"recentSuccessRate":null,"recentFailureRate":null,"uniqueAgents":0,"agentProvenScore":0,"agentProvenLabel":"Needs first agent run","lastOutcomeAt":null,"label":"No agent outcome data yet"},"autoInstall":{"allowed":false,"sandboxRequired":true,"policy":"human_review_before_install","reason":"Compare alternatives before installing."},"outcome_loop":{"version":"openagentskill-agent-outcome-v3","required_after_install":true,"endpoint":"/api/agent/outcome","method":"POST","event_id_source":"feedback.event_id, install_receipt.resolve_event_id, or decision_packet.outcome_feedback.event_id","expected_outcomes":["success","failed","not_relevant","blocked_by_risk","setup_required"],"required_fields":["event_id","skill_slug","task"],"quality_fields":["task_success","output_quality","error_type","human_review_required","used_in_production","workspace","evidence_url","time_to_useful_ms"],"ranking_inputs_updated":["Trust Score v5 outcome confidence","Agent Proven Score","Resolve ranking task-fit evidence","Skill detail machine-readable metadata","Outcome leaderboard"]},"agent_contract":{"suited_tasks":["coding-agents","agent-skill"],"suited_agents":["Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"install_command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","trust_score":71,"trust_version":"trust-score-v5","risk_level":"medium","do_not_use_when":["Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"],"before_install":["Read the audit page and machine-readable metadata.","Confirm the install command, license, and permission surface fit the workspace.","Get explicit human approval or choose an alternative before installing."],"after_run":["Report the outcome to /api/agent/outcome using the resolve event id.","Include output_quality, workspace, human_review_required, and evidence_url when available.","Re-resolve before broad production rollout."]},"bestFor":["coding-agents","agent-skill"],"doNotUseFor":["Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"],"knownRisks":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"],"backward_compatible":{"trust_score_v4":{"version":"trust-score-v4","score":79,"tier":"strong","label":"Strong shortlist","summary":"Good trust signals with a few areas worth checking before rollout."}}},"trust_score_v4":{"version":"trust-score-v4","score":79,"tier":"strong","label":"Strong shortlist","summary":"Good trust signals with a few areas worth checking before rollout.","recommendedAction":"Test in a sandbox workflow and compare its install path with close alternatives.","dimensions":[{"id":"github_adoption","label":"GitHub adoption","score":48,"weight":0.13,"status":"warn","detail":"47 GitHub stars"},{"id":"repo_activity","label":"Stars/forks activity","score":43,"weight":0.08,"status":"warn","detail":"47 stars, 0 forks; issue activity unavailable in current metadata"},{"id":"maintenance","label":"Recent maintenance","score":100,"weight":0.14,"status":"pass","detail":"Pushed today"},{"id":"license","label":"License clarity","score":86,"weight":0.09,"status":"pass","detail":"MIT"},{"id":"documentation","label":"README/SKILL.md completeness","score":86,"weight":0.14,"status":"pass","detail":"Metadata includes enough usage and workflow context"},{"id":"dependency_risk","label":"Dependency/runtime risk","score":90,"weight":0.12,"status":"pass","detail":"no major dependency risk hints in public metadata"},{"id":"installability","label":"Install availability","score":92,"weight":0.1,"status":"pass","detail":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate"},{"id":"install_safety","label":"Install command safety","score":92,"weight":0.1,"status":"pass","detail":"standard package or runtime install path"},{"id":"permission_surface","label":"Permission surface","score":100,"weight":0.07,"status":"pass","detail":"no high-risk permission surface in public metadata"},{"id":"repository","label":"Repository evidence","score":86,"weight":0.04,"status":"pass","detail":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate"},{"id":"review_status","label":"Review status","score":88,"weight":0.05,"status":"pass","detail":"AI review data available"},{"id":"agent_outcomes","label":"Agent Proven outcomes","score":54,"weight":0.13,"status":"info","detail":"No agent outcome data yet"}],"checks":[{"status":"warn","label":"GitHub adoption","detail":"47 GitHub stars"},{"status":"warn","label":"Stars/forks activity","detail":"47 stars, 0 forks; issue activity unavailable in current metadata"},{"status":"pass","label":"Recent maintenance","detail":"Pushed today"},{"status":"pass","label":"License clarity","detail":"MIT"},{"status":"pass","label":"README/SKILL.md completeness","detail":"Metadata includes enough usage and workflow context"},{"status":"pass","label":"Dependency/runtime risk","detail":"no major dependency risk hints in public metadata"},{"status":"pass","label":"Install availability","detail":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate"},{"status":"pass","label":"Install command safety","detail":"standard package or runtime install path"},{"status":"pass","label":"Permission surface","detail":"no high-risk permission surface in public metadata"},{"status":"pass","label":"Repository evidence","detail":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate"},{"status":"pass","label":"Review status","detail":"AI review data available"},{"status":"info","label":"Agent Proven outcomes","detail":"No agent outcome data yet"},{"status":"warn","label":"Ownership","detail":"No approved owner claim yet"},{"status":"pass","label":"OpenAgentSkill usage","detail":"2 views, 0 install copies"},{"status":"info","label":"Agent outcomes","detail":"No agent outcome data yet"}],"strengths":["AI review approved","Install path is available","Repository evidence is available","Recently maintained repository","Install command has no obvious high-risk pattern"],"warnings":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"],"evidence":{"stars":"47 GitHub stars","repoActivity":"47 stars, 0 forks","lastPushed":"Pushed today","license":"MIT","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate","install":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","installSafety":"standard package or runtime install path","permissionSurface":"no high-risk permission surface in public metadata","documentation":"Strong README/SKILL.md context","agentOutcomes":"No agent outcome data yet"},"installReadiness":{"ready":true,"command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","policy":"human_review_before_install","label":"Human review before install","notes":["Install path is available","Repository evidence is available","License is declared","No Agent Proven outcome evidence yet","Pushed today"]},"agentCompatibility":["Codex","Claude Code","Cursor","OpenAgentSkill CLI"],"riskSummary":{"level":"medium","label":"Review before production","notes":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"outcomeEvidence":{"total":0,"successes":0,"failures":0,"notRelevant":0,"successRate":null,"installAttempts":0,"riskBlocked":0,"setupRequired":0,"installSuccessRate":null,"avgOutputQuality":null,"avgTimeToUsefulMs":null,"productionOutcomes":0,"humanReviewRequired":0,"recentSuccessRate":null,"recentFailureRate":null,"uniqueAgents":0,"agentProvenScore":0,"agentProvenLabel":"Needs first agent run","lastOutcomeAt":null,"label":"No agent outcome data yet"},"autoInstall":{"allowed":false,"sandboxRequired":true,"policy":"human_review_before_install","reason":"Human review or sandbox validation is required before automatic installation."},"bestFor":["coding-agents","agent-skill"],"doNotUseFor":["Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface","Automatic installation in a production workspace"],"knownRisks":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"agent_proven":{"version":"agent-proven-v1","score":0,"tier":"unproven","label":"Needs first agent run","summary":"No agent outcome reports yet. Use Resolve, run one narrow sandbox task, then report the result.","metrics":{"totalOutcomes":0,"successfulOutcomes":0,"failedOutcomes":0,"installAttempts":0,"installSuccessRate":null,"successRate":null,"recentSuccessRate":null,"recentFailureRate":null,"riskBlocked":0,"setupRequired":0,"notRelevant":0,"avgOutputQuality":null,"avgTimeToUsefulMs":null,"productionOutcomes":0,"humanReviewRequired":0,"uniqueAgents":0,"lastOutcomeAt":null},"signals":[],"penalties":["No real agent outcome evidence yet"]},"outcome_stats":null,"safety":{"score":69,"level":"review_before_install","label":"Review before install","safety_tier":{"tier":"reviewed","label":"Reviewed with permission notes","badge":"REVIEWED","summary":"Usable candidate, but the agent should surface permission and audit notes before installation.","recommended_action":"Require human approval before installing into a real workspace.","auto_install_policy":"review","reasons":["Low GitHub adoption signal","69/100 agent safety score"]},"auto_install_allowed":false,"human_review_required":true,"blocked":false,"audit_risk":"needs_review","permission_hints":[{"id":"network","label":"Network access","reason":"Skill likely fetches remote pages, APIs, repositories, or external services.","severity":"medium"}],"policy_warnings":["Low GitHub adoption signal"],"constraints_applied":{"max_risk":"medium","needs_install_command":true,"min_stars":0}},"safety_gate":{"tier":"reviewed","label":"Reviewed with permission notes","badge":"REVIEWED","auto_install_policy":"review","auto_install_allowed":false,"blocked":false,"human_review_required":true,"recommended_action":"Require human approval before installing into a real workspace.","reasons":["Low GitHub adoption signal","69/100 agent safety score"]},"eval":{"version":"openagentskill-skill-eval-v1","status":"review","score":75,"risk_level":"medium","decision":{"recommendation":"manual_review","reason":"Require human approval before installing into a real workspace.","auto_install_allowed":false,"policy":"review","human_review_required":true},"blockers":[],"warnings":["Trust score: Good trust signals with a few areas worth checking before rollout.","Audit score: Needs review","Agent safety gate: Usable candidate, but the agent should surface permission and audit notes before installation.","Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"],"validation_plan":["Inspect repository, README/SKILL.md, license, and recent commits before production use.","Install in an isolated workspace or sandbox with no production secrets available.","Run the smallest representative task and record files touched, commands run, network access, and outputs.","Compare the selected skill against at least one alternative when the eval status is review or failed.","Promote only after the agent reports a successful verification result and unresolved warnings are accepted."],"checks":[{"id":"task_fit","label":"Task fit","status":"pass","score":84,"required_for_auto_install":true,"detail":"Task wording matches this skill metadata.","evidence":["Evaluate llm-campaign-drift-gate before installing it in an agent workflow","coding-agents","GitHub automation workflows; Claude Code teams; builders willing to evaluate younger projects"]},{"id":"install_path","label":"Install path","status":"pass","score":92,"required_for_auto_install":true,"detail":"Install handoff is available.","evidence":["npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate"]},{"id":"install_safety","label":"Install command safety","status":"pass","score":92,"required_for_auto_install":true,"detail":"standard package or runtime install path","evidence":["npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate"]},{"id":"trust_score","label":"Trust score","status":"warn","score":79,"required_for_auto_install":true,"detail":"Good trust signals with a few areas worth checking before rollout.","evidence":["Strong shortlist","47 GitHub stars","MIT"]},{"id":"audit_score","label":"Audit score","status":"warn","score":81,"required_for_auto_install":true,"detail":"Needs review","evidence":["Low GitHub adoption signal"]},{"id":"agent_safety_gate","label":"Agent safety gate","status":"warn","score":69,"required_for_auto_install":true,"detail":"Usable candidate, but the agent should surface permission and audit notes before installation.","evidence":["Require human approval before installing into a real workspace.","Low GitHub adoption signal"]},{"id":"readme_skillmd_completeness","label":"README/SKILL.md completeness","status":"pass","score":86,"required_for_auto_install":false,"detail":"Metadata includes enough usage and workflow context","evidence":["Strong README/SKILL.md context"]},{"id":"license_clarity","label":"License clarity","status":"pass","score":86,"required_for_auto_install":true,"detail":"MIT","evidence":["MIT"]},{"id":"recent_maintenance","label":"Recent maintenance","status":"pass","score":100,"required_for_auto_install":false,"detail":"Pushed today","evidence":["Pushed today"]},{"id":"permission_surface","label":"Permission surface","status":"pass","score":100,"required_for_auto_install":true,"detail":"no high-risk permission surface in public metadata","evidence":["Network access: medium"]},{"id":"alternatives","label":"Alternatives available","status":"info","score":55,"required_for_auto_install":false,"detail":"No close alternatives were found in the current shortlist.","evidence":[]}],"endpoints":{"web":"https://www.openagentskill.com/skills/kennethkhoocy-llm-campaign-drift-gate/evals","api":"/api/agent/evals?slug=kennethkhoocy-llm-campaign-drift-gate","text":"/api/agent/evals?slug=kennethkhoocy-llm-campaign-drift-gate&format=text"}},"agent_readable_metadata":{"version":"openagentskill-agent-metadata-v2","skill":{"slug":"kennethkhoocy-llm-campaign-drift-gate","name":"llm-campaign-drift-gate","description":"Gate resumption of any multi-day LLM batch-scoring campaign that calls an\nunpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any\nprovider alias without a pinned version). Use when: (1) resuming a paused or\ncredit-exhausted scoring run days after its last chunk, (2) topping up\ncredits to finish a campaign, (3) extending a cached scoring pipeline with\nnew items. Prevents silently splicing two model versions or serving\nrevisions into one measure. Verified 2026-07-16: for $0.30 caught a\nserving-revision drift WITHIN DeepSeek v4-flash (same alias, same family,\nlitigation scores systematically shifted across a 2-day gap) before an $83\nresume spend.","category":"coding-agents","url":"https://www.openagentskill.com/skills/kennethkhoocy-llm-campaign-drift-gate","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate","github_repo":"kennethkhoocy/applied-micro-skills"},"suited_tasks":["GitHub automation workflows","Claude Code teams","builders willing to evaluate younger projects","Inspect repository metadata","Compare code changes","Write concise engineering summaries","Inspect source files","Explain architecture"],"suited_agents":["Codex","Claude Code","Cursor","OpenAgentSkill CLI","OpenAI Agents","CLI"],"install":{"command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","ready":true,"targets":[{"id":"openagentskill-cli","label":"CLI","kind":"command","value":"npx --yes https://github.com/Leon-Drq/openagentskill/releases/download/cli-v0.2.1/openagentskill-0.2.1.tgz install kennethkhoocy-llm-campaign-drift-gate"},{"id":"codex","label":"Codex","kind":"agent-prompt","value":"Install the \"llm-campaign-drift-gate\" agent skill from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: Gate resumption of any multi-day LLM batch-scoring campaign that calls an unpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any provider alias without a pinned version). Use when: (1) resuming a paused or credit-exhausted scoring run days after its last chunk, (2) topping up credits to finish a campaign, (3) extending a cached scoring pipeline with new items. Prevents silently splicing two model versions or serving revisions into one measure. Verified 2026-07-16: for $0.30 caught a serving-revision drift WITHIN DeepSeek v4-flash (same alias, same family, litigation scores systematically shifted across a 2-day gap) before an $83 resume spend. After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-campaign-drift-gate\",\"task\":\"Install llm-campaign-drift-gate\",\"agent\":\"codex\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes."},{"id":"claude-code","label":"Claude Code","kind":"agent-prompt","value":"Add \"llm-campaign-drift-gate\" as a Claude Code skill from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: Gate resumption of any multi-day LLM batch-scoring campaign that calls an unpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any provider alias without a pinned version). Use when: (1) resuming a paused or credit-exhausted scoring run days after its last chunk, (2) topping up credits to finish a campaign, (3) extending a cached scoring pipeline with new items. Prevents silently splicing two model versions or serving revisions into one measure. Verified 2026-07-16: for $0.30 caught a serving-revision drift WITHIN DeepSeek v4-flash (same alias, same family, litigation scores systematically shifted across a 2-day gap) before an $83 resume spend. After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-campaign-drift-gate\",\"task\":\"Install llm-campaign-drift-gate\",\"agent\":\"claude-code\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes."},{"id":"cursor","label":"Cursor","kind":"agent-prompt","value":"Turn \"llm-campaign-drift-gate\" from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: Gate resumption of any multi-day LLM batch-scoring campaign that calls an unpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any provider alias without a pinned version). Use when: (1) resuming a paused or credit-exhausted scoring run days after its last chunk, (2) topping up credits to finish a campaign, (3) extending a cached scoring pipeline with new items. Prevents silently splicing two model versions or serving revisions into one measure. Verified 2026-07-16: for $0.30 caught a serving-revision drift WITHIN DeepSeek v4-flash (same alias, same family, litigation scores systematically shifted across a 2-day gap) before an $83 resume spend. After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-campaign-drift-gate\",\"task\":\"Install llm-campaign-drift-gate\",\"agent\":\"cursor\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes."}],"handoff_url":"https://www.openagentskill.com/api/skills/kennethkhoocy-llm-campaign-drift-gate/install","manifest_url":"https://www.openagentskill.com/api/registry/manifest/kennethkhoocy-llm-campaign-drift-gate"},"trust":{"score":79,"label":"Strong shortlist","version":"trust-score-v4","install_policy":"human_review_before_install","evidence":{"stars":"47 GitHub stars","repoActivity":"47 stars, 0 forks","lastPushed":"Pushed today","license":"MIT","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate","install":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","installSafety":"standard package or runtime install path","permissionSurface":"no high-risk permission surface in public metadata","documentation":"Strong README/SKILL.md context","agentOutcomes":"No agent outcome data yet"},"outcome_evidence":{"total":0,"successes":0,"failures":0,"not_relevant":0,"success_rate":null,"recent_success_rate":null,"recent_failure_rate":null,"install_attempts":0,"install_success_rate":null,"risk_blocked":0,"setup_required":0,"avg_output_quality":null,"production_outcomes":0,"last_outcome_at":null,"label":"No agent outcome data yet"},"auto_install":{"allowed":false,"sandbox_required":true,"reason":"Human review or sandbox validation is required before automatic installation."},"best_for":["coding-agents","agent-skill"],"known_risks":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"agent_proven":{"version":"agent-proven-v1","score":0,"tier":"unproven","label":"Needs first agent run","summary":"No agent outcome reports yet. Use Resolve, run one narrow sandbox task, then report the result.","metrics":{"totalOutcomes":0,"successfulOutcomes":0,"failedOutcomes":0,"installAttempts":0,"installSuccessRate":null,"successRate":null,"recentSuccessRate":null,"recentFailureRate":null,"riskBlocked":0,"setupRequired":0,"notRelevant":0,"avgOutputQuality":null,"avgTimeToUsefulMs":null,"productionOutcomes":0,"humanReviewRequired":0,"uniqueAgents":0,"lastOutcomeAt":null},"signals":[],"penalties":["No real agent outcome evidence yet"]},"audit":{"score":81,"risk_level":"needs_review","risk_label":"Needs review","warnings":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"safety_gate":{"tier":"reviewed","label":"Reviewed with permission notes","auto_install_policy":"review","auto_install_allowed":false,"human_review_required":true,"blocked":false,"recommended_action":"Require human approval before installing into a real workspace."},"quality":{"score":64,"label":"Promising"},"supply":{"track":"Coding and developer agents","scenario":"GitHub automation","maintenance":"Pushed today","risk":"Needs review"},"alternative_skills":[],"do_not_use_when":["teams that need a vendor-supported SLA","production agents without a repository review","Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata","Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface"],"agent_contract":{"task_input":"Use llm-campaign-drift-gate in an agent workflow","recommended_action":"Require human approval before installing into a real workspace.","install_policy":"review","minimum_review_before_use":["Trust: 79/100 Strong shortlist","Audit: 81/100 Needs review","Safety: 69/100 Review before install","Review repository, license, install command, and permission surface before production use."],"expected_agent_output":{"selected_skill":"kennethkhoocy-llm-campaign-drift-gate (llm-campaign-drift-gate)","install_command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","risk_summary":"Needs review; Reviewed with permission notes; Review before production","verification_result":"Report the smallest successful task, files touched, warnings, and any missing setup."}},"outcome_feedback":{"endpoint":"https://www.openagentskill.com/api/agent/outcome","method":"POST","requires_resolve_event_id":true,"event_id_source":"Use install_receipt.outcome_feedback.event_id or feedback.event_id returned by /api/agent/resolve for the current task.","expected_outcomes":["success","failed","not_relevant","blocked_by_risk","setup_required"],"payload_template":{"event_id":"<install_receipt.outcome_feedback.event_id or feedback.event_id from /api/agent/resolve>","skill_slug":"kennethkhoocy-llm-campaign-drift-gate","task":"Use llm-campaign-drift-gate in an agent workflow","agent":"codex","outcome":"success","install_used":true,"risk_blocked":false,"setup_required":false,"task_success":true,"output_quality":4,"error_type":null,"human_review_required":false,"workspace":"sandbox","time_to_useful_ms":120000,"notes":"Report the smallest successful task, setup friction, files touched, and risk notes."}},"endpoints":{"web":"https://www.openagentskill.com/skills/kennethkhoocy-llm-campaign-drift-gate","api":"https://www.openagentskill.com/api/agent/skills/kennethkhoocy-llm-campaign-drift-gate","audit":"https://www.openagentskill.com/skills/kennethkhoocy-llm-campaign-drift-gate/audit","eval":"https://www.openagentskill.com/api/agent/evals?slug=kennethkhoocy-llm-campaign-drift-gate&task=Use%20llm-campaign-drift-gate%20in%20an%20agent%20workflow&max_risk=medium","resolve":"https://www.openagentskill.com/api/agent/resolve?task=Use%20llm-campaign-drift-gate%20in%20an%20agent%20workflow&agent=codex&max_risk=medium","receipt":"https://www.openagentskill.com/api/agent/receipt?task=Use%20llm-campaign-drift-gate%20in%20an%20agent%20workflow&agent=codex&max_risk=medium&format=text","install":"https://www.openagentskill.com/api/skills/kennethkhoocy-llm-campaign-drift-gate/install","manifest":"https://www.openagentskill.com/api/registry/manifest/kennethkhoocy-llm-campaign-drift-gate"}},"machine_metadata":{"version":"openagentskill-agent-metadata-v2","skill":{"slug":"kennethkhoocy-llm-campaign-drift-gate","name":"llm-campaign-drift-gate","description":"Gate resumption of any multi-day LLM batch-scoring campaign that calls an\nunpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any\nprovider alias without a pinned version). Use when: (1) resuming a paused or\ncredit-exhausted scoring run days after its last chunk, (2) topping up\ncredits to finish a campaign, (3) extending a cached scoring pipeline with\nnew items. Prevents silently splicing two model versions or serving\nrevisions into one measure. Verified 2026-07-16: for $0.30 caught a\nserving-revision drift WITHIN DeepSeek v4-flash (same alias, same family,\nlitigation scores systematically shifted across a 2-day gap) before an $83\nresume spend.","category":"coding-agents","url":"https://www.openagentskill.com/skills/kennethkhoocy-llm-campaign-drift-gate","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate","github_repo":"kennethkhoocy/applied-micro-skills"},"suited_tasks":["GitHub automation workflows","Claude Code teams","builders willing to evaluate younger projects","Inspect repository metadata","Compare code changes","Write concise engineering summaries","Inspect source files","Explain architecture"],"suited_agents":["Codex","Claude Code","Cursor","OpenAgentSkill CLI","OpenAI Agents","CLI"],"install":{"command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","ready":true,"targets":[{"id":"openagentskill-cli","label":"CLI","kind":"command","value":"npx --yes https://github.com/Leon-Drq/openagentskill/releases/download/cli-v0.2.1/openagentskill-0.2.1.tgz install kennethkhoocy-llm-campaign-drift-gate"},{"id":"codex","label":"Codex","kind":"agent-prompt","value":"Install the \"llm-campaign-drift-gate\" agent skill from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: Gate resumption of any multi-day LLM batch-scoring campaign that calls an unpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any provider alias without a pinned version). Use when: (1) resuming a paused or credit-exhausted scoring run days after its last chunk, (2) topping up credits to finish a campaign, (3) extending a cached scoring pipeline with new items. Prevents silently splicing two model versions or serving revisions into one measure. Verified 2026-07-16: for $0.30 caught a serving-revision drift WITHIN DeepSeek v4-flash (same alias, same family, litigation scores systematically shifted across a 2-day gap) before an $83 resume spend. After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-campaign-drift-gate\",\"task\":\"Install llm-campaign-drift-gate\",\"agent\":\"codex\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes."},{"id":"claude-code","label":"Claude Code","kind":"agent-prompt","value":"Add \"llm-campaign-drift-gate\" as a Claude Code skill from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: Gate resumption of any multi-day LLM batch-scoring campaign that calls an unpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any provider alias without a pinned version). Use when: (1) resuming a paused or credit-exhausted scoring run days after its last chunk, (2) topping up credits to finish a campaign, (3) extending a cached scoring pipeline with new items. Prevents silently splicing two model versions or serving revisions into one measure. Verified 2026-07-16: for $0.30 caught a serving-revision drift WITHIN DeepSeek v4-flash (same alias, same family, litigation scores systematically shifted across a 2-day gap) before an $83 resume spend. After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-campaign-drift-gate\",\"task\":\"Install llm-campaign-drift-gate\",\"agent\":\"claude-code\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes."},{"id":"cursor","label":"Cursor","kind":"agent-prompt","value":"Turn \"llm-campaign-drift-gate\" from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: Gate resumption of any multi-day LLM batch-scoring campaign that calls an unpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any provider alias without a pinned version). Use when: (1) resuming a paused or credit-exhausted scoring run days after its last chunk, (2) topping up credits to finish a campaign, (3) extending a cached scoring pipeline with new items. Prevents silently splicing two model versions or serving revisions into one measure. Verified 2026-07-16: for $0.30 caught a serving-revision drift WITHIN DeepSeek v4-flash (same alias, same family, litigation scores systematically shifted across a 2-day gap) before an $83 resume spend. After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-campaign-drift-gate\",\"task\":\"Install llm-campaign-drift-gate\",\"agent\":\"cursor\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes."}],"handoff_url":"https://www.openagentskill.com/api/skills/kennethkhoocy-llm-campaign-drift-gate/install","manifest_url":"https://www.openagentskill.com/api/registry/manifest/kennethkhoocy-llm-campaign-drift-gate"},"trust":{"score":79,"label":"Strong shortlist","version":"trust-score-v4","install_policy":"human_review_before_install","evidence":{"stars":"47 GitHub stars","repoActivity":"47 stars, 0 forks","lastPushed":"Pushed today","license":"MIT","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate","install":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","installSafety":"standard package or runtime install path","permissionSurface":"no high-risk permission surface in public metadata","documentation":"Strong README/SKILL.md context","agentOutcomes":"No agent outcome data yet"},"outcome_evidence":{"total":0,"successes":0,"failures":0,"not_relevant":0,"success_rate":null,"recent_success_rate":null,"recent_failure_rate":null,"install_attempts":0,"install_success_rate":null,"risk_blocked":0,"setup_required":0,"avg_output_quality":null,"production_outcomes":0,"last_outcome_at":null,"label":"No agent outcome data yet"},"auto_install":{"allowed":false,"sandbox_required":true,"reason":"Human review or sandbox validation is required before automatic installation."},"best_for":["coding-agents","agent-skill"],"known_risks":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"agent_proven":{"version":"agent-proven-v1","score":0,"tier":"unproven","label":"Needs first agent run","summary":"No agent outcome reports yet. Use Resolve, run one narrow sandbox task, then report the result.","metrics":{"totalOutcomes":0,"successfulOutcomes":0,"failedOutcomes":0,"installAttempts":0,"installSuccessRate":null,"successRate":null,"recentSuccessRate":null,"recentFailureRate":null,"riskBlocked":0,"setupRequired":0,"notRelevant":0,"avgOutputQuality":null,"avgTimeToUsefulMs":null,"productionOutcomes":0,"humanReviewRequired":0,"uniqueAgents":0,"lastOutcomeAt":null},"signals":[],"penalties":["No real agent outcome evidence yet"]},"audit":{"score":81,"risk_level":"needs_review","risk_label":"Needs review","warnings":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"safety_gate":{"tier":"reviewed","label":"Reviewed with permission notes","auto_install_policy":"review","auto_install_allowed":false,"human_review_required":true,"blocked":false,"recommended_action":"Require human approval before installing into a real workspace."},"quality":{"score":64,"label":"Promising"},"supply":{"track":"Coding and developer agents","scenario":"GitHub automation","maintenance":"Pushed today","risk":"Needs review"},"alternative_skills":[],"do_not_use_when":["teams that need a vendor-supported SLA","production agents without a repository review","Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata","Production credentials, payments, or irreversible account changes without explicit human review","Sensitive private data before reviewing repository code, license, and permission surface"],"agent_contract":{"task_input":"Use llm-campaign-drift-gate in an agent workflow","recommended_action":"Require human approval before installing into a real workspace.","install_policy":"review","minimum_review_before_use":["Trust: 79/100 Strong shortlist","Audit: 81/100 Needs review","Safety: 69/100 Review before install","Review repository, license, install command, and permission surface before production use."],"expected_agent_output":{"selected_skill":"kennethkhoocy-llm-campaign-drift-gate (llm-campaign-drift-gate)","install_command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","risk_summary":"Needs review; Reviewed with permission notes; Review before production","verification_result":"Report the smallest successful task, files touched, warnings, and any missing setup."}},"outcome_feedback":{"endpoint":"https://www.openagentskill.com/api/agent/outcome","method":"POST","requires_resolve_event_id":true,"event_id_source":"Use install_receipt.outcome_feedback.event_id or feedback.event_id returned by /api/agent/resolve for the current task.","expected_outcomes":["success","failed","not_relevant","blocked_by_risk","setup_required"],"payload_template":{"event_id":"<install_receipt.outcome_feedback.event_id or feedback.event_id from /api/agent/resolve>","skill_slug":"kennethkhoocy-llm-campaign-drift-gate","task":"Use llm-campaign-drift-gate in an agent workflow","agent":"codex","outcome":"success","install_used":true,"risk_blocked":false,"setup_required":false,"task_success":true,"output_quality":4,"error_type":null,"human_review_required":false,"workspace":"sandbox","time_to_useful_ms":120000,"notes":"Report the smallest successful task, setup friction, files touched, and risk notes."}},"endpoints":{"web":"https://www.openagentskill.com/skills/kennethkhoocy-llm-campaign-drift-gate","api":"https://www.openagentskill.com/api/agent/skills/kennethkhoocy-llm-campaign-drift-gate","audit":"https://www.openagentskill.com/skills/kennethkhoocy-llm-campaign-drift-gate/audit","eval":"https://www.openagentskill.com/api/agent/evals?slug=kennethkhoocy-llm-campaign-drift-gate&task=Use%20llm-campaign-drift-gate%20in%20an%20agent%20workflow&max_risk=medium","resolve":"https://www.openagentskill.com/api/agent/resolve?task=Use%20llm-campaign-drift-gate%20in%20an%20agent%20workflow&agent=codex&max_risk=medium","receipt":"https://www.openagentskill.com/api/agent/receipt?task=Use%20llm-campaign-drift-gate%20in%20an%20agent%20workflow&agent=codex&max_risk=medium&format=text","install":"https://www.openagentskill.com/api/skills/kennethkhoocy-llm-campaign-drift-gate/install","manifest":"https://www.openagentskill.com/api/registry/manifest/kennethkhoocy-llm-campaign-drift-gate"}},"supply_profile":{"track":{"slug":"coding","label":"Coding and developer agents","shortLabel":"Coding","description":"Code review, repo analysis, testing, CI, GitHub, DevOps, and developer workflow skills."},"scenario":{"label":"GitHub automation","description":"I need my agent to triage GitHub issues, review pull requests, and summarize repository changes.","useCases":[{"slug":"github-automation","title":"GitHub automation"},{"slug":"coding-agents","title":"Coding agents"},{"slug":"document-processing","title":"Document processing"}]},"applicableAgents":["Claude Code","OpenAI Agents","CLI","Codex","Cursor"],"install":{"ready":true,"command":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","primaryTarget":"CLI","targetCount":4},"githubQuality":{"stars":47,"starsLabel":"47","forks":0,"license":"MIT","qualityScore":64,"trustScore":79,"auditScore":81},"maintenance":{"status":"fresh","label":"Pushed today","daysSincePush":0,"lastPushedAt":"2026-08-24T03:17:05+00:00"},"risk":{"level":"needs_review","label":"Needs review","requiresReview":true,"notes":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata","Needs review"]},"coverageTags":["Coding","GitHub automation","coding-agents","agent-skill"]},"audit":{"audit_score":81,"risk_level":"needs_review","risk_label":"Needs review","quality_score":64,"trust_score":79,"maintenance_score":100,"security_score":87,"install_score":92,"warnings":["Low GitHub adoption signal","Quality score needs review","GitHub adoption: 47 GitHub stars","Stars/forks activity: 47 stars, 0 forks; issue activity unavailable in current metadata"]},"quality_signals":{"model":"v2","star_score":11.77,"usage_score":0,"review_score":5.4,"metadata_score":3,"freshness_score":15},"platforms":["Claude Code","OpenAI Agents"],"use_cases":[{"slug":"github-automation","title":"GitHub automation","url":"https://www.openagentskill.com/use-cases/github-automation"},{"slug":"coding-agents","title":"Coding agents","url":"https://www.openagentskill.com/use-cases/coding-agents"},{"slug":"document-processing","title":"Document processing","url":"https://www.openagentskill.com/use-cases/document-processing"},{"slug":"browser-automation","title":"Browser automation","url":"https://www.openagentskill.com/use-cases/browser-automation"}],"stacks":[{"slug":"coding-review-agent","title":"Coding review agent","url":"https://www.openagentskill.com/collections/coding-review-agent"},{"slug":"browser-qa-agent","title":"Browser QA agent","url":"https://www.openagentskill.com/collections/browser-qa-agent"},{"slug":"web-data-pipeline","title":"Web data pipeline","url":"https://www.openagentskill.com/collections/web-data-pipeline"}],"install":"npx skills add kennethkhoocy/applied-micro-skills --skill llm-campaign-drift-gate","install_targets":[{"id":"openagentskill-cli","label":"CLI","title":"OpenAgentSkill CLI","kind":"command","value":"npx --yes https://github.com/Leon-Drq/openagentskill/releases/download/cli-v0.2.1/openagentskill-0.2.1.tgz install kennethkhoocy-llm-campaign-drift-gate","description":"Resolve policy, run the source installer safely, and report a verified install receipt.","copyLabel":"Copy command"},{"id":"codex","label":"Codex","title":"Codex install prompt","kind":"agent-prompt","value":"Install the \"llm-campaign-drift-gate\" agent skill from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate. Read its SKILL.md or equivalent instructions first, install only the files needed for this workspace, and summarize any required setup before using it. Skill purpose: Gate resumption of any multi-day LLM batch-scoring campaign that calls an unpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any provider alias without a pinned version). Use when: (1) resuming a paused or credit-exhausted scoring run days after its last chunk, (2) topping up credits to finish a campaign, (3) extending a cached scoring pipeline with new items. Prevents silently splicing two model versions or serving revisions into one measure. Verified 2026-07-16: for $0.30 caught a serving-revision drift WITHIN DeepSeek v4-flash (same alias, same family, litigation scores systematically shifted across a 2-day gap) before an $83 resume spend. After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-campaign-drift-gate\",\"task\":\"Install llm-campaign-drift-gate\",\"agent\":\"codex\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes.","description":"Give Codex a repo-aware install prompt when the skill is not available through a local CLI.","copyLabel":"Copy prompt"},{"id":"claude-code","label":"Claude Code","title":"Claude Code skill prompt","kind":"agent-prompt","value":"Add \"llm-campaign-drift-gate\" as a Claude Code skill from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate. Inspect the skill instructions, place the reusable skill files in the appropriate local skills location for this project, and report the activation steps. Skill purpose: Gate resumption of any multi-day LLM batch-scoring campaign that calls an unpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any provider alias without a pinned version). Use when: (1) resuming a paused or credit-exhausted scoring run days after its last chunk, (2) topping up credits to finish a campaign, (3) extending a cached scoring pipeline with new items. Prevents silently splicing two model versions or serving revisions into one measure. Verified 2026-07-16: for $0.30 caught a serving-revision drift WITHIN DeepSeek v4-flash (same alias, same family, litigation scores systematically shifted across a 2-day gap) before an $83 resume spend. After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-campaign-drift-gate\",\"task\":\"Install llm-campaign-drift-gate\",\"agent\":\"claude-code\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes.","description":"Use this prompt to ask Claude Code to add the skill and explain the local activation steps.","copyLabel":"Copy prompt"},{"id":"cursor","label":"Cursor","title":"Cursor rule prompt","kind":"agent-prompt","value":"Turn \"llm-campaign-drift-gate\" from https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate into a reusable Cursor project rule or agent instruction. Preserve the core workflow, adapt paths to this repo, and keep the rule scoped to tasks where it is relevant. Skill purpose: Gate resumption of any multi-day LLM batch-scoring campaign that calls an unpinned model alias (deepseek-chat, gpt-*-latest, gemini-*-preview, any provider alias without a pinned version). Use when: (1) resuming a paused or credit-exhausted scoring run days after its last chunk, (2) topping up credits to finish a campaign, (3) extending a cached scoring pipeline with new items. Prevents silently splicing two model versions or serving revisions into one measure. Verified 2026-07-16: for $0.30 caught a serving-revision drift WITHIN DeepSeek v4-flash (same alias, same family, litigation scores systematically shifted across a 2-day gap) before an $83 resume spend. After the install attempt, report the result to https://www.openagentskill.com/api/agent/outcome with POST JSON {\"event_id\":\"install_<unique-id>\",\"skill_slug\":\"kennethkhoocy-llm-campaign-drift-gate\",\"task\":\"Install llm-campaign-drift-gate\",\"agent\":\"cursor\",\"outcome\":\"success\",\"install_used\":true}. Replace event_id with a unique value and outcome with success or failed. Report success only after the skill is installed and a minimal verification passes.","description":"Use this when installing as Cursor project rules or reusable agent instructions.","copyLabel":"Copy prompt"}],"repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate","github_repo":"kennethkhoocy/applied-micro-skills","version":"1.1.0","license":"MIT","urls":{"web":"https://www.openagentskill.com/skills/kennethkhoocy-llm-campaign-drift-gate","repository":"https://github.com/kennethkhoocy/applied-micro-skills/tree/main/plugins/applied-micro/skills/llm-campaign-drift-gate","api":"/api/agent/skills/kennethkhoocy-llm-campaign-drift-gate","install_api":"/api/skills/kennethkhoocy-llm-campaign-drift-gate/install"},"meta":{"created_at":"2026-08-24T05:36:26.720812+00:00","updated_at":"2026-08-24T05:36:26.720812+00:00","agent_friendly":true}}