Skill audit report

agentsop-llm-artifact-versioning Audit report.

Enhancement overlay — version the WHOLE deployable LLM-app artifact as one bundle: prompts + compiled programs + model snapshot pins + retrieval config + eval-set version, versioned together so a deploy is reproducible and rollback is atomic. Activate when preparing to deploy an LLM app, when asking "what exactly is running in prod right now?", when a deploy must be reproducible months later, or when an incident needs a clean rollback. The core reframe: an LLM app artifact is NOT an ML model — it is a manifest over many independently-mutable parts, not one weights file. Do NOT activate for one-off prompt edits with no deploy, for a single-component demo, or where a vendor owns the whole prompt lifecycle. For versioning ONE compiled prompt use [[agentsop-per-model-artifacts]]; for the CI comparison mechanism use [[agentsop-regression-gate]]. Search keywords: prompt versioning, reproducible deploy, what is running in prod, rollback LLM app, model pinning, prompt registry, version prompts

BLOCKED · BLOCKRiskyGenerated Nov 7, 2026Heuristic metadata audit
77
Audit
73
Trust
69
Quality
78
Security
88
Maintain
92
Install

OpenAgentSkill Trust Score

73
Strong shortlist

OpenAgentSkill Trust Score

The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.

GitHub adoption

INFO

62

357 GitHub stars

Stars/forks activity

WARN

57

357 stars, 19 forks; issue activity unavailable in current metadata

Recent maintenance

PASS

88

2mo since push

License clarity

PASS

86

MIT

README/SKILL.md completeness

PASS

86

Metadata includes enough usage and workflow context

Dependency/runtime risk

INFO

64

credential or environment access, network or browser surface

Install availability

PASS

92

npx skills add agentsope/SkillAlchemy --skill agentsop-llm-artifact-versioning

Install command safety

PASS

92

standard package or runtime install path

Permission surface

FAIL

22

secrets or environment access, shell or command execution

Repository evidence

PASS

86

https://github.com/agentsope/SkillAlchemy/tree/master/skills/agentsop-llm-artifact-versioning

Review status

PASS

88

AI review data available

Agent Proven outcomes

INFO

54

No agent outcome data yet

Checks

Install and adoption review

7 Passed · 10 Needs review

Install path

92

PASS

npx skills add agentsope/SkillAlchemy --skill agentsop-llm-artifact-versioning

Repository

88

PASS

https://github.com/agentsope/SkillAlchemy/tree/master/skills/agentsop-llm-artifact-versioning

License

86

PASS

MIT

Maintenance

88

PASS

2mo since push

AI review

88

PASS

Approved with no listed issues

README/SKILL.md completeness

86

PASS

Usable description available

Dependency risk

64

CHECK

credential or environment access, network or browser surface

Install command safety

92

PASS

standard package or runtime install path

Permission surface

22

FIX

secrets or environment access, shell or command execution

Stars/forks activity

57

FIX

357 stars, 19 forks; issue activity unavailable in current metadata

Adoption

68

INFO

357 GitHub stars

Warnings

  • Permission surface may require sandboxing
  • Potential broker, wallet, exchange, or real-money execution surface; sandbox and explicit approval are required
  • This skill may touch real-money trading, broker, wallet, or exchange operations; use only in a sandbox with explicit approval.
  • Quality score needs review
  • Permission surface needs review: secrets or environment access, shell or command execution
  • Stars/forks activity: 357 stars, 19 forks; issue activity unavailable in current metadata
  • Permission surface: secrets or environment access, shell or command execution

Method

This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.

Compare nearby options

Related skills to audit next