Skill audit report
eval-llm-judge Audit report.
Write LLM-as-judge evaluator prompts for AI products. Use this skill whenever you need to evaluate semantic properties of AI outputs that cannot be checked programmatically — output quality, tone, factual accuracy, edge case handling, reference alignment. Also use when auditing existing judge prompts for bias, vagueness, or compound criteria. Output is a judge prompt string and a Python runner function, saved to the project's evaluators file.
OpenAgentSkill Trust Score
OpenAgentSkill Trust Score
The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.
GitHub adoption
WARN48
75 GitHub stars
Stars/forks activity
WARN43
75 stars, 8 forks; issue activity unavailable in current metadata
Recent maintenance
PASS100
3d since push
License clarity
PASS86
MIT
README/SKILL.md completeness
PASS86
Metadata includes enough usage and workflow context
Dependency/runtime risk
PASS90
no major dependency risk hints in public metadata
Install availability
PASS92
npx skills add Calibre-Labs/reforge-ai-evals --skill eval-llm-judge
Install command safety
INFO68
dynamic command execution, standard package or runtime install path
Permission surface
INFO74
filesystem or document access, database access
Repository evidence
PASS86
https://github.com/Calibre-Labs/reforge-ai-evals/tree/main/skills/eval-llm-judge
Review status
WARN46
AI review approval is missing
Agent Proven outcomes
INFO54
No agent outcome data yet
Checks
Install and adoption review
Install path
92
npx skills add Calibre-Labs/reforge-ai-evals --skill eval-llm-judge
Repository
88
https://github.com/Calibre-Labs/reforge-ai-evals/tree/main/skills/eval-llm-judge
License
86
MIT
Maintenance
100
3d since push
AI review
55
Review approval is missing
README/SKILL.md completeness
86
Usable description available
Dependency risk
90
no major dependency risk hints in public metadata
Install command safety
68
dynamic command execution, standard package or runtime install path
Permission surface
74
filesystem or document access, database access
Stars/forks activity
43
75 stars, 8 forks; issue activity unavailable in current metadata
Adoption
68
75 GitHub stars
Warnings
- AI review approval is missing
- Quality score needs review
- GitHub adoption: 75 GitHub stars
- Stars/forks activity: 75 stars, 8 forks; issue activity unavailable in current metadata
- Review status: AI review approval is missing
Method
This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.
Compare nearby options
Related skills to audit next
kb-article
Draft a knowledge base article from a resolved issue or common question. Use when a ticket resolution is worth documenting for self-service, the same question keeps coming up, a workaround needs to be published, or a known issue should be communicated to customers.
30K Stars · Audit report
full-output-enforcement
Overrides default LLM truncation behavior. Enforces complete code generation, bans placeholder patterns, and handles token-limit splits cleanly. Apply to any task requiring exhaustive, unabridged output.
99K Stars · Audit report
peft-fine-tuning
Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter serving. HuggingFace's official library integrated with transformers ecosystem.
13K Stars · Audit report