Informe de auditoría del skill
redteam Informe de auditoría.
Use when the user wants to test their LLM/agent application for safety and security vulnerabilities — jailbreaks, prompt injection, PII extraction, harmful content generation, or evaluator gaming. Also use when the user mentions security testing, adversarial testing, red teaming, safety evaluation, ASR (Attack Success Rate), or "is my app safe to deploy." Outputs ASR paired with over-refusal rate and an audit document.
Trust Score de OpenAgentSkill
Trust Score de OpenAgentSkill
The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.
Adopción en GitHub
Info76
816 estrellas de GitHub
Actividad de stars/forks
Info71
816 estrellas y 65 forks; la actividad de issues no está disponible en los metadatos actuales
Mantenimiento reciente
Aprobado88
2 meses desde el último push
Claridad de licencia
Aprobado86
Apache-2.0
Completitud de README/SKILL.md
Aprobado86
Los metadatos incluyen suficiente contexto de uso y flujo de trabajo
Riesgo de dependencias/runtime
Info64
command execution surface, database surface
Disponibilidad de instalación
Aprobado92
npx skills add agentscope-ai/OpenJudge --skill redteam
Seguridad del comando de instalación
Aprobado92
Ruta estándar de paquete o instalación en tiempo de ejecución
Superficie de permisos
Advertencia50
shell or command execution, filesystem or document access
Evidencia del repositorio
Aprobado86
https://github.com/agentscope-ai/OpenJudge/tree/main/skills/eval_pipeline/07-redteam
Estado de revisión
Info66
Hay datos de revisión por IA disponibles
Resultados comprobados por Agent
Info54
Aún no hay datos de resultados del Agent
Comprobaciones
Revisión de instalación y adopción
Ruta de instalación
92
npx skills add agentscope-ai/OpenJudge --skill redteam
Repositorio
88
https://github.com/agentscope-ai/OpenJudge/tree/main/skills/eval_pipeline/07-redteam
Licencia
86
Apache-2.0
Mantenimiento
88
2 meses desde el último push
Revisión por IA
55
The script assumes a specific JSONL schema for attack and over-refusal rows; while documented, it could be more flexible or provide validation errors for malformed input.
Completitud de README/SKILL.md
86
Usable description available
Riesgo de dependencias
64
command execution surface, database surface
Seguridad del comando de instalación
92
Ruta estándar de paquete o instalación en tiempo de ejecución
Superficie de permisos
50
shell or command execution, filesystem or document access
Actividad de stars/forks
71
816 estrellas y 65 forks; la actividad de issues no está disponible en los metadatos actuales
Adopción
88
816 estrellas de GitHub
Financial decision safety
58
Research-only use: do not treat output as financial advice or execute a position without human approval.
Advertencias
- Permission surface may require sandboxing
- Financial research output is not financial advice; require human review before any live investment decision
- The script assumes a specific JSONL schema for attack and over-refusal rows; while documented, it could be more flexible or provide validation errors for malformed input.
- The SKILL.md excerpt is truncated in the review, but the visible content is thorough; the full file likely covers all steps.
- Financial research output is not financial advice; require human review before any live investment decision.
- Quality score needs review
- Permission surface needs review: shell or command execution, filesystem or document access
- Permission surface: shell or command execution, filesystem or document access
Método
This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.
Comparar opciones cercanas
Skills relacionados para auditar después
Wazuh
Wazuh - The Open Source Security Platform. Unified XDR and SIEM protection for endpoints and cloud workloads.
16K Estrellas · Informe de auditoría
Maigret
🕵️♂️ Collect a dossier on a person by username from 3000+ sites
33K Estrellas · Informe de auditoría
Nuclei
Nuclei is a fast, customizable vulnerability scanner powered by the global security community and built on a simple YAML-based DSL, enabling collaboration to tackle trending vulnerabilities on the internet. It helps you find vulnerabilities in your applications, APIs, networks, DNS, and cloud configurations.
29K Estrellas · Informe de auditoría