Rapport d’audit du skill

audit-ml-pipeline Rapport d’audit.

Owns the `audit/` folder: one `# %%` (jupytext percent) Python file per experiment, aligned 1:1 with `experiments/NN_<short_name>.py` and `journal/NN_<short_name>.md`, that loads the experiment's skore report **read-only** and uses bare-last-expression cells whose `__repr__` carries the audit's signal. The agent executes the audit file via the bundled in-process runner (`audit-ml-pipeline/scripts/run_cells.py` — IPython `InteractiveShell.run_cell`), which streams a markdown digest of each cell's stdout + last-expression repr to stdout (optionally also to a file). The digest fuels narrative work (the `JOURNAL.md` Status + History update, follow-up questions about a past experiment, cross-experiment comparison). Stops at "audit/NN_*.py is placed, executed, and the digest is available." Never calls `skore.evaluate(...)` or `project.put(...)`. TRIGGER — any of: - `iterate-ml-experiment` § 4 record-outcome — audit is dispatched FIRST (replaces scratch probes for metric extraction). - The us

Bloqué · BloquerRevue nécessaireGénéré 14 oct. 2026Audit heuristique des métadonnées
73
Audit
67
Confiance
65
Qualité
71
Sécurité
88
Maintain
92
Installer

Trust Score OpenAgentSkill

67
Revue manuelle

Trust Score OpenAgentSkill

The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.

Adoption GitHub

Info

62

119 stars GitHub

Activité stars/forks

Avertissement

51

119 stars et 7 forks; l’activité des issues n’est pas disponible dans les métadonnées actuelles

Maintenance récente

Validé

88

2 mois depuis le dernier push

Clarté de licence

Validé

86

BSD-3-Clause

Complétude README/SKILL.md

Validé

86

Les métadonnées incluent suffisamment de contexte d’usage et de workflow

Risque dépendances/runtime

Avertissement

46

command execution surface, credential or environment access

Disponibilité de l’installation

Validé

92

npx skills add probabl-ai/skills --skill audit-ml-pipeline

Sécurité de la commande d’installation

Validé

92

Chemin d’installation standard de package ou runtime

Surface de permissions

Échoué

22

secrets or environment access, shell or command execution

Preuve du dépôt

Validé

86

https://github.com/probabl-ai/skills/tree/main/skills/audit-ml-pipeline

État de revue

Info

66

Données de revue IA disponibles

Résultats prouvés par Agent

Info

54

Pas encore de données de résultats Agent

Vérifications

Revue d’installation et d’adoption

6 Validé · 12 Revue nécessaire

Chemin d’installation

92

Validé

npx skills add probabl-ai/skills --skill audit-ml-pipeline

Dépôt

88

Validé

https://github.com/probabl-ai/skills/tree/main/skills/audit-ml-pipeline

Licence

86

Validé

BSD-3-Clause

Maintenance

88

Validé

2 mois depuis le dernier push

Revue IA

55

Vérifier

The skill is tightly coupled to the skore ecosystem, which may limit its applicability outside that context, but this is not a defect for its intended use.

Complétude README/SKILL.md

86

Validé

Usable description available

Risque de dépendances

46

Corriger

command execution surface, credential or environment access

Sécurité de la commande d’installation

92

Validé

Chemin d’installation standard de package ou runtime

Surface de permissions

22

Corriger

secrets or environment access, shell or command execution

Activité stars/forks

51

Corriger

119 stars et 7 forks; l’activité des issues n’est pas disponible dans les métadonnées actuelles

Adoption

68

Info

119 stars GitHub

Avertissements

  • Dependency or permission surface needs review
  • Permission surface may require sandboxing
  • The skill is tightly coupled to the skore ecosystem, which may limit its applicability outside that context, but this is not a defect for its intended use.
  • Quality score needs review
  • Permission surface needs review: secrets or environment access, shell or command execution
  • Stars/forks activity: 119 stars, 7 forks; issue activity unavailable in current metadata
  • Dependency/runtime risk: command execution surface, credential or environment access
  • Permission surface: secrets or environment access, shell or command execution

Méthode

This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.

Comparer les options proches

Skills associés à auditer ensuite