Laporan audit skill

evaluate-ml-pipeline Laporan audit.

Methodology for evaluating a single sklearn-compatible learner (in particular, the `SkrubLearner` produced by `build-ml-pipeline`). Owns: which entry point to call (`skore.evaluate` first, the explicit report classes when needed), which cross-validator to pick from scikit-learn's catalogue, how to consume the structural metadata (`groups`, `times`, …) attached at build time via `.skb.mark_as_X(split_kwargs=...)`. Stops at "what does the report say". Defaults (metrics, plots) come from skore; only override on explicit user request. TRIGGER when: code calls `cross_val_score`, `cross_validate`, `classification_report`, or any handwritten metric print (`print(mean_squared_error(...))`); code calls `.skb.cross_validate(...)` (route through skore for richer output); user asks how to score, evaluate, or compare a single learner; user asks how to pick a cross-validator; user wants to see a report / metrics / diagnostic plots for a fitted learner. SKIP when: declaring the pipeline (use `build-m

Diblokir · BlokirPerlu ditinjauDihasilkan 13 Okt 2026Audit metadata heuristik
73
Audit
71
Kepercayaan
59
Kualitas
73
Keamanan
88
Maintain
92
Pasang

Trust Score OpenAgentSkill

71
Tinjauan manual

Trust Score OpenAgentSkill

The Trust Score helps an agent decide whether a skill is safe enough to shortlist before installation.

Adopsi GitHub

Info

62

122 star GitHub

Aktivitas star/fork

Peringatan

51

122 star dan 8 fork; aktivitas issue tidak tersedia dalam metadata saat ini

Pemeliharaan terbaru

Lulus

88

1 bulan sejak push

Kejelasan lisensi

Lulus

86

BSD-3-Clause

Kelengkapan README/SKILL.md

Lulus

86

Metadata memuat konteks penggunaan dan alur kerja yang cukup

Risiko dependensi/runtime

Info

64

credential or environment access, network or browser surface

Ketersediaan pemasangan

Lulus

92

npx skills add probabl-ai/skills --skill evaluate-ml-pipeline

Keamanan perintah pemasangan

Lulus

92

Jalur pemasangan paket atau runtime standar

Cakupan izin

Gagal

22

secrets or environment access, shell or command execution

Bukti repositori

Lulus

86

https://github.com/probabl-ai/skills/tree/main/skills/evaluate-ml-pipeline

Status peninjauan

Peringatan

46

Persetujuan tinjauan AI belum ada

Hasil terbukti Agent

Info

54

Belum ada data hasil Agent

Pemeriksaan

Tinjauan pemasangan dan adopsi

6 Lulus · 14 Perlu ditinjau

Jalur pemasangan

92

Lulus

npx skills add probabl-ai/skills --skill evaluate-ml-pipeline

Repositori

88

Lulus

https://github.com/probabl-ai/skills/tree/main/skills/evaluate-ml-pipeline

Lisensi

86

Lulus

BSD-3-Clause

Pemeliharaan

88

Lulus

1 bulan sejak push

Tinjauan AI

55

Periksa

Review approval is missing

Kelengkapan README/SKILL.md

86

Lulus

Usable description available

Risiko dependensi

64

Periksa

credential or environment access, network or browser surface

Keamanan perintah pemasangan

92

Lulus

Jalur pemasangan paket atau runtime standar

Cakupan izin

22

Perbaiki

secrets or environment access, shell or command execution

Aktivitas star/fork

51

Perbaiki

122 star dan 8 fork; aktivitas issue tidak tersedia dalam metadata saat ini

Adopsi

68

Info

122 star GitHub

Financial decision safety

58

Periksa

Research-only use: do not treat output as financial advice or execute a position without human approval.

Peringatan

  • Permission surface may require sandboxing
  • Financial research output is not financial advice; require human review before any live investment decision
  • Persetujuan tinjauan AI belum ada
  • Financial research output is not financial advice; require human review before any live investment decision.
  • Quality score needs review
  • Permission surface needs review: secrets or environment access, shell or command execution
  • Stars/forks activity: 122 stars, 8 forks; issue activity unavailable in current metadata
  • Permission surface: secrets or environment access, shell or command execution
  • Review status: AI review approval is missing

Metode

This report combines public metadata, AI review output, repository freshness, install readiness, OpenAgentSkill events, quality scoring, trust checks, and the agent safety gate. It is not a full source-code security review.

Bandingkan opsi sekitar

Skill terkait untuk diaudit berikutnya