跳至正文
OpenAgentSkill
浏览已开放 · 目录记录日期 2026-11-21 · 自动更新和账户服务暂时关闭。
搜索与研究

phd-idea-evaluator

Evaluates a preliminary research idea against a five-dimension framework (Higher, Faster, Stronger, Cheaper, Broader) plus idea-lifecycle and student-capability matching, paradigm-shift probing, and a fatal-flaws audit. Returns a reviewer-style verdict. Use when the user has a draft research idea and asks whether it is worth pursuing, asks to 'evaluate this idea', 'score this idea', 'assess feasibility', 'novelty check', 'is this a good research direction', or before committing to a paper scope.

Immortalqx · 已有静态检查记录

安装与使用

运行命令前先阅读来源与依赖说明。复制命令不会自动安装或执行。

npx skills add Immortalqx/my_codex_skills --skill phd-idea-evaluator

技能说明


name: phd-idea-evaluator description: >- Evaluates a preliminary research idea against a five-dimension framework (Higher, Faster, Stronger, Cheaper, Broader) plus idea-lifecycle and student-capability matching, paradigm-shift probing, and a fatal-flaws audit. Returns a reviewer-style verdict. Use when the user has a draft research idea and asks whether it is worth pursuing, asks to 'evaluate this idea', 'score this idea', 'assess feasibility', 'novelty check', 'is this a good research direction', or before committing to a paper scope.

Idea Evaluator

Overview

This skill evaluates a preliminary research idea from the combined perspective of a top-venue reviewer and an experienced advisor. It scores the idea against five improvement dimensions from the idea-generation guide (Higher, Faster, Stronger, Cheaper, Broader), matches the idea's lifecycle against the user's actual capability and available hours per week, probes whether the idea has paradigm-shift potential, flags fatal flaws, and returns one of three verdicts: Strong Accept, Accept with Revisions, or Reject and Pivot.

The goal is to kill weak ideas before the student invests months, and to shape promising-but-underdeveloped ideas into stronger forms before writing begins.

When to use this skill

  • The user has a draft idea and asks whether it is worth pursuing.
  • The user asks for novelty check, feasibility assessment, or scoring.
  • Before the user commits to a paper scope or starts implementation.
  • The user is comparing two or three candidate ideas and needs a structured trade-off.
  • The user suspects scope creep and wants an external check.
  • The user mentions 'evaluate this idea', 'score this idea', 'assess feasibility', or 'is this a good research direction'.

When NOT to use this skill

  • The user has already implemented the idea and is writing the paper. Use phd-intro-drafter, phd-tech-paper-template, or phd-benchmark-paper-template instead.
  • The user explicitly wants brainstorming of new ideas from scratch. Use plain conversation first, then draw from references/paradigm-shift-probe.md and references/paradigm-examples.md if disruptive framing becomes relevant.
  • The user asks for review of an existing manuscript. Use phd-pre-submission-reviewer.
  • The user asks to evaluate a benchmark contribution specifically. Use phd-benchmark-paper-template in targeted mode.

Core procedure

Step 1: First impression and paper-type positioning

Read the user's idea description. In one paragraph, state whether the idea reads as Novel Problem, Novel Method, or New Setting. Is the story compelling in one sentence? If you cannot write that sentence, the idea itself is probably not yet clear enough for evaluation; ask the user to restate.

Step 2: Fatal-flaws audit (early gate)

See: references/fatal-flaws.md for the ten canonical fatal flaws, each with a detection rule and a defense strategy.

Run the fatal-flaws audit before the scoring steps rather than after them. Identify at most two fatal flaws. For each, state the flaw, cite the detection rule, and recommend a concrete defense.

Short-circuit rule. If any fatal flaw is tagged CRITICAL in the severity taxonomy (single-handedly causes rejection, unfixable within the lifecycle), stop here and emit the verdict directly:

  • Verdict: Reject and Pivot.
  • Output sections 1 (First impression), 2 (Fatal flaws with the CRITICAL flaw), and 8 (Verdict with the flaw-driven rationale) only.
  • Do not run the five-dimension scoring, paradigm-shift probe, feasibility check, or integrity gate. Those would be decoration on a rejection.

If no CRITICAL flaw is found, continue to Step 3.

Step 3: Lifecycle and capability matching

See: references/lifecycle-capability-matching.md for the six-category lifecycle matrix, capability self-assessment rubric, and mismatch recovery strategies.

Map the idea onto one of six categories (Application, Foundational Theory, Cross-Disciplinary, Frontier Exploration, Data-Intensive, Innovative Technique). Match against the user's declared capability (effective hours per week, skill depth, theoretical versus applied strength). Output a mismatch flag if lifecycle is shorter than the user's realistic execution window.

Step 4: Five-dimension scoring

See: references/five-dimensions.md for each dimension's entry strategies, scoring rubric, and worked examples.

Score the idea on each of:

  • Higher: effectiveness and accuracy gains.
  • Faster: efficiency and cost reduction.
  • Stronger: robustness, noise tolerance, generalisation.
  • Cheaper: data, annotation, or solution cost reduction.
  • Broader: cross-domain transplantation or unification.

Score each 1-10 with explicit evidence from the user's stated contribution. Identify the two or three dimensions where the idea has the highest ceiling and recommend emphasising those in the paper.

Step 5: Paradigm-shift probe

See: references/paradigm-shift-probe.md for the four probing principles (First Principles, Elephant in the Room, Technology Cycle, Hamming's Rule) and escalation rules for deeper disruptive framing.

Test the idea against four questions:

  1. Does it challenge a hidden assumption the field takes for granted?
  2. Does it address an elephant-in-the-room problem everyone sees but nobody wants to touch?
  3. Does it ride a technology-cycle shift (for example, LLMs making a previously impractical approach now feasible)?
  4. If this problem solved itself, would the field change meaningfully? (Hamming's Rule)

Two or more yes answers means the idea has disruptive potential. Note that, and recommend revisiting references/paradigm-shift-probe.md plus references/paradigm-examples.md to deepen the disruptive framing before the user commits to a paper story.

Step 6: Feasibility check

Against the user's stated resources (hardware, data access, team size, engineering skills, timeline), assess:

  • Compute risk: does t
阅读完整来源 ↗