演进技能
danielvm-git2026-10-27查看 1346复制 1024
基准门控的技能演进——消费 bigpowers-benchmark 报告、提出 plan-work 变更、通过 craft-skill 编辑技能、重新运行基准、记录 ADR。当技能在基准上表现不佳或 stocktake 发现系统性差距时使用。
📘如何使用这个技能
- 1复制技能内容·点击上方「Copy SKILL.md」复制全部内容,或 Download 下载到本地
- 2打开你的 AI 客户端·支持 Claude Code、Trae、Cursor、ChatGPT、DeepSeek、Kimi 等任意 AI 助手
- 3粘贴为系统提示/知识文件·Claude Code:放入 .claude/skills/ 目录;普通对话:作为首条消息发送并说「请严格按这份技能文档执行」
- 4直接提出你的需求·AI 会按技能定义的工作流、格式和约束来处理,无需再解释背景
💡 提示:技能生效后,每次对话只需一句需求,AI 会按 SKILL.md 的流程执行。
SKILL.md2436 chars
--- name: evolve-skill description: "Benchmark-gated skill evolution — consume bigpowers-benchmark report, propose plan-work change, edit skill via craft-skill, re-run benchmark, record ADR. Use when a skill underperforms on benchmark or stocktake finds systemic gap." --- <!-- story: e23s03 --> <!-- story: e09s01 --> <!-- story: e09s05 --> # Evolve Skill > **HARD GATE** — No skill change ships without benchmark score ≥ pre-change baseline. Learning is measured and versioned — never implicit. ## Loop 1. **Regression gate** — Run `bash scripts/run-verification-gates.sh` to catch mechanical regressions (compliance, sync pipeline, size budget) before spending time on benchmark evals. If golden suite fails, fix regressions first — they are pre-requisites for any capability improvement. 2. **Establish baseline** — Run `run-benchmark <skill> --baseline`. If no definition exists at `specs/benchmarks/<skill>.yaml`, create one following `specs/benchmarks/SCHEMA.md` first. Save report path in `state.yaml`. If `specs/benchmarks/reports/BASELINE-<skill>.yaml` already exists, skip this step. 3. **Identify gap** — Read the baseline report (`specs/benchmarks/reports/BASELINE-<skill>.yaml`). Find scenarios with `result: FAIL` or low `pass_at_k`. This is the measurable gap. 4. **`plan-work`** — Write a minimal change proposal targeting the failing scenarios. Include verify commands. 5. **Edit** via `craft-skill` / direct SKILL.md edit; run `bash scripts/sync-skills.sh`. 6. **Re-run benchmark** — `run-benchmark <skill>`. Compare new `pass_at_k` against baseline. - **IMPROVED or STABLE** → advance to step 6. - **REGRESSION** (`new pass_at_k < baseline`) → revert the change and loop back to step 3. 7. **Record decision** — Write `specs/adr/NNNN-evolve-<skill>.md` with before/after `pass_at_k` scores. Update `session-state`. ## Verify → verify: `test -d specs/benchmarks && test -f skills/run-benchmark/SKILL.md` See [REFERENCE.md](REFERENCE.md) for ADR template. <!-- story: e31s07 --> --- # Evolve Skill — ADR snippet ```markdown ## ADR-XXXX: Evolve <skill-name> **Status:** Accepted **Benchmark:** before X% / after Y% **Change:** one-sentence summary **Evidence:** path/to/benchmark-report.md ``` Benchmark repo: `bigpowers-benchmark` — resolve the local clone on this machine; clone it from wherever your fork lives if absent. Never assume a hard-coded absolute path or a specific owner.