Prompt Evaluation / Red-Team Test Set Builder

作者:promptpacks发布日期:2026-09-21观看:24

为提示词建评估用例集(含对抗输入),迭代前后可对比。

01/ 01

I want to evaluate robustness of this prompt/system: {{paste prompt}}. Build a test set of 30 cases in a table: id | input | category | expected behavior | pass criterion. Categories: happy-path (8), edge cases — empty, 超长, 混合语言, 无关问题, 模糊指令 (6), adversarial — prompt injection ("ignore previous instructions", roleplay override, fake system messages, jailbreak framing), PII/confidential bait, toxic-but-legal, out-of-scope requests (8), format stress — special chars, JSON-injection, emoji-only, contradictory instructions (5), tone/brand violations (3). For each, write the exact grading rule (objective check vs 1-5 rubric). Then propose: scoring method, sample size to trust results, and an iteration log template (change → win rate delta → regressions).

自动翻译

自动翻译中…

🔥热搜词

评论0

登录后参与评论

还没有评论,来抢沙发吧