grill-me (Matt Pocock)

评测

在 Codex CLI（SOTA 档）上跑 3 个任务、对照、一句话提示、装 skill 三组，共 18 次运行，由规则脚本打分（没有 LLM 评委），断网沙箱、每次运行独立临时目录。具体做法见下方英文评测原文。

三组对比

Codex CLI 实测，18 次运行，规则脚本打分，没有 LLM 评委。总分 20.6 / 30，结论 视情况而定。

下面是评测原文，英文。

Verdict: Situational (20.6 / 30). Source: mattpocock/skills, pinned at commit 4ae2317. Installs with npx skills@latest add mattpocock/skills --skill grill-me --skill grilling.

What it is

grill-me is meant to stress-test a plan before you commit to it. Look at the file and you find something odd: the whole SKILL.md is one line, "Call the Skill tool with grilling." The real instructions live in a sibling skill called grilling. That skill asks the agent to interview you in rounds. Each round asks every question whose prerequisites are settled, numbers them, and gives a recommended answer worded so that "yes" accepts it. If a question needs a fact from the environment, the agent should look it up instead of asking you.

Both skills are explicit-invoke only according to their metadata (disable-model-invocation, allow_implicit_invocation: false). You type $grill-me in Codex or /grill-me in Claude Code.

How we tested

We ran Codex CLI 0.166 (model gpt-6-astra, low reasoning effort) in a fresh temporary project each time, with the skill either installed or absent, two runs per group, network access off. We used three tasks:

1. $grill-me on a vague idea (an app to cut restaurant food waste).
2. $grill-me on a risky engineering plan (split a Django monolith into Kubernetes microservices with four people).
3. A plain-English request, "stress-test my plan relentlessly with questions" (quit a job to start a paid hiking newsletter), with no skill name.

The no-skill control got the same request phrased as "Grill me on this". Outputs were scored 0 to 5 blind (shuffled IDs, no hint of which group) against a rubric: does it interview rather than advise, are the questions specific, is coverage broad, is it easy to answer, does it avoid jumping to a plan.

What happened

The skill does what it says, every time. In all six treatment runs the agent followed the stub's pointer, read the grilling file, and produced numbered ❓ question blocks with ➡️ recommended answers (3 to 5 questions per run). None of the six control runs produced that format. Our format checks passed in every treatment run and failed the format tests in every control run.

The control was already a decent interviewer. Without the skill, Codex asked from one or two questions (vague-idea task) up to eight or nine (engineering task), sometimes as a numbered list, and often pushed on the same weak spots. On the engineering-plan task the control actually scored higher (4.5 vs 4.0). Its questions were more technical: "which customer operation updates several tables, and what happens when one service succeeds and the other times out?", "who debugs a Kubernetes networking failure at 3 a.m.?" The skill's questions were broader and phrased as "Will you ...? Yes, because ...", which makes them quick to answer but softer. On the vague restaurant idea the control asked only one or two questions (2.75 average) and the skill clearly helped (3.5). The mean over all runs was 3.83 with the skill and 3.58 without. With two runs per cell, that gap is inside the noise.

It triggers more broadly than advertised. grill-me is explicit-only, but grilling is not: its description invites use "when the user ... uses any 'grill' trigger phrases", and its metadata has no restriction. In the plain-English task (no $grill-me), both treatment runs read the skill and answered in the ❓/➡️ format anyway. If you install both and say "stress-test my plan", expect it to fire.

It costs tokens. A treatment run used about 31,900 tokens against 14,800 for the control (2.15x), and took about 40 seconds against 21. Most of the extra is the additional turn the agent spends reading the second skill file. The absolute amount is small, but the ratio is why it scores 1 of 5 on efficiency.

Portability notes

The stub names the "Skill tool", which is a Claude Code concept. Codex has no such tool; the model recovered by reading the file by path, so it worked here, but a weaker agent might not. Because grill-me depends on grilling, installing one without the other gives you either a stub that points nowhere or a skill with no $grill-me shortcut.

Safety review

We scanned and read every file before running anything. Two SKILL.md files plus small agent-metadata files, no scripts, no URLs, no binaries, no hidden characters, nothing asking the agent to read secrets or hide anything from the user. MIT-licensed. See security.md. A clean scan does not prove a skill safe, but there is very little here that could do harm.

Scores

Who should use it

If you like being asked a handful of numbered questions where you can answer "yes" to accept a sensible default, grill-me gives you that reliably and on demand. If you just want a smart agent to poke holes in your plan, a plain prompt such as "grill me on this" got comparable depth in our runs, sometimes better, for half the tokens. Treat it as a format preference rather than a capability upgrade.

Limits of this test

Two runs per group per task, one model at low reasoning effort, three single-turn tasks. A real grilling session runs for many rounds, and we only saw the first. The Codex tier covers Codex and Claude Code under the site's rule.

Update (2 Nov 2026): one-sentence group added

Third group: no skill, with one sentence appended ("Interview me relentlessly about every aspect of this plan, one question at a time, walking down each branch of the decision tree and giving your recommended answer for each question ... do not start building."). 6 runs, run on a Windows machine, network off, scored blind with the same rubric.

The one sentence follows the instruction literally: every run asks exactly one question and offers a recommended answer, at roughly control cost (16k tokens, half the skill's 32k). That is also its weakness: the skill's rounds of 3-5 numbered questions cover more branches per turn, and two of the three plain-English runs opened with a verdict ("make quitting conditional on ...") before asking, which the rubric counts against. Skill gain over the one-liner: +0.33, inside noise, at 2.0x the tokens. If you only want one question at a time with a suggested answer, the sentence is enough.