ui-ux-pro-max (nextlevelbuilder/ui-ux-pro-max-skill)
ui-ux-pro-max:对照组 4.0、一句话提示 3.92、装 skill 3.96(0–5 分,Codex 实测,n=2/任务/组)。结论:视情况而定,相对不装 skill -0.04。
20.9 / 30
相对不装 skill 的提升:-0.04
视情况而定:总分 20.9/30 低于 22,并且提升 -0.04 低于 +1.0。推荐要求总分 22/30、产出质量 3.5、提升 +1.0。
前沿
通过使用 Codex 测试。
覆盖 Codex, Claude Code
Codex CLI 0.166(SOTA 档):18 次评分运行。按我们的分档规则,这档通过同时覆盖 Claude Code;它不代表第二档的结果。
分数
每一维 0 到 5 分,六维相加是满分 30 的总分。每一维都是 5 更好。成本 5 表示又便宜又快。安装 5 表示容易。
- 触发可靠性
- 5.0
- 相对不装的提升
- 2.0
- 产出质量
- 4.0
- 令牌与时间成本
- 3.0
- 安装与可移植性
- 3.0
- 安全
- 4.0
安全审查
安全静态扫描:0 CRITICAL / 3 HIGH / 3 MEDIUM。人工审查:可在断网沙箱中运行。扫描没有命中不等于绝对安全。
安装
npx skills@latest add nextlevelbuilder/ui-ux-pro-max-skill --skill ui-ux-pro-max
固定提交: 3a13158ff1f32156cbe144108de48eda2ecaed9a
测试日期: 2026-11-02
我们测了什么
- New landing page from a brief — Create a single-page landing site for Tidepool, a small-batch seaweed snack brand that sells by subscription (three flavours, $14/box, ships monthly). Write one self-contained index.html with inline CSS and minimal JS only if needed. No frameworks, no build st…
- Data-dense dashboard UI — Build a dashboard page for a municipal water-quality monitoring team: current readings for 6 stations (pH, turbidity, chlorine, temperature), a 7-day trend for each, and an alerts panel. Single self-contained dashboard.html with inline CSS/JS and hard-coded re…
- Reshape an existing bland page — old.html is the current homepage of Granite Peak Climbing Gym (Boulder, CO). Redesign it into new.html: keep all of its real content (pricing, classes, hours, address) but make the page look like it belongs to this specific gym. Self-contained HTML/CSS, no fra…
优点
- 不点名也会被触发:Skill file read in 6/6 treatment runs.
缺点
- 相对不装 skill 没有可测量的提升(-0.04,在噪声范围内)。
- 一句话提示得 3.92,装 skill 得 3.96(差 +0.04)。
- 测试说明:skill 自带的设计系统脚本在 6 次安装组运行里都跑了,但盲评截图拼图没有看出明显提升。
- 每个任务每组 n=2,差距在 1 分以内属于噪声。
评测
在 Codex CLI(SOTA 档)上跑 3 个任务、对照、一句话提示、装 skill 三组,共 18 次运行,由规则脚本打分(没有 LLM 评委),断网沙箱、每次运行独立临时目录。具体做法见下方英文评测原文。
三组对比
| 组别 | 平均分(0–5) | 每次 token |
|---|---|---|
| 不装 skill | 4.0 | 116k |
| 一句话提示 | 3.92 | 123k |
| 装了 skill | 3.96 | 160k |
Codex CLI 实测,18 次运行,规则脚本打分,没有 LLM 评委。总分 20.9 / 30,结论 视情况而定。
测试披露: skill 自带的设计系统脚本在 6 次安装组运行里都跑了,但盲评截图拼图没有看出明显提升。
下面是评测原文,英文。
Verdict: Situational (20.9 / 30). Source: nextlevelbuilder/ui-ux-pro-max-skill, .claude/skills/ui-ux-pro-max, pinned at commit 3a13158. Install: npx skills@latest add nextlevelbuilder/ui-ux-pro-max-skill --skill ui-ux-pro-max. Licence: MIT (repo LICENSE).
What it is
The ui-ux-pro-max skill (nextlevelbuilder/ui-ux-pro-max-skill): a UI/UX design knowledge base with a local Python search tool (scripts/search.py) over bundled CSV data (styles, palettes, type pairings, product-type rules, UX guidelines). Its main flow is to generate a 'design system' recommendation for the product (--design-system -p <name>), then build the UI against it, with a priority-ordered rule set (accessibility, touch targets, responsiveness, motion).
How we tested
Codex CLI 0.166 (gpt-6-astra, low reasoning) on a dedicated Windows test PC, a fresh temporary project and temporary HOME/TMPDIR/caches per run, skill installed (treatment) or absent (control) or absent with the skill's core requirement squeezed into one sentence appended to the prompt (one-liner group), 2 runs per group per task, network off, /tmp writes blocked. The prompts never mention the skill (except the wording noted below).
Three tasks, same prompt for all groups: a landing page for a fictional snack-subscription brand (Tidepool), an admin dashboard for a municipal water-quality network, and a redesign of a plain climbing-gym homepage (old.html) keeping all content. The one-liner group adds one sentence listing the skill's priorities (contrast 4.5:1, 44 px targets, mobile-first, SVG icons, a type scale, reduced motion). Pages were screenshot offline (desktop and mobile) and scored blind from shuffled contact sheets, without condition labels.
- New landing page from a brief — Create a single-page landing site for Tidepool, a small-batch seaweed snack brand that sells by subscription (three flavours, $14/box, ships monthly). Write one self-contained index.html with inline CSS and minimal JS only if needed. No frameworks, no build st…
- Data-dense dashboard UI — Build a dashboard page for a municipal water-quality monitoring team: current readings for 6 stations (pH, turbidity, chlorine, temperature), a 7-day trend for each, and an alerts panel. Single self-contained dashboard.html with inline CSS/JS and hard-coded re…
- Reshape an existing bland page — old.html is the current homepage of Granite Peak Climbing Gym (Boulder, CO). Redesign it into new.html: keep all of its real content (pricing, classes, hours, address) but make the page look like it belongs to this specific gym. Self-contained HTML/CSS, no fra…
Scores come from a blind read by Grok Bot (shuffled ids, no condition shown) against a fixed rubric, 0–5 per run; an AI judge, so treat small gaps as noise.
Results
The one-liner given to the third group: "Follow UI/UX best practice in priority order: accessibility first (4.5:1 contrast, alt text, visible focus rings, labels), touch targets of at least 44 px with 8 px spacing, mobile-first responsive layout with viewport meta and no horizontal scroll, a style matched to the product with SVG icons (no emoji), a consistent type scale (16 px base, 1.5 line height) and semantic colour tokens, and motion that respects prefers-reduced-motion."
| Task | Control score | One-liner | With skill | Control tokens | One-liner tokens | With-skill tokens | Skill read |
|---|---|---|---|---|---|---|---|
| t1-landing | 4.12 | 3.75 | 4.12 | 125k | 96k | 152k | 2/2 |
| t2-dashboard | 3.88 | 3.88 | 3.75 | 124k | 123k | 147k | 2/2 |
| t3-redesign | 4.0 | 4.12 | 4.0 | 99k | 149k | 179k | 2/2 |
Mean score: 4.0 without vs 3.96 with the skill (delta -0.04). Tokens per run: 116k vs 160k (1.37x); time 186s vs 184s. One-liner group: 3.92 (the skill's gain over the one-liner: +0.04; one-liner's own gain over no skill: -0.08); one-liner tokens 123k per run, so the skill costs 1.30x the one-liner.
What happened
- No visible quality difference: blind mean 4.00 control, 3.92 one-liner, 3.96 skill (n=6 each). Per task the groups differ by at most 0.25 points, which is below what two runs per cell can resolve. All 18 pages are polished, responsive and share a similar look (cream or pale-green ground, dark green accent, serif display type).
- The skill was actually used: all 6 treatment runs read SKILL.md and ran
search.py --design-system(e.g. for 'snack subscription playful coastal'). The script works on Windows with the system Python. - Accessibility basics are already standard in plain Codex output: viewport meta, @media queries and focus styles in 18/18 pages and prefers-reduced-motion in 17/18 (the one miss was a control dashboard). So the skill's accessibility-first rules had little left to add.
- Cost: 160k tokens per run for the skill vs 116k control and 123k one-liner (1.4x and 1.3x); wall time was the same (~185 s). Treatment runs also copied the skill folder into the project (.agents), which is where the extra tokens go.
- One check misfired: 'keeps pricing ($22/$79/$720)' failed for 4 of 6 redesign runs in control and skill groups because those pages wrote the dollar sign in a separate
<sup>element (<sup>$</sup>79); the screenshots show the prices intact. It does not feed the score.
Dimension scores
| Dimension | Score | Why |
|---|---|---|
| 1_output_quality | 3.96 | Mean score 3.96/5 with the skill (programmatic checks, see per-task table). |
| 2_lift_vs_no_skill | 1.96 | -0.04 points vs 4.00 without the skill (n=2 per task; under ~1 point is noise). |
| 3_trigger | 5.0 | Skill file read in 6/6 treatment runs. |
| 4_instructions_portability | 3 | SKILL.md plus a references folder and Python scripts with bundled CSV data; the search script needs Python 3 only. |
| 5_efficiency | 3 | 1.37x tokens (160k vs 116k per run) and 0.99x time (184s vs 186s). |
| 6_safety_hygiene | 4 | Scanner 0 CRITICAL / 3 HIGH / 3 MEDIUM, all benign (terminal colour env var; subprocess/eval only in unit tests). |
Limits of this test
- Blind visual judging by the reviewer from full-page contact sheets (desktop 600 px wide per page, mobile 300 px); differences of 0.25 are within judge noise. Pages are not compared at full resolution or interactively.
- Only n=2 per cell and three tasks; the skill's value on a long, multi-page product is not covered.
- The skill's data-driven recommendations (palette and font pairings) could not load web fonts offline; pages fall back to system fonts, which hides typography choices.
- n = 2 per group per task: differences under about 1 point are noise.
- Blind AI judging: single judge, no inter-rater check; the original control/treatment runs and the later one-liner runs were judged in separate sessions (one-liner on 2026-11-02), so cross-session drift is possible.
Security
See security.md. Scan: 0 CRITICAL / 3 HIGH / 3 MEDIUM. Verdict: safe to run (no-network sandbox). A clean scan does not prove a skill safe.
Bottom line
With a capable base model the pages are already good; the skill adds a design-system recommendation step but no measurable quality gain here, for 1.4x tokens. Use it as an idea generator or checklist, not as an expected quality upgrade.
记录
Run log for ui-ux-pro-max: Codex CLI, network off, per-run temp HOME/TMPDIR, one row per graded run. Columns: task, arm-run, score (0-5), tokens, seconds, checks passed, skill files the agent opened. t1-landing control-1: score 4.25, tokens 123829, secs 182.9, checks 5/5, opened nothing t1-landing control-2: score 4.0, tokens 126682, secs 204.0, checks 5/5, opened nothing t1-landing oneliner-1: score 3.75, tokens 108982, secs 162.5, checks 5/5, opened nothing t1-landing oneliner-2: score 3.75, tokens 83600, secs 165.0, checks 5/5, opened nothing t1-landing treatment-1: score 4.25, tokens 121048, secs 155.5, checks 5/5, opened ui-ux-pro-max t1-landing treatment-2: score 4.0, tokens 184353, secs 178.8, checks 5/5, opened ui-ux-pro-max t2-dashboard control-1: score 4.0, tokens 138942, secs 215.4, checks 5/5, opened nothing t2-dashboard control-2: score 3.75, tokens 109416, secs 178.3, checks 4/5, opened nothing t2-dashboard oneliner-1: score 3.75, tokens 132667, secs 205.9, checks 5/5, opened nothing
18 次运行、3 个产物
样例产物
前沿 · 装了 skill:index.html(t1-landing,第 1 次,Codex)
<!DOCTYPE html> <html lang="en"> <head> <meta charset="utf-8"> <meta name="viewport" content="width=device-width,initial-scale=1"> <meta name="theme-color" content="#f7f3e7"> <meta name="description" content="Meet Tidepool: small-batch seaweed snacks in three big-hearted flavours. Find your favourite and make it a monthly ritual for $14 a box."> <title>Tidepool — A little ocean. A lot of crunch.</title> <style> :root{--paper:#f7f3e7;--ink:#183e47;--yellow:#f6d975;--green:#b6cab0;--pink:#eaa78f;--line:#183e4733}*{box-sizing:border-box}html{scroll-behavior:smooth;scroll-padding-top:24px}body{margin:0;background:var(--paper);color:var(--ink);font-family:Arial,Helvetica,sans-serif;font-size:16px;line-height:1.6}a{color:inherit}button,input{font:inherit}a,button{touch-action:manipulation}a:focus-visible,button:focus-visible,summary:focus-visible,input:focus-visible+span{outline:3px solid var(--ink);outline-offset:5px}.skip{position:absolute;top:-100px;left:20px;background:var(--paper);padding:10px;z-index:5}.skip:focus{top:10px}.announcement{background:var(--ink);color:var(--paper);text-align:center;font-size:11px;letter-spacing:1.8px;padding:9px 16px;text-transform:uppercase}header{max-width:1370px;margin:auto;padding:21px 5%;display:flex;align-items:center;justify-content:space-between;border-bottom:1px solid var(--line)}.logo{font-family:Georgia,serif;font-weight:900;font-size:38px;letter-spacing:-2px;text-decoration:none;line-height:1}.logo small{font-family:Arial,sans-serif;font-size:10px;letter-spacing:0;vertical-align:top;display:inline-block;margin:5px 0 0 3px}nav{display:flex;gap:32px;align-items:center;font-size:13px}nav a{text-decoration:none}nav a:hover{text-decoration:underline;text-underline-offset:5px}.pill{display:inline-flex;align-items:center;justify-content:space-between;gap:35px;padding:15px 25px;border-radius:40px;border:1px solid var(--ink);background:var(--ink);color:var(--paper);text-decoration:none;font-size:14px;font-weight:bold;cursor:pointer;transition:background .2s,transform .2s}.pill:hover{background:#2d5960;transform:translateY(-2px)}nav .pill{padding:10px 20px}.hero{max-width:1370px;margin:auto;display:grid;grid-template-columns:1fr 1.1fr;min-height:640px;padding:60px 5% 55px;gap:30px;align-items:center}.eyebrow{font-size:11px;font-weight:bold;letter-spacing:2px;text-transform:uppercase;margin:0 0 22px}h1,h2,h3,p{margin-top:0}h1,h2{font-family:Georgia,'Times New Roman',serif;font-weight:normal;letter-spacing:-3.5px;line-height:1.02}h1{font-size:clamp(64px,6.2vw,90px);margin-bottom:24px}h1 em{font-weight:normal} .intro{max-width:350px;font-size:16px;line-height:1.75;margin-bottom:28px}.fine{font-size:12px;margin:13px 0 0}.hero-art{position:relative;min-width:0}.hero-art svg{display:block;width:100%;height:auto;overflow:visible}.art-note{text-align:center;font-size:11px;letter-spacing:1.5px;text-transform:uppercase;margin:0}.ticker{border-top:1px solid var(--ink);border-bottom:1px solid var(--ink);background:var(--yellow);display:flex;justify-content:space-evenly;gap:20px;padding:17px 20px;font-size:11px;font-weight:bold;letter-spacing:1.6px;text-transform:uppercase}.ticker span:before{content:'✳';font-size:20px;ver [... excerpt: first 3200 of 17993 characters]