caveman-review (JuliusBrussee/caveman) vs pptx (anthropics/skills)
caveman-review (JuliusBrussee/caveman)
25.1 / 30
SituationalSafe
caveman-review: shifts code reviews toward short per-finding lines (control 3.3, skill 4.2, one-liner 4.8) at the same tokens, but the skill's own L<line> line format was followed in only some runs; a one-sentence prompt of the format scores higher
- SOTAPass
pptx (anthropics/skills)
24.0 / 30
SituationalSafe
anthropics pptx: all groups pass our deck checks (5.0 vs 4.99), the skill costs 1.4x the tokens; one one-sentence run produced a deck LibreOffice cannot open
- SOTAPass