Hacker News
points by reedlaw 1 day ago | 0 comments
Is there any evidence that skills like this beat training? For example, "Use links for navigation and buttons for actions", is something I imagine any decent model would have picked up already. From my experience, this kind of thing just bloats context and might cause the agent to go off on many rabit trails due to anchoring on keywords in the skill that aren't even relevant to the prompt.
[–] luisrudge 1 day ago
not sure if you count this as evidence, but https://www.whichai.dev has comparisons between default model behavior + model with skills etc. It's very good to assess how strong a model is for frontend tasks.
[–] gwerbin 1 day ago
I only glanced at the repo, but there is an evals/ folder. A good eval would include a no-skill default model+harness (like Claude Code) as a baseline.
Hacker News