Ask HN: Is there an emerging pattern for NEGATIVESKILLS.md files?
Posted by mehmetoguzderin 2 days ago
I am increasingly hitting cases where agents pick something from skills in part due to regex-based reading, since putting them all in context would be less efficient, leave out the negative, and do something exactly opposite of what is intended. Just like negative prompts for diffusion models, I feel like a negative-skills file listing explicit antipatterns and bad versions could enable harnesses with fewer graph nodes to perform better.
I might be missing some developments, but is there an accepted/shaping way to do this with recent models?
Comments
Comment by MrCoffee7 1 day ago
This paper wasn't for SKILLS per se, but for LLMs, and suggests that LLMs can't follow too many constraints at one time very well https://arxiv.org/abs/2608.12426 . Other papers suggest that LLMs show more information sparsity in the results with negative constraints.
Comment by mehmetoguzderin 1 day ago
Good one; reading this briefly took me back to the days of “Needle in a Haystack” being super challenging for LLMs. Maybe there needs to be a benchmark of “Rule in a Haystack” (similar to information one, testing not only independent rules also the ones that need hops) to clarify model performance regarding this. Thank you for the resource.
Comment by oofbaroomf 4 hours ago
I believe you're looking for IFBench (https://arxiv.org/abs/2507.02833, https://artificialanalysis.ai/evaluations/ifbench, https://github.com/allenai/IFBench)
Comment by alikhater30000 1 day ago
[flagged]