Attack trace library reveals 42.5% of AI agent hacks needed two tries

Security researchers have unveiled a new resource for tracking how artificial intelligence agents get exploited in the wild. Called SkillAtlas, it functions as a hosted attack trace library built specifically for agent skills, the reusable building blocks that power language-model agents. The project, described in a paper by researchers Yuxin Tian, Zenghao Duan, Liang Pang, Zhiyi Yin, and Xueqi Cheng, tackles a problem that has quietly grown alongside the rise of autonomous AI systems: figuring out exactly how these agents fail under attack, not just whether they fail.

Key takeaways

• SkillAtlas is a hosted attack trace library that turns private agent-skill security reports into reviewed, redacted, and publicly searchable cases.
• The library currently holds 3,014 cases, 6,589 traces, 151,131 steps, 233 affected skills, and 8 risk categories.
• 42.5% of successful attack cases only succeed after an initial failed attempt, showing that many exploits take more than one try.
• Using trajectory-grounded labels, SkillAtlas raises pre-execution guard accuracy to 0.770.
• Risks tied to agent skills stem from model decisions, user context, tool calls, and execution feedback rather than fixed signatures or a single sandbox test.

What SkillAtlas Is and Why Agent Skill Risks Behave Differently

SkillAtlas is best understood as a documented map of how AI agents get tricked, rather than a static blacklist of known threats. Agent skills, the modular capabilities that let language-model agents perform tasks, don’t fail in the same predictable way traditional software vulnerabilities do. According to the researchers behind the project, the danger in these skills emerges through a mix of model decisions, the context a user provides, the tool calls an agent makes, and the feedback it receives during execution.

… Continue reading the full article at the original source below.