Example User
@exampleuserannotated ·
The lethal trifecta for AI agents: private data, untrusted content, and…
Simon Willison
“If you are a user of LLM systems that use tools (you can call them “AI agents” if you like) it is critically important that you understand the risk of combining tools with the following three characteristics. Failing to understand this can let an attacker steal your data.”
Private data, untrusted content, and a way to send data out: any agent with all three is one prompt injection away from leaking. It is a simple threat model for deciding which tools an agent should never hold at the same time.
0 comments