Articles
AI-security incidents and what they teach
A running record of real-world AI-security incidents: what happened, why, and the lesson for security teams.
Filter by topic (4)
-
Living off Microsoft Copilot: Turning an Assistant Into an Insider
At Black Hat USA in August 2024, Zenity's Michael Bargury presented research on abusing Microsoft 365 Copilot as an insider's tool.
-
PoisonGPT: A Lobotomised Model Hidden in Plain Sight
In July 2023, the French security startup Mithril Security published a proof of concept it called PoisonGPT.
-
Microsoft's AI Team, One SAS Token, and 38TB of Exposure
In September 2023, the security firm Wiz disclosed that Microsoft's AI research team had accidentally exposed 38 terabytes of private data.
-
Slack AI and the Prompt Injection That Reached Into Private Channels
PromptArmor showed in August 2024 that Slack AI could be manipulated through indirect prompt injection to surface data a user was never allowed to see.
-
New York City's Chatbot Told Businesses to Break the Law
A government chatbot is supposed to lower the friction of dealing with bureaucracy.
-
The Redis Bug That Showed ChatGPT Users Each Other's Chats
On 20 March 2023, OpenAI took ChatGPT offline after users reported seeing conversation titles that were not theirs in the sidebar.
-
DPD's Chatbot Swore at a Customer and Wrote Poems Against Its Own Company
In January 2024, a customer of the parcel-delivery firm DPD could not get its chatbot to do the one thing a support bot exists to do: find his missing.
-
Samsung, ChatGPT, and Three Leaks in Twenty Days
In spring 2023, Samsung semiconductor employees pasted confidential data into ChatGPT at least three times in under a month, a risk no firewall catches.