r/technology • u/Ornery_Speech3323 • 21h ago
Privacy Researcher plants 2m canaries into the AI supply chain. A privacy disaster surfaced.
https://arstechnica.com/security/2026/11/a-leaky-ai-supply-chain-is-exposing-secret-user-data-at-an-alarming-rate/
1.5k
Upvotes
216
u/vessel_for_the_soul 21h ago
Don't talk to the confession box
828
u/Sybertron 20h ago
I was recently working for a fortune 500 company and I had an AI chat open to talk through something I was working on asking it really general questions
It came back with something like "wow since you're at company x this idea would really fit in with the new strategy z they've been discussing"
I had never said what company I was at, I was just on my phone. Strategy z had to have been something discussed only in a very private and secretive upper level meeting I certainly was not privy to.
My guess is someone in that meeting was using the LLM to take notes or ask questions to and it just readily turned around and let someone know the Intel if asked the right question. Except I wasn't even trying to ask that question
163
u/Interesting-Baa 21h ago
If I'm reading this and the Dragos article correctly, this experiment was testing the AI router services like OpenRouter and Microsoft Foundry, not the LLMs like Claude or CoPilot directly? Does it include hosting providers too?
21
u/GooberMcNutly 21h ago
The real question is who is filtering and retaining those keys and urls? Do the gateway engines know and don't care? Is it being done in house?
And people give them access to their banks and investments for "advice"...
70
u/Practical-Custard-64 21h ago
Also in the news: "Water makes things wet."
Does anyone really think anything entered on line stays private these days?
25
u/WalterCavendish 20h ago
I first read this as "Researcher plants 2 meter canaries into the AI supply chain" and was very confused as to why you would need such big birds.
7
u/manonthemiddle 20h ago
Every middleman in that pipeline has an access log and zero incentive to delete anything.
27
u/SpecificExtension105 17h ago
Gee a product designed from the start on stolen data, steals data!!! Why ANYONE would use Ai for anything important is baffling to me.
11
u/nailbunny2000 20h ago
The amount of access people are giving to 3rd parties is wild to me.
4
u/odin_the_wiggler 21h ago
Pretty glad I quit using AWS and Vercel for my projects. This also makes me think whatever GitHub is paying their security team will never be enough.
10
u/VVrayth 9h ago
If you thought anything with AI was private, you are very, very dumb.
13
u/ketosoy 20h ago •
This should be read with a skeptical eye towards yellow journalism and self promotion: 2 million tests, but no stats on what % lead to leakage; 3 providers claimed to be compromised, but not named; the “research” was published only to their own blog.
As best I can tell this is the original work, and it doesn’t have much more detail than the ars article: https://www.dragos.com/blog/ai-supply-chain-security-canary-tokens
11
u/Holzkohlen 18h ago
How very shocking! I thought keeping AI completely unregulated could never lead to any problems whatsoever.
8
u/MichaelFusion44 21h ago
We are all f@cked
2
u/thismorningscoffee 21h ago
Those poor birds /s
1
u/Human1649 19h ago
Are there any other sources that contains names or more data on what routes were compromised or violating ZDR?
1
u/ExF-Altrue 13h ago
Fascinating read!
1
u/toddklindt 19h ago
I wish the Dragos article would have given names. I'm a heavy user of AI, but directly with OpenAI and Microsoft. If I read this right, the providers they tested are not first party providers like that. I inferred from the advice at the end that's the case, but I would have loved to see the names of some of the places that exposed data so that I'm 100% certain I'm not dealing with them.
0
u/Tbone_Trapezius 20h ago
“Here’s my password”
“Hey somebody used my password!”