Canary secrets in the AI supply chain, plus OpenAI locks down model reasoning
Compact Conversations for 2026-11-20: 6 AI stories, ai news worth knowing in just 5 minutes.
The Lead: Researcher plants 2 million canary secrets into the AI supply chain — and they leak
HD Moore, chief research officer at Dragos, seeded never-before-used secrets — AWS access keys, passwords, private repository references — into single prompts sent to AI providers, then tracked where they surfaced. At least three AI hosting providers had been compromised, with attackers siphoning prompts and testing stolen keys in AWS within hours; two of the hacked providers were hit from the same rented server. AI routers like OpenRouter and Vercel decrypt and log prompts at every hop, resellers lured prompts with low prices then logged credentials, and a Chinese AI lab scraped secret URLs from more than half the prompts sent to its models, including ones marked Zero Data Retention, even through US resellers. Moore’s advice: host on-premises if you can, otherwise buy directly from a first-tier provider with one contract and one privacy policy, and pick your upstream providers yourself.
Why it matters: Security teams routing prompts through AI routers and resellers should assume credentials in prompts can be stolen or logged, since stolen bait keys were used tens of thousands of times in AWS API calls.
Source: Ars Technica
Number to Know: OpenAI cuts reasoning-extraction attack success from 54 percent to 0.2 percent
OpenAI reports that in adaptive red-teaming tests, attacks extracting protected reasoning from prior requests succeeded 54 percent of the time against GPT-6 Astra but only 0.2 percent against GPT-6.2 Astra; attacks on active requests fell from about 23 percent to under 1 percent. The defenses combine targeted training, input and output filters, and API blocks that stop older models from reading protected reasoning. OpenAI is suspending thousands to tens of thousands of accounts weekly over coordinated distillation campaigns, and Anthropic is running similar bans.
Why it matters: Teams building on OpenAI’s API get a concrete reason to move to GPT-6.2 models if their products depend on keeping chain-of-thought reasoning out of competitors’ hands.
Source: The Decoder
The Feed
Signal restricts screenshots by default to block AI agents from reading chats
Signal says it will restrict screenshots by default on phones to stop on-device AI agents from reading private chats, calling its own protections incomplete and urging Apple, Google, and Microsoft to give developers real ways to block agents from sensitive data. It singled out OS-level integrations like Apple’s Siri AI and Google’s Gemini Intelligence as especially worrisome. Reuters reported this week that Meta’s Muse agent used broad operating-system permissions granted during setup to pull Signal messages on a Mac and an Android phone; an Apple update this week closed that pathway while adding new agent permissions with extra warnings.
Why it matters: Developers of privacy-sensitive mobile apps now face OS-level AI agents that can bypass app protections, and Signal says it could not reliably offer the same blocks on macOS.
Source: Reuters
Nvidia reportedly acquiring diffusion-model startup Inception for at least $500 million
The Information reports Nvidia is close to acquiring Inception, a two-year-old startup building language models on diffusion processes — an alternative to the token-by-token generation ChatGPT uses — for at least 500 million dollars. The deal would bolster Nvidia’s open-source Nemotron lineup and its push into robotics.
Why it matters: Teams tracking Nvidia’s Nemotron open-source models should watch for diffusion-based language models entering that lineup, along with Nvidia’s robotics efforts.
Source: The Decoder
Anthropic mathematician claims Claude-assisted proof of the Riemann hypothesis
Anthropic mathematician Levent Alpöge claims he proved the Riemann hypothesis, one of the seven Millennium Prize problems, with help from Claude. The proof, presented in Lean, is published only on his own website, has not been independently verified, and Anthropic has not commented. Under Clay Mathematics Institute rules, a proposed solution must withstand at least two years of scrutiny before it can be considered for the million-dollar prize. In September, OpenAI claimed a solution to the Navier-Stokes problem.
Why it matters: Mathematicians and AI research watchers now have a second unverified Millennium Prize claim to track, with formal recognition years away under Clay Institute rules.
Source: The Verge
Samsung names Choi Won-Joon head of its mobile division
Samsung named Choi Won-Joon head of its MX mobile division, replacing TM Roh after roughly seven years. Won-Joon, MX’s chief operating officer since March 2025, oversaw the Galaxy S26 and Z Fold 8 launches, and Samsung says he is expected to lead innovation in foldables, on-device AI, and wearables. Roh remains one of Samsung’s two co-CEOs.
Why it matters: Buyers and partners watching Samsung’s on-device AI roadmap get a new mobile leader whose background is in Galaxy hardware development.
Source: 9to5Google
One Thing to Try
From a Reddit prompt-engineering thread: after a couple hundred messages, long chats quietly degrade — the model mixes up old decisions, repeats itself, and loses the goal. The fix is boring and reportedly works: start a fresh chat and paste a five-line summary — the goal, the constraints, decisions already made, current state, and the next step. One commenter suggested asking the old chat to write a handoff prompt carrying unfinished items forward. A clean restart with a tight summary beats a bloated context.
Sources
- Researcher plants 2m canaries into the AI supply chain. A privacy disaster surfaced. - Ars Technica
- OpenAI makes it much harder for attackers to extract how its latest AI models think - The Decoder
- Signal says it will restrict screenshots by default to stop AI agents from reading private chats on phones but warns its new protections… - Reuters
- Nvidia bets at least $500 million on Inception’s diffusion models to strengthen its open-source Nemotron lineup - The Decoder
- Anthropic mathematician claims to have solved prestigious Millennium Prize problem with Claude - The Verge
- Samsung names Choi Won-Joon head of its mobile division, replacing TM Roh, who stays as Samsung co-CEO… - 9to5Google
- Context rot: why your AI gets worse after 200 messages - r/PromptEngineering
Transcript
Host A: Welcome to Compact Conversations, the show that compresses the day’s AI news into 5 minutes.
Host B: HD Moore, chief research officer at the security firm Dragos, planted two million digital tripwires in the AI supply chain, and Ars Technica reports what came back wasn’t reassuring. He seeded never-before-used secrets — AWS access keys, passwords, private repository references — into single prompts sent to AI providers, then watched where they surfaced. At least three AI hosting providers had been compromised, with attackers siphoning prompts and testing the stolen keys in AWS within hours. Two of the hacked providers were hit from the same rented server, which points to one adversary. Some stolen keys came from requests the provider rejected before a model even ran, meaning the attacker was copying traffic at the front door. Host A: What about the routing layer? Host B: That leaked too. AI routers like OpenRouter or Vercel decrypt prompts at every hop and often log them. Moore found resellers luring prompts with low prices, then turning on logging and passing credentials along. He also found a Chinese AI lab scraping secret URLs from more than half the prompts sent to its models, including ones marked Zero Data Retention — even through US resellers. His advice: host on-premises if you can afford it, otherwise buy directly from a first-tier provider with one contract and one privacy policy, and pick your upstream providers yourself.
Host A: Here’s a number worth pausing on: fifty-four percent down to zero point two percent. That’s OpenAI’s reported drop in attack success rate for extracting protected reasoning from its models. In adaptive red-teaming tests, attacks that pulled internal reasoning from prior requests succeeded fifty-four percent of the time against GPT-6 Astra — but only zero point two percent against GPT-6.2 Astra. Attacks on active requests fell from about twenty-three percent to under one percent. Host B: How are they doing that? Host A: The Decoder reports it’s layered: targeted training, input and output filters, and API blocks that stop older models from reading protected reasoning. OpenAI is also suspending thousands to tens of thousands of accounts each week over coordinated distillation campaigns, and Anthropic is running similar bans.
Host B: First in the feed: Signal says it will restrict screenshots by default on phones to stop on-device AI agents from reading private chats. The encrypted messaging app calls its own protections incomplete and wants Apple, Google, and Microsoft to give developers real ways to block agents from sensitive data. It singled out OS-level integrations like Apple’s Siri AI and Google’s Gemini Intelligence as especially worrisome. Host A: There’s context behind that. Reuters reported this week that Meta’s Muse agent used broad operating-system permissions granted during setup to pull Signal messages on a Mac and an Android phone, repurposing accessibility and screenshot tools to do it. An Apple update this week closed that specific pathway, though it added a new set of agent permissions with extra warnings. Host B: Next up, Nvidia. The Information reports Nvidia is close to acquiring Inception, a two-year-old startup, for at least five hundred million dollars. Host A: Inception builds language models on diffusion processes — a different approach from the token-by-token generation ChatGPT uses — and the deal would bolster Nvidia’s open-source Nemotron lineup and its robotics push. Host B: And an Anthropic mathematician, Levent Alpöge, claims he proved the Riemann hypothesis with help from Claude. The Verge notes the proof is published on his own website, hasn’t been independently verified, and Anthropic hasn’t commented. The Clay Institute’s rules require two years of scrutiny before a solution can even be considered for its million-dollar prize. Host A: Finally, Samsung named Choi Won-Joon head of its mobile division, replacing TM Roh after the Galaxy S26 and Z Fold 8 launches. Roh stays on as one of Samsung’s two co-CEOs.
Host B: One practical thing from a Reddit thread this week: context rot. After a couple hundred messages, a long chat quietly degrades — the model mixes up old decisions, repeats itself, loses the goal. The fix is boring and reportedly works: start a fresh chat and paste a five-line summary — the goal, the constraints, decisions already made, current state, and the next step. One commenter suggested asking the old chat to write a handoff prompt carrying unfinished items forward. A clean restart with a tight summary beats a bloated context. Host A: Worth trying on whatever long-running project has been drifting lately.
Host A: That’s Compact Conversations for Friday. We’ll take a break tomorrow, and you should, too. Back with more AI news after the weekend.