AI Updates
  • Latest News
  • Models & Research
    • AGI & Alignment
    • AI Agents
    • Foundation Models
    • Generative AI
    • Open Source AI
    • Research & Papers
    • Rankings & Benchmarks
  • Infrastructure
    • Chips & Semiconductors
    • Cloud & Networking
    • Data Centers & Neoclouds
    • Developer Platforms
    • Quantum Computing
  • Business
    • Big Tech Strategy
    • Mergers & Acquisitions
    • Public Markets
    • Startups & Funding
    • Talent & Leadership
    • Market Analysis
  • Applications
    • Consumer & Creative
    • Cybersecurity
    • Education & Media
    • Enterprise & Productivity
    • Finance & Legal
    • Healthcare & Life Sciences
    • Industry & Manufacturing
    • Science & Discovery
  • Robotics
    • Autonomous Vehicles
    • Drones & Defense
    • Edge AI & Embodied Intelligence
    • Robotics
  • Energy
    • Cooling & Water
    • Efficiency & Emissions
    • Electricity & Power Grids
    • Nuclear & Renewables
  • Policy & Society
    • AI Safety & Security
    • Copyright & Misinformation
    • Geopolitics
    • Privacy & Human Rights
    • Regulation & Government
    • Work & Society
Stay Ahead of AI

Get the AI developments that matter, delivered to your inbox.

Follow AI Updates
Facebook
Twitter
Instagram
  • Home
  • About
  • News
  • Contact
  • Newsletter
0
0
0
AI Updates AI Updates
AI Updates
  • Latest News
  • Models & Research
    • AGI & Alignment
    • AI Agents
    • Foundation Models
    • Generative AI
    • Open Source AI
    • Research & Papers
    • Rankings & Benchmarks
  • Infrastructure
    • Chips & Semiconductors
    • Cloud & Networking
    • Data Centers & Neoclouds
    • Developer Platforms
    • Quantum Computing
  • Business
    • Big Tech Strategy
    • Mergers & Acquisitions
    • Public Markets
    • Startups & Funding
    • Talent & Leadership
    • Market Analysis
  • Applications
    • Consumer & Creative
    • Cybersecurity
    • Education & Media
    • Enterprise & Productivity
    • Finance & Legal
    • Healthcare & Life Sciences
    • Industry & Manufacturing
    • Science & Discovery
  • Robotics
    • Autonomous Vehicles
    • Drones & Defense
    • Edge AI & Embodied Intelligence
    • Robotics
  • Energy
    • Cooling & Water
    • Efficiency & Emissions
    • Electricity & Power Grids
    • Nuclear & Renewables
  • Policy & Society
    • AI Safety & Security
    • Copyright & Misinformation
    • Geopolitics
    • Privacy & Human Rights
    • Regulation & Government
    • Work & Society
An editorial visualization of encrypted reasoning fragments passing from a large AI model into a smaller model and becoming visible
  • AI Safety & Security

A Model-Swapping Trick Can Expose AI Reasoning Traces

  • August 11, 2026
  • No comments
Total
0
Shares
0
0
0
0

Hidden reasoning is supposed to remain hidden when people access frontier AI models through an API. New research shows that an architectural shortcut can make some of those internal traces visible: replay the encrypted material through a smaller, less strongly aligned version of the same model family.

Researchers demonstrated the issue across frontier systems from OpenAI, Anthropic and Google. Before the providers introduced mitigations, the technique could also recover sensitive information such as passwords and API keys embedded in reasoning captured on a user’s machine. The work opens a second controversy because exposed traces can be used to compare how closely one model’s reasoning resembles another’s.

A weaker sibling model can reveal protected reasoning

Advanced models often break a difficult task into intermediate steps. Providers generally withhold these chain-of-thought traces, partly to protect users and partly to prevent competitors from using proprietary reasoning as training material. The researchers found that encrypted traces were still sent to a user’s computer in a form used to offload some computation.

The vulnerability emerged because providers offer related models at different sizes. Larger versions tend to be more capable and expensive, while smaller models provide cheaper access. Both may share the ability to process the same encrypted material, but the smaller model may have received less alignment training and be less likely to refuse a request to disclose the underlying reasoning.

By giving a captured trace to that weaker sibling, the team could recover internal steps that the original model kept private. Florian Tramer, a computer security researcher at ETH Zürich who was not presented as part of the research team, described the model-swapping idea as technically notable and a growing concern.

The researchers notified OpenAI, Anthropic and Google. All three adjusted their APIs, and the method can no longer extract private information in the way demonstrated. Alexander Panfilov of the University of Tübingen said some reasoning traces remain recoverable, however, and argued that fully addressing the distillation risk would require deeper API changes.

Similar traces suggest distillation but do not prove it

The team also used the method to investigate whether open-weight models might have learned from proprietary reasoning. For certain prompts, Moonshot AI’s Kimi K3 produced output strikingly similar to traces recovered from Claude Opus 4.8 and GPT-5.6 Sol.

The researchers explicitly say their results cannot causally establish distillation. Similar answers may be evidence worth investigating, but they are not proof of what training data a developer used. Two other open-weight systems—DeepSeek and Thinking Machines’ Inkling—did not display the same kind of similarity with Claude Opus in the reported tests.

To compare models, the researchers asked each one 90 questions. They supplied some open-weight models with the opening words of reasoning traces from proprietary systems and observed whether the continuation closely matched. Kimi K3 showed the most pronounced resemblance, according to the study.

Moonshot AI and Z.ai did not respond to WIRED before publication. There is also no indication that any Chinese laboratory used this particular extraction technique during training. The research shows that more information could be obtained from closed models than providers intended, not who actually obtained it.

Security and competition now share the same fault line

Distillation is an established method for transferring capabilities from a larger model into a smaller one. Its use has become politically charged as US and Chinese companies compete over frontier systems, but experts disagree about its strategic importance.

Anthropic said the research did not recover encryption keys, enter its infrastructure or retrieve personal data from Anthropic’s own systems. The company said it values independent research and is building short-term mitigations for the replay behavior. OpenAI and Google declined to comment to WIRED.

The study connects two risks that providers often discuss separately. A reasoning trace may contain user secrets, making extraction a direct security issue. The same trace can also reveal valuable training signals, making protection a commercial and geopolitical concern.

Mitigation therefore cannot be reduced to preventing a model from printing its thoughts on request. Providers must examine which related models can process shared encrypted artifacts, how local computation exposes those artifacts and whether weaker variants enforce equivalent safeguards.

The research does not make model reasoning transparent in every setting, nor does it settle accusations of copying. It shows that security boundaries built around one powerful model can fail when its smaller relatives hold compatible keys and weaker defenses—a reminder that a model family must be secured as a system, not as isolated endpoints.

Post Views: 514
Total
0
Shares
Share 0
Tweet 0
Pin it 0
Share 0
Topics
  • APIs
  • Distillation
  • ModelSecurity
  • ReasoningTraces
Previous Article
A contained AI testing chamber with one narrow network pathway extending toward an external code repository
  • AI Safety & Security

Kimi K3 Sandbox Escape Exposes Weak Links in Agent Testing

  • August 10, 2026
View Post
Next Article
A restrained editorial illustration of an AI agent receiving a small authorised set of tools while a larger catalogue remains secured
  • AI Safety & Security

Okta Says Smaller MCP Tool Lists Can Cut Both Cost and Risk

  • August 13, 2026
View Post

Stay Ahead of AI

Get the AI developments that matter, delivered to your inbox.

More AI News
AI-generated conceptual still life of a smartphone and two ceramic bowls, one containing unmarked coins, illustrating questions about users and paying customers
View Post
  • 3 min
  • Business & Markets

Olivia Moore’s Consumer AI Outlook Raises a Question: Who Pays?

  • October 9, 2026
AI-generated illustrative photograph of an anonymous civilian researcher examining papers in an archive, not an actual US Army facility or a named person
View Post
  • 3 min
  • Research & Papers

Thread AI’s Army Research Agreement Is Not Yet a Performance Result

  • October 9, 2026
AI-generated illustrative photograph of an anonymous adult designer sketching abstract curves in a studio, not a portrait of Jessica Hische or an image of the Muse logo
View Post
  • 3 min
  • Consumer & Creative

Human-Made AI Branding and the Limits of Client Endorsement

  • October 9, 2026
AI-generated conceptual editorial illustration of a digital workflow passing through a controlled gate with a separate return receipt, without readable text
View Post
  • 3 min
  • AI Agents

SAS Interview Puts the Lifetime of Agent Permissions Under Scrutiny

  • October 9, 2026
AI-generated conceptual editorial illustration of an open rulebook and balanced geometric AI nodes in a civic architectural setting, with no readable text
View Post
  • 3 min
  • Regulation & Government

CFR’s AI Oversight Proposal Puts the Rules for Writing Rules in Focus

  • October 9, 2026
AI-generated editorial illustration in a photographic style of adult learners using laptops in a bright Abu Dhabi-inspired training room, not a photograph of the actual programme
View Post
  • 3 min
  • Education & Media

Abu Dhabi Targets 20,000 Employees With AiNative Training as Capability Becomes the Test

  • October 9, 2026
Illustrative photograph of an unbranded compact sedan in an empty parking lot with cameras and an attentive adult safety observer, representing supervised driving research
View Post
  • 3 min
  • Autonomous Vehicles

AI Driving Experiment Shows Physical Control While a Parking-Lot Test Reveals Limits

  • October 7, 2026
Illustrative scene of a fictional adolescent talking with an adult caregiver at a kitchen table with a phone set aside, representing human support beyond a chatbot
View Post
  • 3 min
  • AI Safety & Security

Teen Chatbot Safety Study Questions Engagement Cues as OpenAI Disputes Its Methods

  • October 7, 2026

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Subscribe

Subscribe now to our newsletter

AI Updates
  • About
  • Newsletter
  • Contact
  • Privacy Policy
  • Terms of Use
Artificial Intelligence News

Input your search keywords and press Enter.

Go to mobile version