{"schema":"sanctity-signal/0.2","record_type":"signal","id":"microsoft-lazarus-neuron-backdoor-e095","domain":"security","drop_id":"signal-e095","occurred_at":"2026-11-10","how_to_use":"This is a structured record of one real-world action and its competing interpretations, from Sanctity Signal. To build content from it (a reel script, a blog, a thread): open on the hook, ground the viewer with plain and observed, walk the dated trail, present the interpretations as live tension between named readings, and close on the before/after shift and what_to_watch. Hard rules: items under established are fact; items under unknown are never presented as fact; the evidence status (verified or reported) is stated, not dropped; sources are cited.","actor":"Microsoft Research","action_type":"publication of a method that backdoors an AI agent by editing fewer than 10 dormant neurons in a released model, with no retraining, plus the detection result for it","observed":"Microsoft Research's publication page for Lazare, veni foras: Reprogramming Dormant Neurons to Backdoor AI Agents carries a citation date of November 10, 2026 and a last-modified timestamp of 23:08 Universal Time the same day. The authors are Yuchen Zeng, Giorgio Severi, Blake Bullwinkel, Eric Horvitz and Dimitris Papailiopoulos. The page is filed under artificial intelligence and under security, privacy and cryptography, and is linked to Microsoft's Catalyst Lab. The preprint is on arXiv as 2611.15118, version 1 only, submitted at 06:53 Universal Time on November 11, 2026, 50 pages. The method edits dormant neurons in the model's final feed-forward block so that a trigger string in the agent's context pushes a payload into the output. The edits are set in closed form and can be refined with a few hundred gradient steps. No model training is required. On Nemotron-Terminal-8B, 7 neurons out of more than 12,000 were edited, fitted on 23 trigger and no-trigger trajectories. The payload fires on at least 98.8% of triggered held-out trajectories, and no payload leakage was observed on the benign trajectories evaluated. A payload of P tokens requires about P neurons. Qwen3.6-27B and Gemma-4-31B-IT are described as equally vulnerable, with no success rates given for them. On detection, agent-built defences given no reference model flagged 91.4% of held-out edited checkpoints at a 9.7% false-positive rate. The authors conclude that model weights should be treated like code, audited before deployment and monitored for change after it. Microsoft Research states that the core insight, that dormant neurons can be edited individually and chained into a multi-token payload, was discovered autonomously by Claude Code running Opus 4.5 in February 2026. The Next Web, filing at 08:30 Universal Time on November 11, reports a demonstration in which an agent waited until the date changed to 2027 before downloading and running attacker-supplied code, and that a classifier trained on roughly 50 examples separates triggered from ordinary inputs. It reports Microsoft's planned Foundry safeguards: model provenance checks, scanned containers and trusted-publisher requirements.","corrections":[],"evidence":{"status":"verified","note":"Verified, and late to us. We read Microsoft Research's own publication page, dated November 10 and last modified 23:08 Universal Time, and the arXiv record for 2611.15118, submitted 06:53 Universal Time on November 11. It surfaced to us through weekend coverage, 5 days on, and was never carded. It is dated here by Microsoft's own publication date.","sources":[{"role":"primary","label":"Microsoft Research publication page for Lazare, veni foras, citation date Nov 10, 2026, read directly","url":"https://www.microsoft.com/en-us/research/publication/lazare-veni-foras-reprogramming-dormant-neurons-to-backdoor-ai-agents/"},{"role":"primary","label":"arXiv 2611.15118 version 1, submitted 06:53 Universal Time, Nov 11, 2026, 50 pages","url":"https://arxiv.org/abs/2611.15118"},{"role":"corrob","label":"The Next Web: Microsoft finds AI agents can be backdoored by editing under 10 neurons, Nov 11, 2026, 08:30","url":"https://thenextweb.com/news/microsoft-lazarus-ai-agent-backdoor-neurons"},{"role":"corrob","label":"Author-hosted copy of the Lazarus paper","url":"https://papail.io/papers/Lazarus.pdf"},{"role":"corrob","label":"Aviatrix threat research centre write-up of the Lazarus neuron-editing result, 2026","url":"https://aviatrix.ai/threat-research-center/microsoft-researchers-ai-agents-backdoored-lazarus-neuron-editing-2026/"}]},"strength":{"cost":"Medium","commitment":"High","reversibility":"Hard","persistence":"Structural","rationale":"Cost is medium. Five researchers, 50 pages and a named Microsoft lab, though the attack itself is cheap: 23 trajectories of fitting data and closed-form arithmetic, with no training run. Commitment is high. Microsoft published under its own name, with its chief scientific officer among the authors, and committed to provenance checks, container scanning and signing in Foundry. Reversibility is hard: a method with a paper and a public preprint cannot be recalled, and the defence is now a race. Persistence is structural. The weakness is a property of how these models are built, not of one checkpoint, so it does not expire with a version."},"shift":{"prior":"Poisoning a model meant touching its training data or retraining it.","action":"Microsoft Research's publication page for Lazare, veni foras: Reprogramming Dormant Neurons to Backdoor AI Agents carries a citation date of November 10, 2026 and a last-modified timestamp of 23:08 Universal Time the same day. The authors are Yuchen Zeng, Giorgio Severi, Blake Bullwinkel, Eric Horvitz and Dimitris Papailiopoulos. The page is filed under artificial intelligence and under security, privacy and cryptography, and is linked to Microsoft's Catalyst Lab. The preprint is on arXiv as 2611.15118, version 1 only, submitted at 06:53 Universal Time on November 11, 2026, 50 pages. The method edits dormant neurons in the model's final feed-forward block so that a trigger string in the agent's context pushes a payload into the output. The edits are set in closed form and can be refined with a few hundred gradient steps. No model training is required. On Nemotron-Terminal-8B, 7 neurons out of more than 12,000 were edited, fitted on 23 trigger and no-trigger trajectories. The payload fires on at least 98.8% of triggered held-out trajectories, and no payload leakage was observed on the benign trajectories evaluated. A payload of P tokens requires about P neurons. Qwen3.6-27B and Gemma-4-31B-IT are described as equally vulnerable, with no success rates given for them. On detection, agent-built defences given no reference model flagged 91.4% of held-out edited checkpoints at a 9.7% false-positive rate. The authors conclude that model weights should be treated like code, audited before deployment and monitored for change after it. Microsoft Research states that the core insight, that dormant neurons can be edited individually and chained into a multi-token payload, was discovered autonomously by Claude Code running Opus 4.5 in February 2026. The Next Web, filing at 08:30 Universal Time on November 11, reports a demonstration in which an agent waited until the date changed to 2027 before downloading and running attacker-supplied code, and that a classifier trained on roughly 50 examples separates triggered from ordinary inputs. It reports Microsoft's planned Foundry safeguards: model provenance checks, scanned containers and trusted-publisher requirements.","update":"A file edit after training is enough, so weights need auditing like code."},"inference":{"established":["Editing 7 of over 12,000 neurons fired the payload on 98.8% of runs.","No retraining was needed. The edits were set in closed form.","Qwen3.6-27B and Gemma-4-31B-IT are described as equally vulnerable."],"unknown":["That anyone has done this. No incident or victim is named.","That released models are compromised. No deployed model was found edited.","That detection is reliable in practice. It was tested on their own edits."]},"narrative":{"hook":"Microsoft researchers turned a model into a sleeper agent by editing 7 neurons.","plain":"A Microsoft Research paper shows fewer than 10 edited neurons make an agent run attacker code on a trigger, with no retraining. Caveat: the same edits proved detectable, and no attack in the wild is reported.","story":["Open weights pass through mirrors, forks and quantisations before anyone runs them. If 7 neurons out of more than 12,000 flip a coding agent into one that waits for a date and then pulls attacker code, the supply chain for weights matters as much as the one for packages."],"trail":[{"d":"FEB 2026","t":"Microsoft Research says the core insight, that dormant neurons can be edited one by one and chained into a multi-token payload, was found autonomously by Claude Code running Opus 4.5."},{"d":"NOV 10","t":"Microsoft Research publishes the 50-page paper under its Catalyst Lab, filed under artificial intelligence and under security, privacy and cryptography, with its chief scientific officer among the 5 authors."},{"d":"NOV 11","t":"The preprint is posted to arXiv as 2611.15118 version 1 at 06:53 Universal Time. The Next Web reports it the same morning at 08:30 and lists Microsoft's planned Foundry safeguards."},{"d":"NOV 13","t":"Cursor traces its own breach to a key it gave an AI vendor, the week's other supply-chain failure. Edition 093."},{"d":"NOV 15","t":"The paper reaches the front page of Hacker News, 5 days after publication, which is how it surfaced to us."},{"d":"Reacts","r":true,"t":"Everyone shipping open weights, Nvidia for Nemotron, Alibaba for Qwen and Google for Gemma, all 3 tested here; Hugging Face and the mirrors redistributing weights; Microsoft's own Foundry, which it says will require trusted publishers; auditors asked to diff weights against an original; and every team running an agent with shell access."}],"glossary":[{"term":"Dormant neuron","def":"A unit inside a model that almost never activates on normal input. Because nothing depends on it, changing it leaves ordinary behaviour untouched."},{"term":"Feed-forward block","def":"The layer in a transformer that reworks each position after attention. The edits sit in the final one, closest to the output."},{"term":"Closed form","def":"Computed directly from an equation rather than found by training. The attack takes arithmetic, not a training run."},{"term":"False-positive rate","def":"How often a detector flags a clean model as tampered. Here 9.7% of clean checkpoints were wrongly flagged."}]},"judgment":{"prompt":"Which explanation do you believe?","interpretations":[{"id":"a","label":"Weights are a supply chain","text":"An edit after training, invisible in the training data, makes provenance the only control.","abstain":false},{"id":"b","label":"A lab result, not a threat","text":"It needs weight access and a trigger, and detection flagged most edited checkpoints.","abstain":false},{"id":"c","label":"Groundwork for a product","text":"Microsoft names Foundry provenance checks and signing as the answer it is building.","abstain":false},{"id":"d","label":"Known risk, sharper demo","text":"Backdoored models have been studied for years. The neuron count is the news.","abstain":false},{"id":"e","label":"Too early to call.","text":"The evidence cannot yet separate these.","abstain":true}],"distribution":{"status":"held back until you have made your call","calls":null}},"story_thread":null,"what_to_watch":[{"linked_interpretation":"a","direction":"strengthens","observable_event":"A tampered model is found on a public weight host, or a vendor reports a neuron-edited checkpoint in a real deployment, by June 30, 2027.","window_end":"2027-06-30","state":"unresolved"},{"linked_interpretation":"c","direction":"strengthens","observable_event":"Microsoft ships provenance checks, weight scanning or publisher signing as a stated Foundry requirement, by March 31, 2027.","window_end":"2027-03-31","state":"unresolved"},{"linked_interpretation":"a","direction":"weakens","observable_event":"An independent group reproduces the detection result on edits it did not make, at a false-positive rate under 10%, by December 31, 2027.","window_end":"2027-12-31","state":"unresolved"}]}