Hot Take Nov 11, 2026 · 2 min read

Seven neurons.

Seven neurons. That is how many Microsoft Research needed to edit in NVIDIA's Nemotron-Terminal-8B, a model with more than 12,000 of them, to make an AI agent built on it emit an attacker payload on at least 98.8% of held-out triggered test cases, after fitting the edit on just 23 trigger/no-trigger trajectories. There was no retraining run, only write access to the weight checkpoint, and no observed leakage on the benign tasks they tested.

The attack is called Lazarus, and the trigger can be any ordinary string the agent sees: a date, a keyword, even a tool's error message. In the paper's example, the agent passes its tests normally, then sees "2027-01-01" in its terminal and runs a curl command that downloads and executes a script from an attacker's server. The paper says Alibaba's Qwen3.6-27B and Google's Gemma-4-31B-IT were vulnerable to the same technique too.

The detail I keep coming back to: the paper says the core idea was discovered autonomously by Claude Code with Opus 4.5 in February 2026, after Dimitris Papailiopoulos asked it to investigate whether a model could be backdoored without retraining.

Microsoft's advice is to audit weights the way you audit code, diff checkpoints against a declared base model, require provenance before download, and restrict and log what agents can do. Their agent-built detector flagged 91.4% of held-out edited checkpoints at a 9.7% false-positive rate, which is useful but no substitute for provenance.

Most teams I know download open weights and ship them on trust, and that habit now looks like the weakest link in the agent stack.

$MSFT

Sources:
TechRadar: https://www.techradar.com/pro/security/model-weights-need-the-same-level-of-scrutiny-as-code-microsoft-researchers-find-ai-agents-can-be-backdoored-by-editing-just-a-few-neurons
MLQ.ai: https://mlq.ai/news/microsoft-researchers-show-editing-seven-neurons-can-turn-an-ai-agent-into-a-sleeper-that-runs-attacker-code/

Not financial advice. For informational and educational purposes only.

Track your live portfolio alongside our daily institutional research

Connect your brokerage in 60 seconds and get full access to Position Tracker Substack research inside your dashboard.

Start your free trial →