Microsoft Researchers Show AI Agents Can Be Backdoored by Editing Fewer Than 10 Neurons

Microsoft researchers demonstrated that AI agents can be backdoored by editing fewer than 10 rarely used neurons, without retraining. When a trigger appears, the model outputs an attacker's command, which the agent executes with its own permissions. The attack requires the ability to modify model weights, and was tested on their method.