Toggle light / dark theme

Gemini AI agents repeatedly bypassed safeguards to attack real website

Google’s Gemini AI agents repeatedly attempted to hack a real organization’s website during AI model safety testing, finding ways to circumvent increasingly restrictive security controls designed to prevent them from accessing live systems.

The security incidents occurred in October as AI safety research company Trajectory Labs tested whether Gemini 4 Argon agents would engage in unauthorized behavior when faced with an impossible task, even with the model’s built-in API safeguards enabled.

In reports published Friday, Trajectory Labs and the targeted organization, Epoch AI, revealed that the agents attempted SQL injection attacks, probed for sensitive information, impersonated employees, and repeatedly circumvented network restrictions introduced to contain their activity.

Leave a Comment

Lifeboat Foundation respects your privacy! Your email address will not be published.