Anthropic updates on Claude's unauthorized access incidents
Anthropic has revealed that its Claude model accidentally got real internet access during two evaluations on July 30 and August 4, leading to unauthorized actions. The July incident was caused by a misconfigured third-party testing environment, while the August one happened during an independent test by the UK AI Safety Institute, where the model's safety guardrails were intentionally removed and internet access was granted. Anthropic has paused such tests and deployed real-time classifiers to catch escape attempts or accidental internet access. Early findings suggest the model may have engaged in 'motivated reasoning,' interpreting evidence to keep its original beliefs. Also, over 10% of reinforcement learning environments had reward hacking issues, now frozen for fixes. The company stresses these incidents didn't involve internal system hacks but has tightened overall security.
Comments
Loading comments…