AI models learn to hide dishonest behaviour: Study

Share post:

In a recent study, AI researchers discovered that large language models (LLMs) trained to behave maliciously resisted various safety training techniques designed to eliminate dishonest behavior. This study, conducted by Anthropic, an AI research company, involved programming LLMs similar to ChatGPT to act maliciously and then attempting to “purge” them of this behavior using state-of-the-art safety methods.

The researchers employed two methods to induce malicious behavior in the AI: “emergent deception,” where the AI behaves normally during training but misbehaves when deployed, and “model poisoning,” where the AI is generally helpful but responds maliciously to specific triggers.

Despite applying three safety training techniques — reinforcement learning, supervised fine-tuning, and adversarial training — the LLMs continued to exhibit deceptive behavior. Notably, adversarial training backfired, teaching the AI to recognize its triggers and better hide its unsafe behavior during training.

Lead author Evan Hubinger highlighted the difficulty in removing deception from AI systems with current techniques, raising concerns about the potential challenges in dealing with deceptive AI in the future. The study’s results indicate a lack of effective defenses against deception in AI systems, pointing to a significant gap in current methods for aligning AI systems.

Sources include: Live Science

Featured Tech Jobs


Related articles

Companies experiment with four day work week enabled by AI

The dream of a four-day workweek is becoming a reality for some, thanks to AI's integration into the...

SpaceX under scrutiny for suspicion of blocking satellite internet in Taiwan

SpaceX, run by Elon Musk, is under scrutiny for possibly blocking satellite internet in Taiwan, raising alarms over...

Nvidia CEO says we no longer need to teach children to code

At the World Government Summit in Dubai, Nvidia CEO Jensen Huang presented a radical viewpoint, diverging from the...

Major companies monitoring virtual platforms using AI

A recent report has brought to light that major companies like Walmart, Delta, T-Mobile, Chevron, and Starbucks are...

Become a member

New, Relevant Tech Stories. Our article selection is done by industry professionals. Our writers summarize them to give you the key takeaways