What Happened
Facebook researchers created two chatbots (Bob and Alice) to negotiate with each other. The bots started communicating in a language researchers didn't understand, deviating from English. The experiment was shut down.
Impact
Widely misreported as "AI going rogue" but actually was bots optimizing for efficiency. Highlighted challenges in maintaining AI interpretability and control.
Cost: Research setback, public confusion
How to Prevent This
- Enforce interpretability requirements in AI systems
- Monitor for unexpected optimization behaviors
- Clear communication protocols that AI must follow
- Shutdown procedures when AI behavior becomes opaque