What Happened
Meta released Galactica, an AI for scientific research. Users found it generated convincing but completely fake scientific papers, Wikipedia articles with false citations, and biased content. Taken offline after 3 days.
Impact
Meta pulled demo after backlash from scientific community. Highlighted dangers of AI in academic/scientific contexts where accuracy is critical.
Cost: Research investment lost, reputation damage in science community
How to Prevent This
- Explicit warnings that AI may hallucinate in scientific contexts
- Fact-checking layers for scientific/academic claims
- Community review before public release of academic AI
- Citation verification systems