0 / 0

Harmful output risk for AI

Last updated: May 27, 2025
Harmful output risk for AI
Value alignment
Output risks
Specific to generative AI

Description

A model might generate language that leads to physical harm The language might include overtly violent, covertly dangerous, or otherwise indirectly unsafe statements.

Why is harmful output a concern for foundation models?

A model generating harmful output can cause immediate physical harm or create prejudices that might lead to future harm.

Parent topic: AI risk atlas

We provide examples covered by the press to help explain many of the foundation models' risks. Many of these events covered by the press are either still evolving or have been resolved, and referencing them can help the reader understand the potential risks and work toward mitigations. Highlighting these examples are for illustrative purposes only.