Synthetic Content Safety and Misuse Controls

Prevent or detect prohibited generation/manipulation of harmful synthetic content and escalate misuse.

For providers or deployers within the relevant Article 5 restrictions, assess the intended use, reasonably foreseeable misuse and reproducible harmful outputs. Providers should select and test safeguards that prevent and correct the prohibited uses covered by their obligations. Define how reports are investigated, unsafe behavior is addressed and repeat failures are escalated. Deployers should prevent prohibited use within their own workflows. Use controlled, lawful test methods and synthetic or otherwise appropriate test material; do not create prohibited content as evidence of a successful control.

Before release or deployment; continuous misuse detection where appropriate; after material changes or reports.

Documented misuse assessment and applicable prohibition Safeguard configuration and approved safe test cases Test results recording findings without retaining unlawful material Misuse reports, containment decisions and corrective actions

Review the safe testing process and one reported weakness. Check that the response corrected the relevant behavior and was retested. Confirm that evidence retention does not itself create prohibited or unnecessary sensitive content.