Article 5(1)(d)
CurrentFrom 2 Feb 2025Do Not Predict Individual Criminal Risk Solely From Profiling or Personality Characteristics
Applies to Provider; Deployer.
- Actors
- ProviderDeployer
- Context
- Law Enforcement
- Themes
- Governance & Accountability
Tracker Networks Guidance
Your organization should not use AI to assess or predict an individual's risk of committing a criminal offence solely on the basis of profiling or personality traits and characteristics. The prohibition does not prevent AI from supporting a human assessment that is already based on objective and verifiable facts directly linked to criminal activity.
Official text
(d) the placing on the market, the putting into service for this specific purpose, or the use of an AI system for making risk assessments of natural persons in order to assess or predict the risk of a natural person committing a criminal offence, based solely on the profiling of a natural person or on assessing their personality traits and characteristics; this prohibition shall not apply to AI systems used to support the human assessment of the involvement of a person in a criminal activity, which is already based on objective and verifiable facts directly linked to a criminal activity;
Suggested controls
AI Inventory and Use-Case Classification
Maintain an inventory of AI systems/use cases and classify them by regulatory role, use, risk category and relevant conditions.
Prohibited AI Practice Screening and Approval
Screen proposed AI systems and use cases for prohibited practices before procurement, development, deployment or material change.
Related risks
Use of Prohibited AI Practices
The organisation may develop, procure or use AI in a manner prohibited by applicable AI regulation.
AI-Related Fundamental Rights or Discrimination Harm
AI use may create discriminatory, unfair or other material adverse impacts on individuals or groups.