# AI System Manipulation and Exploitation Practices — legal context bundle > Curated from overview.legal on 2026-08-22. Canonical page: https://overview.legal/topics/ai-system-manipulation-practices > Sources are cited per item. Verify against the official texts before relying on them. The prohibited AI practices content likely addresses specific manipulation and exploitation techniques that are banned, which represents a distinct regulatory concern beyond general prohibition. ## Overview ## Legal Framework The prohibition of AI systems involving manipulative or exploitative practices is governed by Article 5(1)(a) of the AI Act, which is detailed by Recitals 29 and 110. The law bans the placing on the market, putting into service, or use of an AI system with the *objective or effect* of materially distorting a person's behavior through subliminal, manipulative, or deceptive techniques. This prohibition applies when such distortion causes or is likely to cause significant harm. Recital 29 clarifies that the harm includes adverse impacts on physical or psychological health, while Recital 110 extends the concern to systemic risks from general-purpose AI models, such as undermining democratic processes or public security. ## Practical Application The prohibition targets practices that subvert human autonomy and free choice. The key interpretation from the Recitals is the dual focus on *intent* (the objective to distort) and *outcome* (the effect of distortion). A system can be banned even absent malicious intent if its operation has a materially distortive effect leading to significant harm. The concept of "material distortion" is linked to exploitation of vulnerabilities related to age, disability, or specific circumstances. While direct case law on this AI-specific provision is nascent, data protection principles on fairness and manipulation, as referenced in cases like *PROMUSICAE*, inform the understanding of when technical data processing becomes an unfair manipulation of an individual. ## Key Considerations * **Conduct a "Manipulation Risk Assessment":** Scrutinize AI system design, especially user interfaces and decision pathways, for techniques that subliminally or deceitfully nudge users toward harmful decisions they would not otherwise make. * **Document Design Objectives:** Maintain clear evidence that the system's purpose and foreseeable effects are not to materially distort behavior, as liability can attach to both the intended objective and the actual effect. * **Assess Systemic Risk for GPAI:** Providers of general-purpose AI models must evaluate if their model's capabilities could enable downstream manipulative practices at scale, constituting a systemic risk under Recital 110. ## Recent developments ### Manipulation by Algorithms. Exploring the Triangle of Unfair Commercial Practice, Data Protection, and Privacy Law *Source: SSRN, 2022-10-09 — https://overview.legal/posts/6262 — original: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3835259#entry-1001* Machine learning can be used to optimize sales practices in consumer markets, but it also raises concerns about manipulation. According to this article, in order to mitigate these risks, we need to understand how unfair commercial practice, data protection, and privacy law interact. ## Related topics - **Unacceptable Risk AI Systems** — https://overview.legal/topics/unacceptable-risk-ai The content specifically addresses unacceptable-risk AI systems as a distinct category of prohibited practices, warranting a dedicated topic for this specific c - **Artificial Intelligence** — https://overview.legal/topics/ai AI systems and their implications for data protection - **Lawful Basis** — https://overview.legal/topics/lawful-basis-article-6 This topic is essential as Article 6 GDPR provides the specific legal bases that determine whether processing is lawful, which is the core requirement of the 'L - **AI Act Territorial Scope** — https://overview.legal/topics/ai-act-territorial-scope The scope section of the AI Act includes specific provisions on territorial applicability and which providers are subject to the regulation regardless of their - **Public Sector** — https://overview.legal/topics/public-sector Processing by public authorities - **Education** — https://overview.legal/topics/education Processing in educational institutions --- Generated by overview.legal · https://overview.legal/topics/ai-system-manipulation-practices · 2026-08-22