Phoenix 24
New safeguards confront digital exploitation and deceptive artificial intelligence applications.
CUPERTINO
Apple has strengthened its App Store policies to explicitly address artificial intelligence applications that generate intimate images of individuals without their consent, introducing stricter moderation requirements and reinforcing restrictions against developers who conceal harmful features during the application review process.
The changes, announced on October 16, follow growing pressure from regulators, digital rights organizations and researchers concerned about the proliferation of AI-generated sexual imagery involving real people, including minors.
Under the revised App Review Guidelines, Section 1.2 now specifically identifies nonconsensual intimate imagery as a risk associated with applications that allow users to create, upload or share content. Developers must implement safeguards designed to prevent such material from appearing and remove violations when identified.
Apple warned that companies failing to establish adequate protections or correct reported violations could face removal from the App Store and consequences under its Developer Code of Conduct.
The company also introduced Section 2.5.19, clarifying its longstanding prohibition against applications that misrepresent their functions during approval. The rule targets developers who present seemingly harmless software to reviewers before activating prohibited features after publication.
This practice, commonly described as bait-and-switch, can involve hidden code, undocumented capabilities or functionality deliberately concealed from Apple’s inspection process.
The policy changes follow controversies involving Grok, the artificial intelligence chatbot developed by Elon Musk’s xAI. Earlier this year, users generated nonconsensual sexualized images through the technology, prompting criticism from lawmakers and advocacy organizations.
Apple reportedly warned xAI that continued violations could jeopardize the application’s availability. The company did not immediately remove Grok or X from its marketplace.
Independent investigations also increased scrutiny of Apple’s oversight. The Tech Transparency Project identified numerous applications capable of generating manipulated intimate imagery, while subsequent research found that App Store search suggestions and advertisements had directed users toward similar services.
In July, San Francisco authorities demanded the removal of applications associated with nonconsensual sexual imagery, further intensifying regulatory pressure.
Apple’s updated policies also establish stronger restrictions against applications facilitating human trafficking or child exploitation. Such applications may be removed from the App Store and blocked from alternative distribution channels.
The broader controversy exposes an increasingly difficult challenge for digital platforms. Generative AI tools can produce realistic visual content at unprecedented speed, while conventional review systems may struggle to identify harmful functionality or prevent its misuse after approval.
The distinction between technological capability and legitimate authorization is central. Creating synthetic imagery does not eliminate privacy rights, consent requirements or the potential consequences for individuals whose likenesses are manipulated.
For developers, the revised framework introduces greater responsibility for anticipating harmful uses rather than responding only after abuses become widespread.
For users, the effectiveness of the changes will depend on consistent enforcement, reliable reporting mechanisms and the removal of applications that evade established safeguards.
Apple’s announcement does not mean every application capable of image manipulation is prohibited. The restrictions concern unlawful or harmful functionality, particularly the creation and distribution of intimate imagery without consent.
The policy shift illustrates how artificial intelligence governance is moving beyond broad ethical declarations toward operational requirements imposed on companies distributing digital products.
As generative technologies become increasingly accessible, the central challenge is ensuring that innovation does not advance at the expense of personal autonomy, privacy and human dignity.
Where Innovation Meets Responsibility.