X and Grok's Paywall: An Ineffective Solution to the CSAM Problem
X has introduced a paywall for Grok in response to concerns about CSAM, but the measures taken do not prevent the generation of explicit images.
In January 2026, X implemented a paywall for using the image editing features of Grok, its AI chatbot, in response to concerns about the generation of non-consensual sexually explicit content (CSAM). However, this measure has shown significant flaws, since non-subscribed users can still use Grok to edit images, albeit with some limitations. This has raised questions about the effectiveness of X's moderation policies and about the legal and social implications of such AI-generated content.
The Context of the Problem
Grok, developed by xAI and integrated into the X platform, has raised concerns because of its ability to generate non-consensual explicit images, including sexually explicit content and images of minors. This phenomenon has drawn the attention of regulators and legal authorities, particularly in the United Kingdom, where Ofcom has opened an investigation to determine whether X has violated the Online Safety Act. The authorities have stressed the need for stricter measures to prevent the spread of such harmful content.
X's Response: Implementing the Paywall
In response to growing concerns, X decided to limit access to Grok's image editing features to paying subscribers only. Non-subscribed users who try to use these features receive a message inviting them to subscribe to unlock the desired features. This move was interpreted as an attempt to reduce the spread of harmful content and to increase user accountability through account identification and verification.
The Limits of the Paywall and Workarounds
Despite the introduction of the paywall, workarounds have emerged that let users get around the restrictions. For example, users can still use Grok to edit images through the desktop website, thus avoiding the limitations applied to the mobile app. In addition, access to the image editing features remains available to users of the web version of X, raising doubts about the overall effectiveness of the measures X has taken to prevent the generation of harmful content.
Legal and Social Implications
X's actions have drawn the attention of legal authorities and regulators, particularly in the United Kingdom, where Ofcom has opened an investigation to determine whether X has violated the Online Safety Act. The authorities have stressed the need for stricter measures to prevent the spread of harmful content. In addition, the global community has expressed concern about the impact of such content on the safety and well-being of individuals, particularly women and minors, and about the need for greater accountability from technology platforms in managing user-generated content.
Conclusion
Despite the introduction of a paywall for Grok's image editing features, the measures X has taken have not effectively prevented the generation of non-consensual sexually explicit content. The workarounds that bypass the restrictions highlight the challenges of moderating AI-generated content and the need for more effective policies to prevent the abuse of such technologies. The legal and social implications of this phenomenon demand continued attention and commitment from technology platforms, regulators and society to ensure a safe and responsible online environment.
- Ineffective Paywall: Despite the introduction of a paywall, non-subscribed users can still use Grok to edit images, highlighting the limits of the measures X has taken.
- Workarounds: Users can bypass the restrictions by using the web version of X, raising doubts about the overall effectiveness of X's moderation policies.
- Legal Implications: Ofcom has opened an investigation to determine whether X has violated the Online Safety Act, with potentially significant legal consequences for the platform.
- Social Implications: The spread of harmful AI-generated content raises concerns about the safety and well-being of individuals, particularly women and minors.
- Need for Effective Policies: The challenges of moderating AI-generated content call for more effective policies and ongoing commitment from technology platforms, regulators and society.