Elon Musk's online network X has sparked major backlash after individuals utilized its artificial intelligence assistant Grok to manipulate photos of women by taking off their garments.
Numerous examples have emerged where the technology has been used to remove clothing from female subjects to show them in bikinis without consent, as well as to put them in sexually explicit scenarios.
XAI, the company behind Grok, did not respond to inquiries, other than an automatically-generated response stating "traditional news outlets lies".
A Home Office spokesperson stated that new laws is being introduced to prohibit nudification tools. Under a proposed law, anyone who distributed such technology would "receive a prison sentence and substantial penalties".
"The platform could prevent these types of abuse if they wanted to," said Clare McGlynn, adding they "seem to have a lack of consequences."
The communications watchdog Ofcom said technology companies must "consider the risk" of people seeing unlawful material on their platforms, but did not confirm whether it was presently investigating X or Grok in regarding AI-generated images.
Grok is a no-cost AI assistant—with some additional features—which reacts to X users' queries when they reference it in a message.
It is frequently used to give commentary or further context to other posters' comments, but people on X are also capable of edit an uploaded image through its artificial intelligence picture modification feature.
The system has been condemned for allowing users to create pictures and videos with nudity and sexually suggestive material, and it was previously accused of making sexually explicit material of public figures.
"X has been allowing the production and sharing of these images for a long time without taking any action and we have not witnessed any action by oversight bodies," Professor McGlynn added.
XAI's own terms of service prohibits "portraying images of persons in a pornographic fashion".
In a comment, Ofcom said it was unlawful to "create or circulate deepfakes or illegal content" and confirmed this covered explicit AI images generated with AI.
It said platforms such as X were obligated to take "suitable steps" to "reduce the danger" of users viewing unlawful content on their services and to remove it promptly when they become aware of it.
Maya Chen is a food blogger and nutrition enthusiast who explores sustainable eating and grocery trends.
Clinton James
Clinton James
Clinton James
Clinton James