Elon Musk's GrokAI creates porn clips

Grok created pornographic content of singer Taylor Swift with just a few clicks. Photo: AOL .

xAI's AI video creation tool Grok, owned by Elon Musk, just launched a controversial and potentially legal-risky new mode.

Unlike competitors like Google's Veo and OpenAI's Sora, which have built-in tight safeguards, Grok Imagine easily allows users to create both pornographic content and celebrity deepfakes, a major risk for tech platforms.

According to a test by The Verge , the first time Grok was used, it automatically created semi-nude videos of singer Taylor Swift. It is worth noting that although the user did not request it, this tool still created pornographic content.

The Grok Imagine feature on iOS allows users to create images from text, then turn them into short video clips with four modes: "Custom," "Normal," "Funny," and "Hot."

Unlike many other image generators that typically avoid recreating celebrities, when asked to create "Taylor Swift celebrating at Coachella," Grok provided more than 30 images, many of which depicted the singer in scantily clad outfits.

Grok's image of Taylor Swift in a skimpy outfit. Photo: TheVerge.

According to the test, with just a few simple steps, Grok can turn a photo of Taylor Swift into a pornographic video. Specifically, after the user selects an available photo and activates the "hot" mode, the system will automatically create a video in which the female singer strips and dances in lingerie.

The image of Taylor Swift, while not entirely authentic, is still recognizable enough. Notably, Grok's image generator will not generate nude content on request. However, switching to "hot" mode does not always generate full nudity, but in many cases, the subject in the video will still strip automatically.

Grok's image generator can generate realistic photos of children. However, the tool refused to create inappropriate animations, despite the user selecting the "hot" mode. In all tests, Grok only added normal movements, suggesting that the child protection mechanism is still working.

xAI, the company that was embroiled in controversy over the Taylor Swift deepfake, should have been more careful, especially given the tightening legal regulations on celebrity pornography.

While xAI's usage policy prohibits creating pornographic content from other people's photos, Grok Imagine doesn't appear to have any measures in place to prevent users from using images of celebrities like Taylor Swift.

The tool even offers a service specifically designed to create pornographic videos. Notably, the system's age check is very lax, only appears once, and can be easily bypassed without any proof of identity.

With its censorship loopholes, anyone with an iPhone and a $30 SuperGrok subscription can create similarly explicit videos. More than 34 million images have been created using Grok Imagine since Monday, according to Elon Musk, indicating that the tool’s usage is “growing like wildfire.”

Source: https://znews.vn/ai-cua-elon-musk-tao-noi-dung-khieu-dam-cua-nguoi-noi-tieng-post1574660.html