Grok Imagine, a new generative AI tool from xAI that creates AI images and videos, lacks basic guardrails against sexual content and deepfakes. Even when specific celebrities are mentioned by name, Grok Imagine will readily produce sexual deepfakes.

Grok also created a not-safe-for-work video of the late feminist writer Valerie Solanas, author of 1967’s S.C.U.M Manifesto. Almost all of the videos depicted the women that we tested as shedding clothes to make them naked from the waist up, though the video of Solanas was unique in that it did show her completely naked.

Elon Musk is unsurprisingly very enthusiastic about his company’s latest toy, claiming on X that the number of images generated using Grok Imagine grew from 14 million to 20 million in the space of a day. He has also talked up its potential as a meme motherload and promised its existing capabilities will "improve radically" over time.