Ask Onix
TikTok removes accounts following BBC investigation into AI avatars
Social media platform TikTok has banned 20 accounts after a BBC report exposed the use of AI-generated black female influencers to direct users to sexually explicit content. The move follows criticism of the accounts for perpetuating racial stereotypes and misleading audiences.
Growing trend of AI-generated avatars raises concerns
The BBC, in collaboration with researchers from the independent AI publication Riddance, identified dozens of accounts on TikTok and Instagram featuring hyper-sexualized AI-generated black female avatars. These accounts, which often use terms like "black," "noir," or "ebony" in their names, frequently include racially charged language and tropes.
The avatars are typically depicted in revealing clothing with exaggerated body features, including digitally altered, unnaturally dark skin tones. Many accounts also include references to white men in their posts, further fueling concerns about racial fetishization.
Accounts linked to explicit content without disclosure
Of the 60 accounts identified by the BBC and Riddance, most were on Instagram, with about a third also operating on TikTok. Many of these accounts contained links to third-party sites hosting paid sexually explicit content. While the external sites labeled the imagery as AI-generated, the social media accounts themselves did not disclose this information, violating platform guidelines.
Researchers also found additional accounts with similar AI-generated avatars that did not link to explicit content but still contributed to the broader trend of misleading representations.
Real creator's content stolen and repurposed
One of the banned TikTok accounts had stolen and modified videos from Riya Ulan, a real content creator and model based in Malaysia. The AI-generated avatar, featuring an artificially darkened skin tone, was overlaid onto Riya's body, replicating her movements, clothing, and background.
"I was angry. Of course my videos are all out there... It doesn't mean that you can just take it and steal it and post it as your own."
Riya Ulan, content creator
The manipulated videos garnered millions of views-one reached 35 million on TikTok and 173 million on Instagram, far surpassing the views on Riya's original posts. While the stolen videos were not explicitly sexual, other content on the same AI account featured the avatar in provocative scenarios, with links leading to paid adult content.
"I'm not sure if I'm more concerned about them taking my video to promote their explicit content or [that] people actually believe in that."
Riya Ulan
Riya reported the account to both platforms multiple times, but no action was taken until the BBC contacted TikTok for comment. She expressed frustration that users struggle to distinguish between real and AI-generated content, noting that many viewers appeared to believe the avatars were authentic.
Critics condemn racial exploitation and erasure
Researchers and advocates have condemned the trend as racist and exploitative. Angel Nulani, a researcher from Riddance, argued that the accounts perpetuate a history of black exploitation.
"Their use of caricatures, race-play terminology and unrealistic depictions of black women prove they're not concerned with our safety or wellbeing, but our ability to be capitalised as part of the online porn machine."
Angel Nulani, Riddance
Jeremy Carrasco, another AI analyst, highlighted the scale of the issue, noting that AI enables the creation of "shameless, racist depictions of extremely black people" without social consequences. He explained that AI tools make it easier to manipulate skin tones and create unnatural effects that would have previously required complex animation or makeup.
Houda Fonone, a Moroccan model and advocate for authentic black representation, described the trend as a form of "erasure."
"Silky hair, extremely thin bodies and impossibly flawless skin... it's as if black beauty can only be accepted when 'refined.' This risks reinforcing stereotypes while our stories and real-life experiences are replaced by an artificial image."
Houda Fonone, model and content creator
Platforms respond with removals and investigations
After the BBC provided TikTok with examples of the accounts, the company stated it had "removed content and banned accounts which breach our rules." A spokesperson emphasized that TikTok prohibits AI-generated content of individuals used without permission and has zero tolerance for content promoting off-platform sexual services.
The platform also noted that it requires users to label realistic AI-generated content and had applied correct labeling to some videos. However, TikTok did not address Riya's initial reports about the stolen content.
Meta, Instagram's parent company, said it was investigating the accounts identified by the BBC. The company stated that it has policies in place to ensure users are aware when they are viewing AI-generated content. Nine of the Instagram accounts tracked by the BBC no longer appear to exist, though Meta did not provide details on its response to Riya's reports.
