November 16, 2025 | 09:26 pm
TEMPO.CO, Jakarta - The launch of OpenAI's latest artificial intelligence (AI) model, Sora 2, presents a digital double-edged sword. It demonstrates a new level of intelligence by generating videos from text instructions, yes, but it is evident that users have crossed societal norms, even bullying others using it.
Technology analyst from Digital Trends, Moinak Pal, dissected the impact of AI-generated videos that have recently flooded our timelines. Noting how Netflix CEO proudly boasts the prowess of artificial intelligence, he underscores how the streaming mogul overlooks the negative effects of generative AI.
Sora 2's application, he said, has been utilized to create bullying content. "OpenAI's new video-making tool is being used to flood the internet with some of the ugliest content imaginable, he said, as quoted from a review in Digital Trends on Friday, November 14, 2025.
"We're talking about a wave of straight-up fatphobic and racist “comedy” videos," he added, referring to videos generated by Sora.
Besides racism, some of the content created by Sora AI also leads to body-shaming, targeting individuals based on their weight. AI-engineered videos have rapidly spread and become the subject of mockery by many people.
OpenAI's Prevention System Failure
Sora 2 was designed with a policy to prohibit hate speech or harassment content. However, according to Moinak, the reality is that fat-shaming videos still manage to bypass the filters implemented by OpenAI.
Many users have found ways to manipulate the input prompt or text command. This method enables them to produce content that violates policies without being detected by the AI system.
This phenomenon indicates a major ethical loophole in the implementation of advanced AI technology. Strict policies do not always stop the malicious intentions of users.
Sora's ability to create highly realistic videos further exacerbates this problem. The videos produced are often misunderstood as authentic content. When one video goes viral, dozens of other attention-hungry users are compelled to make their own versions.
OpenAI is now facing a significant challenge in balancing technological innovation and social responsibility. Companies and regulators should be able to effectively and promptly address the misuse of their platforms.
The Floods of Sora OpenAI Deepfakes
The release of Sora AI has also raised new concerns about the weak detection of content manipulation, known as deepfake. The application has proven capable of producing fake videos that appear increasingly realistic, including mimicking the faces of famous figures such as Martin Luther King Jr., Michael Jackson, Bryan Cranston, as well as popular copyrighted characters like SpongeBob and Pikachu. A review by The Verge on October 27 revealed users reporting that their likenesses were used in racially charged AI-generated videos.
Although OpenAI provides an understanding that the content within the application is not real, the generated videos still spread like wildfires on social media, with no discernible marker that they were AI-generated. This situation indicates the weakness of content labeling systems, including C2PA authentication, a mechanism claimed to differentiate original content from that generated by AI.
The C2PA system, also known as content credentials, is a metadata system developed by Adobe to attach information about when and how an image, video, or audio was created or modified.
OpenAI is part of the board of directors for the Coalition for Content Provenance and Authenticity (C2PA), which collaborates with the Content Authenticity Initiative (CAI). However, the digital identifier is barely noticeable to the public.
Editor’s Choice: Family of Suicide Victim Sues OpenAI, Condemns GPT-4o Model
Click here to get the latest news updates from Tempo on Google News
Indonesia's BRIN Researchers Use Photonics and AI to Detect Plant Toxins
3 hari lalu
BRIN researchers have developed an innovation that uses light for various agricultural purposes, such as measuring seed hardness and visual detection.
Wikipedia Requires AI Developers to Cite Sources When Using Its Content
3 hari lalu
The provider of Wikipedia is aiming to sustain the online encyclopedia amid plummeting visitor traffic and AI expansion.
Australian Researchers Develop AI-Disrupter Tool to Combat Deepfakes
3 hari lalu
Researchers at Monash University collaborate with the Australian Federal Police to develop an AI system making it difficult to be manipulated into deepfakes.
Family of Suicide Victim Sues OpenAI, Condemns GPT-4o Model
7 hari lalu
The lawsuit also accuses OpenAI of accelerating security testing in order to beat Google's Gemini launch.
VP Gibran: Indonesia Aims to Nurture Islamic Students Skilled in AI and Blockchain
13 hari lalu
Vice President Gibran Rakabuming Raka said that Indonesia aims to produce tech-savvy Islamic students who can meet the challenges of the times.
Prabowo Attributes Indonesia's Food Self-Sufficiency Acceleration to AI Use
15 hari lalu
At the APEC summit, Prabowo stated that the utilization of artificial intelligence (AI) and high technology is the key for Indonesia to accelerate food self-sufficiency.
APEC Summit Adopts Declarations on AI and Demographic Change
15 hari lalu
The APEC Summit agreed on declarations regarding AI and changing demographics as it wrapped up on Saturday.
OpenAI: Over One Million ChatGPT Users Talk About Suicide Weekly
17 hari lalu
With ChatGPT reportedly exceeding 800 million weekly active users, that percentage translates to more than one million people each week.
Microsoft and OpenAI Sign New Intellectual Property and Investment Deal
17 hari lalu
The exclusivity rights continue to be enjoyed by Microsoft and OpenAI for AI development.
Amazon to Lay Off 14,000 Corporate Workers It Bets Big on AI Efficiency
18 hari lalu
Amazon announced on October 28, 2025, that it will lay off about 14,000 corporate employees to cut costs amid its increasing reliance on AI.
:strip_icc():format(jpeg)/kly-media-production/medias/5266416/original/075903700_1751001939-young-mother-playing-with-lovely-son-bedroom.jpg)
