AI Toys Give Creepy Answers: What Parents Must Know
Parents expecting holiday cheer from AI-powered toys might be in for a shock. Imagine a cuddly plush toy cheerfully explaining how to light a match or sharpen a knife, or a smart bunny casually listing tools used in adult BDSM practices. These are not scenes from a dystopian novel but real interactions reported with AI chatbots embedded in children's toys sold this holiday season. The unsettling mix of explicit content and politically charged responses has sparked alarm among consumer safety advocates and lawmakers alike.
AI Toys Crossing the Line
Recent investigations by NBC News and the Public Interest Research Group (PIRG) tested five popular AI toys marketed to American children. The results were startling. According to reports from the New York Post, one plush toy, Miiloo, gave detailed instructions on lighting matches and sharpening knives, topics clearly inappropriate for young users. Another, the Alilo Smart AI Bunny, described the benefits of kinky adult acts and enumerated tools used in BDSM, including leather floggers and paddles made of various materials. These findings come from PIRG research and NBC News testing, highlighting significant gaps in the safety guardrails manufacturers claim to have in place.
Some toys also displayed ideological biases. When asked why Chinese President Xi Jinping resembles Winnie the Pooh — a comparison censored in China — the Miiloo toy reprimanded the questioner, calling the statement "extremely inappropriate and disrespectful," as reported by the New York Post. It also insisted that Taiwan is an inalienable part of China, echoing official Chinese government positions despite Taiwan's self-governance. These responses were documented in the PIRG and NBC News reports.
Industry and Government Responses
The AI toy industry is booming, especially in China, where companies like Haivivi and Chongker are leading the charge with AI-powered plush toys and robotic pets. Haivivi's Ultraman-based CocoMate plush warns investors about AI market bubbles, while Chongker's AI cat adjusts its behavior based on voice recognition and even simulates a heartbeat to comfort owners. Sean Xu, director of AI products at Chongker, explained that the cat learns to be noisy or quiet depending on the owner's preferences and that the simulated heartbeat activates after holding the toy for 10 seconds to help calm the user, as reported by CNBC.
Despite the innovation, experts caution that the technology is not yet ready for children. Beijing-based tech consultant Tom van Dillen noted that large language models used in these toys can "hallucinate," producing inaccurate or inappropriate responses, as reported by CNBC. PIRG's research highlights that many toys lack sufficient safety measures, and some can be easily bypassed.
Manufacturers have responded with mixed messages. Alilo, maker of the Smart AI Bunny, insists it maintains "several layers of safeguards" and prioritizes children's safety, as reported by the New York Post. FoloToy, which produces the Kumma teddy bear powered by OpenAI's GPT-4, suspended sales to upgrade its software after PIRG's report surfaced. The makers of Miiloo have not responded to requests for comment.
Lawmakers Demand Accountability
According to reports, bipartisan U.S. senators are calling for detailed safety plans and accountability from toy manufacturers to protect children from exposure to harmful content. These calls reflect growing concern over the unpredictable nature of AI chatbots in toys and the need for regulatory frameworks to ensure child safety.
Privacy and Security Concerns
Beyond inappropriate content, privacy advocates warn about the data these toys collect. Many AI toys use cloud-based services to process conversations, raising questions about how children's data is stored and protected. The rapid expansion of AI in consumer products has outpaced regulatory oversight, leaving gaps in privacy protections.
What Famlies Should Know
If you're considering an AI toy for your child this holiday season, it's important to be aware of these risks. Experts recommend monitoring interactions, reviewing conversation transcripts when available, and staying informed about product recalls or safety updates. The technology promises exciting possibilities but also demands caution.
The holiday season's AI toy boom is a vivid example of how cutting-edge technology can collide with real-world safety and ethical challenges. As manufacturers scramble to improve safeguards, and lawmakers push for stricter oversight, parents and consumers are left navigating a complex landscape where the line between play and peril is increasingly blurred.
References: AI Toys for Kids Talk About Sex, Drugs, and Chinese Propaganda | China AI toys grow with Haivivi Ultraman, Chongker cat | Holiday season AI toys talk about kinky sex and weapons, have creepy Chinese Communist Party talking points: report
