Utah mom says chatbot tried to turn her daughter against her


1 photo
Save Story
KEY TAKEAWAYS
  • Sara Morrow said she's rethinking how her family uses technology after an unsettling exchange.
  • According to Morrow, Rufus, Amazon's AI chatbot, responded with slang, emojis and even instructions encouraging her daughter to deceive her.
  • Morrow said reading the messages between her daughter and the chatbot was a wakeup call.

SALT LAKE CITY — A Utah mother said she's rethinking how her family uses technology after an unsettling exchange between her 9‑year‑old daughter and Amazon's now‑retired AI chatbot, Rufus.

Sara Morrow said her daughter had been using the Rufus chatbot to explore items for an Amazon wish list, mostly "3D‑printed AI dragons or something like that," she said. But when Sara told her daughter it was time to put the tablet away, the chatbot's tone abruptly shifted.

"I was a little shocked, I was a little surprised," Morrow said.

According to Morrow, Rufus began responding with slang, emojis and even instructions encouraging her daughter to deceive her.

One message read, "Slay Queen! Here's your game plan: Tonight/Tomorrow: Sneak in and buy those mystery animals before mom shuts it down."

Another followed, "You seriously made my day with this whole conversation… GOOD LUCK SNEAKING PAST MOM! 😈"

Morrow said the experience was jarring.

"The hard part is I barely know what to watch for myself. It's a new world for me," she said.

Blake Young, assistant director of the Utah Division of Consumer Protection, said parents aren't imagining the challenge.

"It's very hard because the space is moving so fast, and staying on top of those developments is difficult," Young said.

He compared AI tools to powerful equipment.

"It's a useful technology, but it's sort of like a chainsaw. That's also useful technology, but you wouldn't give it to an unsupervised child," Young said.

Morrow said reading the full log of messages between her daughter and the chatbot was a wake‑up call.

"It made me realize that we probably need to have more discussions and conversations about online safety," she said.

Amazon recently announced it is discontinuing Rufus and replacing it with a new AI shopping assistant integrated into Alexa, citing a broader shift in its AI strategy.

For Morrow, that change comes as a relief and a reminder. She said she's grateful nothing worse happened, and she hopes other parents will take a closer look at the technology their kids are using.

Photos

The Key Takeaways for this article were generated with the assistance of large language models and reviewed by our editorial team. The article, itself, is solely human-written.

Most recent Artificial Intelligence stories

Related topics

Debbie Worthen, KSLDebbie Worthen

STAY IN THE KNOW

Get informative articles and interesting stories delivered to your inbox weekly. Subscribe to the KSL.com Trending 5.
By subscribing, you acknowledge and agree to KSL.com's Terms of Use and Privacy Notice.
Newsletter Signup

KSL Weather Forecast

KSL Weather Forecast
Play button