Case 09
Deepfake fraud
 
A family in Arizona
 
Arizona, United States
 
2023

The phone call in a daughter's voice

A mother heard what sounded exactly like her daughter crying for help, then a man demanded a ransom; her daughter was safe all along.

What happened

In January 2023, a mother in Scottsdale, Arizona, took a call from an unknown number. She heard a voice that sounded just like her 15-year-old daughter, who was away training for a ski race, crying for help.

A man then said he had her daughter and demanded US$1 million. Other parents nearby called the police and tried to reach her husband and daughter. Within minutes, they confirmed the daughter was safe. The "kidnapping" was a scam.

The mother told CNN she believes the voice was cloned with AI. Police had not confirmed whether AI was used. In March 2023, the US Federal Trade Commission had warned that scammers can clone a relative's voice from a short clip posted online.

Why it happened

Voice-cloning tools learn the sound of a person's voice from audio samples. According to the FTC, a short clip, such as one from a social media video, can be enough to make new speech in that voice.

These scams work on emotion, not technology. Fear and urgency stop you from checking. A familiar voice feels like proof, even though it no longer is.

The idea behind this caseLesson: Spot AI-powered scams →

What would have stopped it

  1. 1Agree a family code word that a real caller in trouble would know.
  2. 2Hang up and call the person directly on the number you already have.
  3. 3If you cannot reach them, contact another family member or friend who is with them.
  4. 4Never send money by wire, crypto or gift cards because of a frightening call.
  5. 5Think about how much of your family's voices and travel plans are public online.
Your phone rings. It sounds exactly like your son, crying, saying he has been in an accident and needs money for a lawyer right now. Then someone else takes the phone and asks for a bank transfer. What do you do first?

Would you have caught it?

Your phone rings. It sounds exactly like your son, crying, saying he has been in an accident and needs money for a lawyer right now. Then someone else takes the phone and asks for a bank transfer. What do you do first?

Sources

  1. 'Mom, these bad men have me': She believes scammers cloned her daughter's voice in a fake kidnapping · CNN · 2023-04-29
  2. Scammers use AI to enhance their family emergency schemes · US Federal Trade Commission · 2023-03-20

Don't become a case file.

We help teams use AI with the checks that would have prevented every incident on this page.

AI training for teams
Next case →The search answer that said to add glue to pizza