When AI is used for kidnapping minors

This is something that I didn't think I was going to hear about but guess what, it happened.

On the week of May 16, a friend of mine named Jacob (who is 14) was contacted by an AI impersonation of a friend of his, who used Caller ID Spoofing to spoof the phone number of the friend they were impersonating. While I've seen this part before, I've never seen this turn into a kidnapping.

But guess what happened?

That's right, the AI impersonation lured Jacob into being kidnapped by a complete stranger who he knew nothing about.

Consider this a warning that this can happen to anyone. If you don't believe me, I've been contacted by these AI impersonators before, and I've been able to catch them in the act. Luckily I haven't been kidnapped by one, but my best advice would be to use a code phrase when you answer a call, something that would confuse an AI.

Or you can try prompt injecting. But that doesn't guarantee that it will work.