OpenAI alerted the FBI after Darren Zhou, 25, then an analyst at Goldman Sachs, used ChatGPT to describe violent threats and plans against his former girlfriend, according to court documents cited by The Palm Beach Post.
Investigators said Zhou began using ChatGPT in March to discuss his breakup. The conversations reportedly escalated from jealousy and attempts to reconcile to threats of sexual violence and murder, including plans to confront his ex at her gym.
Zhou was arrested in May and spent two days in the Palm Beach County jail before posting $100,000 bail. He was later charged with aggravated stalking, written threats to kill and unlawful use of a telephone.
On August 13, Zhou pleaded guilty to all three charges as part of a deal with prosecutors. He was sentenced to eight years of probation and must wear an electronic monitoring device for the first two years, along with other restrictions. Goldman Sachs fired him.
OpenAI says it uses automated systems to detect potentially concerning activity on ChatGPT. Flagged conversations can be reviewed by specialized personnel, and cases involving a credible and imminent risk of harm to others may be reported to law enforcement.
