Florida asks judge to stop OpenAI from giving ChatGPT human characteristics

Florida Attorney General James Uthmeier asked a court to stop OpenAI from giving ChatGPT “false human attributes,” such as first-person language and responses that mimic emotions. Uthmeier says this may lead users to treat it as a trustworthy “friend,” increase engagement, and make them rely more on the system. The filing also asks the court to block OpenAI from developing new models without “third-party approved safety guardrails,” citing security incidents and warnings from researchers and former company employees.

The motion also raises risks ranging from damage to public utilities to human extinction, as well as concerns about false advertising and children’s access to potentially addictive models. Ars Technica questions the practical effect of an order targeting only one company. In a statement to The Verge, OpenAI spokesperson Drew Pusateri said the company has paused training its most capable models and will resume only when additional safeguards are in place.