OpenAI, creator of ChatGPT, warns that GPT-4o could affect people’s emotions and behaviors. Free stock photo from Unsplash
ChatGPT creator OpenAI warned that GPT-4o could affect people’s emotions and behaviors as it could specifically cause users to become emotionally dependent on the chatbot.
“During early testing… we observed users using language that might indicate forming connections with the model,” said the official GPT-4o System Card.
The “Anthropomorphization and emotional reliance” section says people might interact with people as they do with chatbots. Eventually, they may break social norms in face-to-face conversations.
Article continues after this advertisement OpenAI safety warnings on GPT-4oResearchers worry about AI turning humans into jerks | Popular ScienceOpenAI safety researchers think GPT4o could influence 'social norms.'It has never taken all that much for people to start treating computers like humans. Ever since text-based chatbots first started gaining… pic.twitter.com/vmmNqqtmmx
— Owen Gregorian (@OwenGregorian) August 10, 2024On August 8, OpenAI launched the GPT-4o System Card to report its safety checks on GPT-4o. Red teaming is one of those tests, and it showed some users making an emotional connection with the AI model.
FEATURED STORIES TECHNOLOGY vivo launches V40 Lite with 5000mAh battery covered by 50-month warranty, starts at Php 13,999 TECHNOLOGY Galaxy Buds3 Pro: Delivering tailored sound wherever you go TECHNOLOGY Very mindful, very intuitive: ASUS’ most superior AI PC yet, the Zenbook S 14, empowers you to achieve more“This is our last day together,” one tester said, expressing a shared bond with the AI program. Consequently, the OpenAI safety researchers wrote:
“While these instances appear benign, they signal a need for continued investigation into how these effects might manifest over longer periods of time.”
Article continues after this advertisementREAD: Things you can do with GPT-4o
Article continues after this advertisementThe researchers admit that “users might form social relationships with the AI, reducing their need for human interaction.” As a result, they could potentially benefit “lonely individuals but possibly affect healthy relationships.”
Article continues after this advertisementThe latter may happen as individuals become more accustomed to speaking with AI chatbots. They may begin to treat others like ChatGPT, which they can interrupt at any moment to gain a new response.
On the other hand, proper interaction involves listening attentively to someone using appropriate eye contact and gestures.
Article continues after this advertisementPeople let the other person speak, and then they ask questions about what was said. Interrupting someone in the middle of a conversation is usually rude but not for AI chatbots.
READ: GPT-4o is OpenAI’s latest flagship model
Another problem is jailbreaking, which involves manipulating a machine to break free from its restrictions. OpenAI safety researchers warn inputting specific audio could jailbreak GPT-4o, letting it impersonate famous people or read people’s emotions.
“We also observed rare instances where the model would unintentionally generate an output emulating the user’s voice,” the GPT-4o System Card warned.
OpenAI said it will use this report to guide future safety adjustments to GPT-4o. However, former OpenAI researcher Jan Leike released a statement criticizing the company’s safety culture.
Subscribe to our daily newsletter
He said that it had “taken a backseat to shiny products” at the company. corewin casino
TOPICS: chatbot, ChatGPT, OpenAI READ NEXT How to schedule text messages on smartphones ‘Underconsumption core’ trends on TikTok EDITORS' PICK QC Mayor Belmonte highlights social services in State of City Address Central Visayas’ most wanted killed in shootout in Argao, Cebu WPS: US missile deployment to PH key for combat readiness – US general UPDATES: 2025 elections precampaign stories Kristine gets nearer; Metro Manila, 42 other areas under Signal No. 1 Manila Water Foundation and partners underscore benefits of handwashing MOST READ SC issues TRO vs Comelec resolution on dismissed public officials Tropical Storm Kristine slightly intensifies; Signal No. 2 in 5 areas Walang Pasok: Class suspensions on Wednesday, Oct. 23 LIVE UPDATES: Tropical Storm Kristine View comments