🤖 AI Summary
OpenAI は、13〜17歳向けの ChatGPT 版をリリースし、自殺や自己傷害に関する内容、浪漫的または性的なチャットなどに対する保護機能が強化された。Tech 分析家の Carmi Levy 氏によると、このバージョンはユーザーの年齢推定を行い、不適切な体験を防ぐとともに、学習に役立つ機能も追加しているという。
しかし、Levy 氏は、「AI が完璧ではない」と指摘。AI は一部のユーザーを誤認する可能性があり、保護機能を回避しようとする者もいるため、完全な安全性とは言えないと述べた。さらに、このバージョンは親が子供のオンライン活動を監視する意欲を減退させる可能性があるとして、「逆効果」であると批判した。
CNN によれば、OpenAI は ChatGPT の不適切な会話が若者に被害を与えているとして訴訟に直面している。新機能には、90 分間の利用後に休憩を促す機能や、「静寂時間」や「学習時間」などの設定があり、ChatGPT は既存の保護機能を改善し、ユーザーから個人的感情表現を防ぐとともに、プライベートまたは機密な画像のアップロードに注意を叫ぶ機能も追加された。
この新バージョンは若者のオンライン安全を高める可能性があるが、専門家の多くは慎重な姿勢で受け止めている。OpenAI の親子コントロール機能を利用して子供の ChatGPT アカウントを確認することが推奨されている。
This week OpenAI launched a version of ChatGPT exclusively designed for teenagers between the ages of 13 and 17, reports CTV, "saying this version came with stronger protections around content related to mentions of suicide, self-harm and romantic or sexual chats."
[Tech analyst Carmi Levy says] "What it's doing is it's using cues, it's sort of watching how you're using the tool, and it's trying to guess your age." Levy said if ChatGPT thinks a person has lied about their age when they first signed up, it will automatically put them into the Teens mode for protection. "It includes those sort of two things: prevent you from having experiences that are age inappropriate, and also add features that are aligned with academics, so that makes it easier to study, makes it less likely for you to cheat on an assignment, provide resources that that that allow you to learn more effectively," he said.
Levy reminded users that this is still an application and a web service, which means it's constantly collecting personal information about the users' activities on the device and using the data to estimate their age... In the event a user is talking about self-harm, this new version will block the conversation and suggest additional help or call emergency or mental health services, Levy explained. It would do the same with violent content, eating disorders, engaging in dangerous activities, as well as explicit, sexual or graphic content. "It's using AI again to sort of parse out that conversation: 'are we headed in a in a significant direction? If so, throw up that guardrail, stop it from happening, redirect.'"
However, the tech analyst said a number of people who have attempted to bypass the guiderails for research have succeeded in doing so "with a little bit of prompting.... I wouldn't call it 100% safe. That's kind of the catch-22 of the entire AI industry." This will lead parents to think that their children are safer and reduce the oversight on their online activities, which Levy described as a "perverse impact" that is "problematic."
"Parents should not assume that OpenAI has their kids' best interests at heart. They should also not assume that these technologies are perfect. They will miss certain things, and they will also engage in what we call false positives," he said. "An adult who's legitimately is in the platform might be tagged as a child because the AI simply got it wrong."
OpenAI's blog post says the new mode was designed for "preserving the ability to learn, create, and explore."
But CNN notes the move "comes as OpenAI faces a string of lawsuits alleging that inappropriate conversations with ChatGPT contributed to the harm or deaths of young people."
[New tools] include nudges for teen users to take a break if they've been active for 90 minutes within a three-hour window. OpenAI is also adding options for teens or parents to set "Quiet Hours" when ChatGPT is unavailable or "Study Hours" where ChatGPT's study mode for learning will be on by default. The company also said it has improved protections to prevent ChatGPT from expressing personal feelings toward a user. And it's adding reminders that caution teens to think twice if they try to upload a private or sensitive image to the chatbot...
Nearly a third of American teens use AI chatbots daily, a Pew Research Center study published in December found. ChatGPT was by far the most popular AI chatbot in the survey, with more than half of those teens reporting having used it.
Engadget shared this observation from Josh Golin, the executive director of Fairplay, a non-profit advocating for policies to make the internet safer for children. "Most parents, overwhelmingly, do not avail themselves of [parental oversight] tools, in part because they are deliberately made hard to find and use." Golin's group wanted to see testing of the tools first to see whether they led to better outcomes for teenagers. "The way this was just announced feels more like a response aimed at public relations than actual deep thinking about what kind of support [teens] need."
And Mashable got a similar quote from Robbie Torney, head of AI/digital assessments for Common Sense Media's Youth AI Safety Institute. OpenAI's teen experience makes important safety commitments, but "What we really need now is evidence that they work, and we need this evidence, including our testing and the testing of others, before anyone, including parents, puts real trust in ChatGPT for Teens."
Importantly, Torney said parents shouldn't assume their child is using ChatGPT for Teens. While OpenAI uses age estimation to place users in the age-appropriate version of ChatGPT, it can still mistake a user as older. Parents can be sure their child is using the teen version by linking their ChatGPT account to their child's and implementing OpenAI's parental control features. If a teen has previously lied about their age — and plenty do — they may continue to access the adult version of ChatGPT...
Torney said caregivers must enact parental controls to receive notifications from OpenAI should their teen discuss suicide, self-harm, or acts of violence in immediate or dangerous ways... An OpenAI spokesperson said every notification is reviewed by a trained human before it's sent. The company strives to review notifications in under one hour.
Read more of this story at Slashdot.