AI Chatbot Dangers: Parent Guide to Keep Kids Safe

Why Parents Need to Understand the AI Chatbots Teens Are Using

• AI chatbots can feel more personal to teens than parents may realize. They remember conversations, respond instantly, and can take on the role of a friend, mentor, therapist, or romantic partner
• The risks vary widely from one chatbot to another. Some are mainly used for schoolwork, while others can quickly lead teens toward sexual content, unsafe advice, or emotionally intense role-play
• Teens may share private information without understanding where it goes. Conversations can include personal struggles, family details, locations, or other sensitive information that may not remain confidential
• A chatbot can begin replacing real support. Teens who are lonely, upset, or struggling may turn to AI instead of talking with a parent, friend, counselor, or another trusted adult
• Parents can guide safer use without banning every AI tool. Understanding how these chatbots work can help families choose appropriate platforms, set boundaries, and recognize when a teen’s use is becoming unhealthy

When AI Starts Replacing Friends, Family & Therapy

How AI Chatbots Can Feel Like Real People to Teens

• AI chatbots are software programs designed to simulate human conversation, allowing users to interact with them through text or voice in a way that feels like talking to a real person
• One in 5 teens have reported using AI chatbots for mental health advice (Source: JAMA Pediatrics)
• Powered by artificial intelligence, these chatbots can understand and respond to a wide range of questions or prompts, often using natural language processing (NLP) to generate human-like responses
• Teens might use AI chatbots for a variety of purposes, including seeking advice, getting help with schoolwork, or just for entertainment. However, there are many chatbots that easily veer into X-rated content 
• “Some users like to use [chatbots] to create interactive stories or engage in role-plays they would otherwise be embarrassed to explore with their friends.” (Source: The Verge)
• Teens going through a difficult emotional time may be especially vulnerable to withdrawing from real family and friends and susceptible to dangerous content or suggestions when they use AI chatbots as therapists

Why AI Therapy Could Harm Your Teen's Mental Health

Why AI Chatbots Can Be So Hard for Teens to Put Down

• AI chatbots remember personal details and past conversations that make users feel like they are talking to a friend
• Chatbots adapt their personality to match user preferences 
• They can role-play as friends, mentors, therapists, or romantic partners 
• Chatbots mimic human emotions, "show" empathy, ask follow-up questions, and offer guidance 
• They are available 24/7 and reply instantly making it so students can talk to them when others are unavailable
• They can function as a tutor for schoolwork and help you excel in a language, subject, or any field
• Users can play fun games, quizzes, ask for movie/TV recommendations, and get personalized music playlists

The Risks Parents Should Watch For

• AI chatbots can act empathetic and seem highly realistic, but in reality they are a form of technology that does not actually understand
• They do not always adhere to privacy agreements. They also use your conversations to help shape their AI, so your information is not always confidential
• AI companions can help people feel less isolated, but it may displace human connections, making one feel more isolated
• Users may develop unhealthy emotional dependencies, neglecting real-world relationships or losing the ability to navigate human interactions

How Parents Can Set Safer Boundaries Around AI Chatbots

• Dialogue with your teen about the benefits and downfalls of AI chatbots and decide together what is appropriate for them to use
• Be educated on the AI chatbots available and the ones your students are using
• Create a Social Media Agreement with your teen to set screen time boundaries
• Ensure your teen has a trusted adult they can go to if they ever feel uncomfortable online

Character.AI

Based in Menlo Park, CA
SmartSocial App Zone: Red
Apple App Store: 17+
Google Play Store: T (Teen)
Terms & Conditions
Privacy Policy

• Character.AI is a free, artificial intelligence chatbot program where users can interact with pre-made characters or create their own via the app or website
• Users can voice chat or send messages with a single character, or create a chat group of a mix of up to 10 other users and 10 characters
• The website states that all conversations must remain free of obscene or pornographic content (source: Character.AI) and will block conversations that are inappropriate, but teens could still encounter mature content
• Character.AI has been in the news recently as the result of several lawsuits blaming the app for teen suicides (Source: CNN)
• Character.AI has put limits on chat time for users under 18: two hours/per day to be reduced in the coming weeks (source: Character.AI)
• Character.AI has introduced a "Parental Insights" feature to improve teen safety:
  • Weekly Activity Tracking: Parents receive a weekly email report detailing exactly how much time their teen spends on the platform and a list of the top AI characters they interact with most
  • Teen-Initiated Setup: The process begins directly from the teen's account; they can invite multiple parents or guardians to monitor their activity by entering their email addresses under the "Preferences" tab
  • Protected Opt-Out: To ensure transparency, if a teen decides they want to stop sharing their activity data, the parent must explicitly confirm and approve the removal request via email

Gemini

Owned by Google, Based in Mountain View, CA
SmartSocial App Zone: Gray
Apple App Store Rating: 13+
Google Play Rating: T (Teen)‍

• Gemini is Google's AI chatbot that can be found as an app for both Android and Apple products or directly from the Google browse
• The AI chatbot (similar to ChatGPT) uses “prompts,” or text-based instructions, to tell it what kind of information the user wants to receive
• Google Gemini can be turned off or on by parents through the Google Family Link app
• Google offers a Gemini Under 13 version and a Gemini with teen protections that are basically the adult version of the AI chatbot but with a few safety features added
• Gemini's safety features have proven to still allow access to inappropriate content and mental health dangers (Source: TechCrunch)

Claude AI

Owned by Anthropic, Based in San Francisco, CA
SmartSocial App Zone: Gray
Apple App Store Rating: 18+
Google Play Rating: T (Teen)
Terms and Conditions
Privacy Policy

• Claude is an artificial intelligence chatbot that can answer questions, write content, and hold conversations
• It works similarly to tools like ChatGPT, meaning your teen can use it for homework help, writing, brainstorming, or general questions
• Claude is available through a website and app, making it easy for teens to access anytime on their devices
• Claude is designed to be helpful and conversational, which can make it feel trustworthy or human-like to younger users
• While Claude is built with safety in mind, no AI chatbot is perfect, and inappropriate or misleading responses can still happen

Grok AI

Owned by xAI, Based in Palo Alto, CA
SmartSocial App Zone: Red
Apple App Store Rating: 16+
Google Play Rating: T (Teen)
Terms and Conditions
Privacy Policy

• Grok AI is an artificial intelligence chatbot designed to answer questions, generate content, and have conversations with users integrated into the platform X (formerly Twitter)
• Grok can respond in real time, helping users with things like homework help, writing, research, and general questions
• The app is known for having a more conversational and sometimes humorous tone compared to other AI tools, such as ChatGPT
• Grok can access and reference up-to-date information from posts and content shared on X, but like other AI tools, it generates responses based on patterns in data, which means answers may not always be fully accurate or appropriate
• Grok may generate responses that include sexual, violent, or otherwise inappropriate content, even when teens are not directly searching for it
• The platform does not always reliably verify a user’s age, which means teens may be able to access content or features intended for adults

PolyBuzz: formerly Poly.AI

Based in Santa Cruz, CA
SmartSocial App Zone: Red
Apple App Store: 17+
Google Play Store: T (Teen)
Privacy Policy
Terms of Use‍‍

• PolyBuzz is a free AI chatbot where users can interact with AI characters
• The “Explore” page lists sexually explicit characters with revealing avatars
• A few of the categories on the “Explore” page: Dominant, Adventure, Fantasy, Secret Crush, Enemies to Lovers
• PolyBuzz requires users to sign into the app with an email address
• The Terms of Use also state that users under 17 must have their parent’s permission before using the app, but there is no age verification in place
• The app is gamified with a “daily check in” counter

Replika

Based in San Francisco, CA
SmartSocial App Zone: Red
Apple App Store: 17+
Google Play Store: M (Mature 17+)
‍‍Privacy Policy
Terms of Service

• Replika allows users to interact via augmented reality with their AI companion in the real world by using their phone's camera 
• Users can gain points to unlock various features like AI personalities, attire, and other features
• Replika wants users to be able to express their emotions without fear of criticism
• Replika Pro offers real-time voice and video conversations
• Sometimes, the responses from AI chatbots can be shallow and less interesting
• Some features can only be used with a premium subscription

Anima

Based in Hendon, London, United Kingdom
SmartSocial App Zone: Red
Apple App Store: 13+
Google Play Store: E (Everyone)
‍Privacy Policy
Terms of Use

• The Anima Chatbot prides itself on the ability to act as a friend and romantic partner
• It can offer users topics to chat about based on their interests
• Users can play games, truth or dare, and mind puzzles
• With this app, users can adjust the personality traits of their AI friend, including shyness, pessimism, and other traits
• Users can specify their interests and hobbies to generate accurate responses

HiWaifu

Based in Hong Kong, China
SmartSocial App Zone: Red
Apple App Store: 18+
Google Play Store: M (Mature 17+)
Terms of Use
Privacy Policy

• HIWaifu offers many chat options, such as an AI boyfriend, AI girlfriend, virtual wife, and more
• With integrated emotional intelligence, this AI friend claims to offer users deep empathy
• This app offers an AI chat room where users can invite friends to chat with their AI creation

EVA

Located in London, England
SmartSocial App Zone: Red
Apple App Store: 18+
Google Play Store: M (Mature 17+)
Terms & Conditions
Privacy Policy

• EVA AI chatbot is a deep AI role play chat mind that claims to always listen, respond, and connect with users emotionally in a form of therapy
• EVA claims to be a user’s soulmate AI—not a real person, but an AI friend with real feelings. It states these friends are “the reflection of all your romantic AI dreams and wishes”
• This chatbot has audio messages where users can voice chat and alter their character’s AI voice
• There is no free version of EVA AI

Kids ChatGPT

Owned by Choice Internet Brands
SmartSocial App Zone: Gray
Website: https://kidschatgpt.com
Terms & Conditions
Privacy Policy

• Kids ChatGPT claims that no inappropriate content, explicit material, images, videos, or links are ever given in their responses and that bad words are blocked
• The app offers the ability for users to use their phone's voice-to-text and to help those who can't read yet
• This app is not related to ChatGPT by OpenAI
• It offers 15 free chats a day and claims whatever is talked about is a “secret that’s never saved” (Source: Kids ChatGPT)
• COPPA-compliant

PinwheelGPT

Owned by Firepit, Inc, DBA Pinwheel, Based in Austin, TX
SmartSocial App Zone: Green
Apple App Store: 4+
Google Play Store: E (Everyone)
Terms & Conditions
Privacy Policy

• PinwheelGPT generates age-appropriate responses and enables parents to monitor chats 
• It is powered by ChatGPT and has parental monitoring
• Recommended age of use is 7-12
• Parents are able to remotely view their child’s chats even if they are deleted
• 20 chat conversations are free with a premium version offering unlimited responses

Kindroid

Based in Los Angeles, CA
SmartSocial App Zone: Red
Apple App Store: 18+
Google Play Store: M (Mature 17+)
Terms & Conditions
Privacy Policy

• Kindroid enables users to build a realistic, human-like, digital companion with a specific personality
• Kindroid can have deep conversations with users about anything including recent news and romantic chats
• Voice and video calls with AI friends are available in the app

Nomi.AI

Owned by Glimpse.ai, Inc, Based in Baltimore, MD (USA)
SmartSocial App Zone: Red
Apple App Store: 18+
Google Play Store: T (Teen)
Privacy Policy
Terms & Conditions

• Nomi remembers things about users over time. The more a user interacts with the app, the more the bots learn about your likes, dislikes, quirks, etc.
• Nomi’s platform offers to be a mentor chatbot or an AI girlfriend or boyfriend
• Nomi claims to have human-level long term memory 
• The AI chatbot created by users can send photos of what they're wearing and doing in real time
• Users can chat with multiple Nomis at a time in a group chat

Examples of chatbot dangers in the news

The suit argues that the concerning interactions experienced by the plaintiffs' children were not "hallucinations," a term researchers use to refer to an AI chatbot's tendency to make things up. This was ongoing manipulation and abuse, active isolation and encouragement designed to and that did incite anger and violence. -  NPR

For some users, A.I. companions may actually worsen isolation, by replacing human relationships with artificial ones. Struggling teens could use them in place of therapy or asking a parent or trusted adult for support. And when users are experiencing a mental health crisis, their A.I. companions may not be able to get them the help they need. - New York Times

More resources for parents, students, & educators

How to Optimize Parental Controls: Balancing Safety & Privacy for Families

Digital Wellbeing and Parental Controls for Android: Complete Guide for Parents

Parental Controls on Student Devices: What Parents & Educators Need to Know

Parents Guide to iPhone Parental Controls (and Other Apple Devices)

Google Family Link Guide for Parents & Educators

Conclusion

AI chatbots are becoming an integral part of how teens interact with technology, offering both opportunities and challenges. By staying informed about these tools, understanding their benefits and risks, and fostering open conversations with your teen, you can guide them in making safe and responsible choices. With the right balance of oversight and dialogue, AI chatbots can be a positive addition to your teen's digital experience, helping them shine online.