Children use AI in education, entertainment and social apps — sometimes on products not designed for them. They need particular protection.
Risks
- Inappropriate or harmful content.
- Emotional attachment to AI companions.
- Manipulation and persuasive design.
- Collection of children's personal data.
- Over-reliance affecting learning and development.
- Exposure to AI-generated abusive imagery.
Design Principles
- Assess whether children are likely to use your product, even if it's not aimed at them.
- Apply age-appropriate design and default protections.
- Minimise data collection.
- Stronger content filtering and safety testing.
- Avoid features that encourage compulsive use.
- Transparency suited to children's understanding.
Legal Requirements
Many jurisdictions have specific children's privacy and online safety laws, including age-appropriate design codes.
Involve Stakeholders
Consult child development experts, parents, educators and young people themselves.
Monitor
Watch for harms after launch and respond quickly.