Ensuring Safety in the Generative AI Ecosystem: Protecting Users from Non-Consensual Intimate Content

Posted by Ron Aquino, Senior Director, Trust & Safety, Chrome, Android, and Play At Google Play, user safety and developer success go hand in hand. We continue to see growth in apps with AI generated features, and indeed, adding generative AI into your apps is a great way to unlock incredible creative possibilities. However, AI features also bring new safety challenges - such as the rise of AI-facilitated generation of non-consensual intimate imagery (NCII).