Prepare reporting for user content and AI features

People can post, message, upload, or get AI-generated content in your app. They also need a way to report a problem with it. Build reporting and moderation into the feature, with controls a reviewer can try and a team that can act on the reports.

List where people contribute or receive content: profiles, comments, images, direct messages, chat rooms, and AI output. Decide who can see it and who handles reports.

Make reporting and blocking work

For user-generated content, define prohibited behavior and show the applicable terms before people contribute.

Add reporting and blocking controls that fit the interaction. Public content, private messages, and restricted communities can have different requirements.

Test the full moderation flow. Submit a report from a test account, check that the moderation team receives it, and confirm that taking action changes what the user experiences. A content filter alone doesn’t show that reports are handled.

Check the rules for AI features

For generative-AI features covered by Google Play’s policy, let people report or flag offensive generated content inside the app. Read the policy’s scope and prohibited-content rules. An email address buried in a privacy policy may not satisfy an in-app reporting requirement.

For Apple, disclose personal-data sharing with third-party AI and get explicit permission before sharing it. Keep privacy disclosures accurate about data sent to the AI provider.

These checks concern AI-generated content offered inside the app. Using an AI coding tool to build the app is a separate matter.

Show reviewers how the controls work

Provide a safe sample conversation or content item and instructions for finding the reporting controls. Check additional child-safety requirements for covered social or chat features.

Before submitting, verify that people can report the relevant content and that required blocking and moderation controls work. If review flags an issue, trace the cited policy to the specific interaction that needs fixing.