Moderation API Introduction

Stream's Moderation API offers a comprehensive and flexible solution for developers seeking to implement content moderation within their applications, ensuring a safe and positive user experience. The API includes features such as the Moderation Check Endpoint for real-time analysis of various content types, including text, images, and videos, and provides recommendations such as keeping, flagging, removing, or shadow-blocking content based on predefined policy rules. Developers can configure moderation rules and enable specific harm detection engines like toxicity and platform circumvention prevention. Additionally, the API supports flagging content for further review, managing flagged content through a Query Review Queue, and performing actions such as deleting messages or banning users via a Submit Action endpoint. Webhooks allow for integration of custom logic for moderation events, facilitating real-time notifications and streamlined management of flagged content. By utilizing these functionalities, developers can tailor robust moderation systems to their specific needs, promoting a healthy in-app community.