-
Notifications
You must be signed in to change notification settings - Fork 5
Open
Description
Overview
Use AI moderation to ensure safety and positivity in discussions. This will help maintain a supportive environment within the app's community chats.
Todo
- Research available AI moderation tools compatible with Next.js (e.g., Google Cloud Natural Language).
- Integrate AI moderation into Firestore chatrooms by analyzing each message before it is written to Firestore:
chatrooms/ <roomId>/ messages/ <messageId>/ text: <string> (moderated before being stored) - Build a mechanism to flag or filter inappropriate content automatically before saving it in Firestore.
- Notify admins when flagged messages require manual review (e.g., store flagged messages in a separate subcollection).
- Remove mock flagged content from
adminsfile and integrate a read/write firestore system - Test moderation accuracy across different contexts.
Metadata
Metadata
Assignees
Labels
No labels