I thoroughly enjoyed participating in last week's discussion hosted by Oversight Board: "An Oversight Body for AI: Lessons in Global Content Moderation." We explored what AI can learn from years of social media content moderation, how international human rights principles should be applied to these emerging technologies, and how AI can help identify when and where human moderation is most needed.
My thoughts from the discussion:
1. Human oversight remains essential. AI can improve efficiency, but it cannot replace human judgment in complex or high-impact decisions. Transparency builds trust, and meaningful appeals and accountability are critical. Bias must be continuously monitored, and a risk-based approach to moderation is key.
2. Key questions remain for AI-enabled content moderation. These include clearly defining appropriate use cases and purposes, distinguishing between moderation in public versus private channels, and determining how to address the propagation of strictly illegal content while respecting fundamental rights. As AI changes how, what, and the speed and scale at which content is produced, organizations need to also think beyond content moderation as a solution and examine more deeply the structure and design of systems and platforms.
3. AI does not shift accountability. Given the scope and scale that AI enables, for many organizations, the greater challenge may be the propagation—as opposed to the suppression—of harmful content, though both raise important questions about the impact on fundamental rights. As decisions become increasingly automated, or even partially automated, important questions arise: What level of internal risk assessment has been conducted? How are potential harms evaluated? And what costs and consequences are organizations prepared to accept?
The Meta Oversight Board continues to provide thoughtful, detailed, and case-specific guidance on some of the most challenging questions surrounding content moderation. I was grateful for the opportunity to contribute to the conversation and thank the Oversight Board for inviting me to join the panel.