OpenAI releases CSAM detection classifier: can identify AI-generated content, provided free via API to vetted organizations
Strengthening the fight against online child sexual abuse with new tools and support
AI summary
OpenAI released an image classifier that can detect child sexual abuse material (CSAM), including AI-generated content, provided free via the OpenAI API to vetted organizations. Internal evaluations estimate it flags 48% fewer images than existing tools, while detecting roughly the same number of abuse images. In fal testing, 72% of high-confidence flags were confirmed as new CSAM; ChatGPT will issue a warning for related attempts, remove the conversation and suspend access for 24 hours.
Read original