Abuse Mitigation

Tuesday, July 2, 2024
in Trust and Safety, Abuse Mitigation, Security, Platforms
5 min read

The Limitations of Watermarking: Why AI-Generated Image Detection is Essential

The World Economic Forum has ranked misinformation as the top global risk over the next two years, even above extreme weather events and war.

In the midst of this and other such concerns, watermarking has emerged as a popular technique to label and identify AI-generated content. Companies like Meta and OpenAI have adopted visible markers and invisible watermarks to indicate AI-generated images, audio, and video. While these efforts represent a step in the right direction, watermarking alone is insufficient. This blog post explores the limitations of watermarking and why robust AI-generated image detection technology remains essential.

Monday, November 27, 2023
in Trust and Safety, Abuse Mitigation, Security, Platforms
5 min read

Separating the real risks of AI from fear-mongering

The rise of generative AI has significantly influenced the conversation around online safety and integrity. Such discussions have evolved against the backdrop of heated global geopolitical events, which have amplified the dangers of misinformation, disinformation, hate speech, and targeted online attacks.

Friday, November 17, 2023
in Trust and Safety, Abuse Mitigation, Security, Platforms
5 min read

What does “Trust and Safety” Mean Anyway?

'Trust and Safety', 'Abuse Mitigation', and 'Content Moderation' are terms that are interchangeably used, frequently misunderstood, and often conflated. To successfully navigate the complexity and nuance of online safety, it is crucial to establish clear definitions of what these terms mean.

Sunday, November 5, 2023
in Trust and Safety, Abuse Mitigation, Security, Platforms
5 min read

How Generative AI has transformed the online spam and abuse landscape

The emergence of generative AI has given rise to an alarming increase in AI-generated spam and abuse.

Products like ChatGPT, DALL-E, and GitHub Copilot have showcased remarkable content creation capabilities. Models underlying such technologies mirror their training material to craft content ranging from text, images, music, and code, often producing outcomes that can enhance many aspects of our lives. However, this very capability also opens the door to misuse, particularly in the generation of spam and abusive material.

Tuesday, October 31, 2023
in Trust and Safety, Abuse Mitigation, Security, Platforms
5 min read

AI Governance Alone Won't Save Us

On October 30, 2023, the Biden Administration issued an executive order proposing safeguards to mitigate concerns around AI-generated content. One such protection proposed instituting watermarking and other such indicators to denote the authenticity of content, with the intent of preventing deception and fraud.

Wednesday, October 25, 2023
in Trust and Safety, Abuse Mitigation, Security, Platforms
5 min read

Should platforms be required to identify and flag AI-generated content?

One frequently debated question is whether platforms should be required to identify and flag generative AI content.

Like many such questions, the answer to this one depends entirely on context. Since the identification of generative AI content is only useful insofar as it mitigates harm, a more pertinent question to ask is: what new risks and potential for harm does generative AI content create? It is then worth asking: how can those risks be mitigated?

Tuesday, October 17, 2023
in AI, User-Generated Content, Authenticity, Integrity, Trust and Safety
5 min read

Introducing Nuanced: Detecting Authenticity in the Age of AI

With AI-generated content rising, it has become vital to distinguish human-authored content from AI-generated impersonations across several contexts.

This is why we built Nuanced, a service for detecting AI-generated images. We help companies like dating apps, ad platforms, news sites, and marketplaces distinguish human-authored materials from AI-generated content.