When we think ‘content’ we think ‘words’ first of all, right? But, as the adage goes, a picture speaks a thousand words — which is particularly relevant where content moderation’s concerned.
Online marketplaces (like classifieds sites and dating sites) pretty much rely exclusively on user-generated content. Although moderating text using machine learning algorithms is pretty common these days, images — which present a composite mix of criteria — have been harder to vet using AI. Until now.
Computer vision – amongst other things used for image moderation — is starting to become powerful enough to change that. The ways it’s evolving across tech are numerous, but in terms of content moderation, it serves a very specific purpose: it can automatically review, approve, or reject digital images and video.
Algorithm-powered image moderation can distinguish between any number of image features — from obvious no-no’s like pornography, to more under-the-radar naughtiness like contact details embedded into a photo. And of course, it can weed out accidental flaws and faults like low quality images and duplicates.
Let’s take a closer look at what you can moderate with computer vision…
Recognizing Human Features
Not all online marketplaces want pictures of people on product images. They take away focus from the product and can lower the user experience. Computer vision can spot and, if necessary, remove pictures featuring people rather than goods.
However, on other online marketplaces, like dating portals, faces are pretty essential. It has to be the right faces though! For profile pictures you really only want the face of the account owner. Group photos will only cause confusion and that’s where AI image moderation comes in. Computer vision can reject pictures with multiple people in them, selecting only pictures that show the person looking for love. It can also screen for unsavory images or pictures where faces are obscured by objects, and determine things like gender, age, skin/hair color, which it can cross-reference with accompanying text. Bad news for those still posting their prom photo 20 years later. Time to update your photo so it matches your details…
This kinda goes without saying; but it’s good to know that the really bad stuff gets nixed straight off the bat. And we’re not just talking about sex or nudity: with the right data computer vision can be trained to screen for violent and shocking images too — as well as things like religious or political symbols, which can be used in negative contexts.
It can also tell the difference between something mildly suggestive in an image — like cleavage — from full frontal nudity. Ultimately, users will lose trust in a site if they encounter really nasty stuff, which is why image recognition is so important. It also helps curb user churn by vetting contributed content and ensuring it lives up to the quality and standards expected by the users.
Image Text and Watermarks
Some online marketplace sellers will try to circumvent platforms sales fees by posting their contact details in an image to encourage off-site transactions. Computer vision stops this practice before it gets started by locating both text and watermarks in images; preventing sellers from linking to their own (or competitor) sites and driving traffic away from your site.
On dating sites this technology can be applied to ensure that contact details are not shared outside the channels endorsed by the site owner to secure revenue and to keep users safe.
Learn how to moderate without censoring
Why moderating content without censoring users demands consistent, transparent policies.
All Aboard the Computer Vision Train
Creating and running a successful online marketplace comes with a lot of challenges. Your main focus needs to be on continuously expanding and improving your core product to stay competitive; meaning most companies don’t have the time or resources to manually moderate all content that’s submitted. Even if they did, with a 100% manual setup they’d struggle to meet user expectations; as content wouldn’t instantly go live. This is where automated moderation can make a big difference. It’s cost-effective and allows for quick content upload. Another benefit is that it enables data privacy in a way human moderation can’t, something that becomes ever more relevant in the digital world.
As you can see there are plenty of reasons to jump aboard the computer vision train, but it takes dedication to get AI-powered image moderation right: unless you have the right help.
Computer vision is a core component of Besedo’s service. If your site handles user-generated content and accompanying images, then take a closer look at how we can help.
The latest around content moderation, straight in your inbox
Subscribe to get our newsletter to stay updated.
How Bad UX Can Ruin Your Online Brand
With user-generated content platforms you’re essentially handing over a massive chunk of your user experience to your community.
The World’s Top Online Marketplaces 2022
Find out which online marketplaces are the biggest in various countries, categories, and more in our list of the biggest marketplaces online.
How can dating apps be flirty but not dirty?
Evolution of language, part three
Making sure dating apps are about ’amore’ not fraud
Evolution of language, part two
Evolution of language, part one
All change: a quick look at content moderation’s big trends
How to not be the brand that ruins Christmas
Can users be given creative freedom without exposing them to risk?
This is Besedo
Global, full-service leader in content moderation
We provide automated and manual moderation for online marketplaces, online dating, sharing economy, gaming, communities and social media.