Contents
We all know that each individual marketplace is unique and comes with its own set of requirements and challenges. However, from our 17 years of experience, weāve also found that some challenges are universal for most online marketplaces. The vast majority of marketplaces struggle with or wants to increase monetization, acquisition, conversion, and retention and often these challenges are closely tied to the user experience.
This means that if you are having issues in one of the areas mentioned UX is often a good place to start when you are looking for a culprit and a solution.
If you struggle with monetization, acquisition, conversion or retention it is highly likely that you are not meeting user expectations.
If you were, theyād be staying on your site and happy to pay for the service, right?
The reason you are not meeting their expectation could be due to several issues. Low-quality inventory, poor customer support, hosting an unsafe platform, for instance, are all very common issues that severely damage the user experience.
Analyzing and pinpointing where the issue lie is the first step, the next is finding a good solution to fix it.
How to turn around decreasing user experience
We get it, user experience is a broad area and improving it can be approached in many ways as such it can sometimes be hard to know where to even start. Seeing how others go about it can be inspiring and help you find the solution that fits your specific site.
Letās look at a real-life example of diminishing UX. Kaidee, Thailandās largest C2C marketplace, saw their UX drop significantly when not living up to their usersā expectations of short time-to-site. Their users turned to public forums, including Facebook and The AppStore, to actively complain about it. This was, obviously, not good for Kaidee as it hurt their retention and acquisition nor was it good for their users, who clearly was unhappy with the product at the time.
Kaidee had to act. They looked internally, at their own platform, to find ways to shorten the time-to-site for their users and improve their UX.
We invited the CEO of Kaidee, Tiwa York, for a webinar, where he openly shared how they managed to overcome the negative trend of diminishing UX, how they approached an aging core platform and how they managed to save 6 months of development time while achieving 85% automation of their total moderation processes.
Prefer reading?
Hereās the full transcript of our webinar āKaideeās journey to improved UX using automationā
Tiwa:
OK, first of all, I may apologize that there is a slight delay from my slides as they come through, so we may have to wait for the visuals to come up on your site.
It has to do with weāre operating out of Thailand. So quite a long way away from Sweden at the moment. So just a little bit about Thailand. We got a sixty-nine million person population, GDP per capita about $17.000, and Internet users are quite a healthy penetration, 57 million. Itās keen to note that the growth in internet users are all smartphone base.
So Thailandās a market that jumped from desktop straight into smartphones, and desktop is a minor part of the traffic today. Desktop represents about 20% of our traffic, mobile web is about 40%. And mobile apps are another 40%. So in terms of our social media landscape, Facebook users weāre ranked number eight globally in the number of Facebook users. I think still today Bangkok is the number one Facebook city in the world.
Weāre heavy users of Instagram. YouTube is a massive stats for us, 2.4 hours per day. In fact, weāre the largest in Asia in terms of consumption per capita of YouTube. The other keynote here is that weāre one of three countries in the world where the messenger app of choice is Line. So Line is dominant in Japan, Taiwan, and Thailand. In fact, Thailand is their number two market, both in terms of users at, 44 million, plus that we are number two in terms of revenue for them as well.
So thereās a little bit of background for the Internet landscape of Thailand and moving on for a time for Kaidee itself. As I mentioned we reached about 30 million Thais and that represents about 329 million visits. We do, roughly, about 27 million to 30 million visits per month. 7 million uniques and about 600 to 650.000 uniques per day, generating about 15 to 20 million page views. And we get about 30000 items listed per day.
Last year we had 8.7 million items listed for sale. And our top category is cars, itās RodKaidee. So we have a sub-brand, itās not a subsite just a sub-brand called RodKaidee, which means cars. And by the way, Kaidee translates into English as āsells wellā.
Number two is motorcycles, number three is mobile and tablet, and number four is property. So BaanKaidee, which means āhouse sells wellā, and number five is auto parts. Another key thing, in terms of our usage, how some people use Kaidee, is that weāve got a large portion of our traffic that searches for items on the platform, and we do about two to three million keyword searches per day on the platform.
The top five things searched for was PCX, Honda PCX, MSX is another Honda motorcycle, Yamaha R15, so you see motorcycles are a huge category for us. And then speakers, and finally refrigerator. So that gives you a good idea of the business itself. Now, if we take a look at the moderation landscape. We donāt have too much freedom of press in Thailand to put it straight forward.
There are several different laws that we have to abide by. So one of the most strict law is Lese Majeste laws, which means you canāt criticize or be critical of the royal family. So that means, one thing gets public on my site that goes against the royal family. Basically, Iām in trouble with the law and itās a very serious topic. In addition to that, thereās a lot of consumer protection board laws in Thailand that we have to abide by. In fact, the Consumer Protection Board hired a full-time person to just watch Kaidee.
Thatās it, thatās their job.
And then weāve got, for example, no selling cigarettes. E-cigarettes are illegal in Thailand. Alcohol, so you can sell a bottle, letās say a Johnnie Walker. As long as thereās no alcohol in the bottle. If thereās alcohol in the bottle, thatās illegal to be placed online and advertised. We also have FDA laws that are very strict. For example, in Thailand the best breast pumps, among the babies category. Breast pumps are considered a medical device and medical devices are not allowed to be advertised unless you have a distributor license for it. So technically by law, if itās a secondhand item I can trade it. Iām just not allowed to advertise it. Down to the fact, that itās illegal to print it out like A4 and stick it in front of the grocery store. Thatās illegal in Thailand for medical devices. So it kind of gives you an idea of the landscape that we deal with. We also abide by all World Wildlife Fund trading laws for pets.
So we try to make sure that illegally traded animals, ivory, things like that, are blocked off the site and we have people tried to sell elephants, monkeys, birds, that are illegally tried. Yes, they have tried and we have to block all that content. So, kind of gives you a landscape of why weāve been very serious about moderation, and the landscape that we deal with. And now for us to tell a little bit about our story and our journey with moderation.
When we launched the site we were 100% post moderated, so we would check on whatever got posted but let it go live first. But with the landscape that we have, we realized we need to be pre-moderated. And so we went to 100% pre-moderation. We had to build a tool of our own. We started building that tool in early 2012 and developed it over time and our ad moderators were human. So it was manual and they were moderating about 350 to 400 ads an hour, each.
That tool was developed in-house and built on our back end that we built from 2011. And we were quite serious, but it was also slow. We had always aspired to try to get to 95% of ads moderated within five minutes. We never, at the time with our manual moderation, were trying to block fraud and spam. We were doing about, less than 20% would go live in less than five minutes.
And people were complaining, they would complain on all the message boards, on Facebook, on the App Store and saying why does it take so long for my ad to get approved. They wanted instant gratification, so along this journey of moderation I guess is another thing that, for those of you who arenāt doing in moderation at the moment, itās also a key differentiator in our strategy. So we believe that moderation and our ad quality team is the heart of our business. And the reason theyāre important is because they keep the quality of my marketplace going.
And the idea is that if I donāt have a quality marketplace, nobody wants to walk around in my marketplace, nobody wants to visit me. So we try to keep high control over the quality of listings that go on the site. If you look at the site today, for those of you who are checking it out right, now youāre going to see that we still have struggles with this. In fact, with image quality and all the policies that we have in place, we still canāt capture everything. But we do our best to try to keep a quality marketplace. No spam, quality of images, quality of products, no fake goods, things like that. So it gives you an idea of where we started from.
Now the critical piece in the storyline happens at the end of 2016. I was sitting around having coffee with my CTO and weāre looking at our core platform that we had been built in 2011. And we realized we needed to update the core platform. In the core platform, we had updated everything else to be a services architecture.
We built everything we could in the services, but we had this monolithic core which was our ad posting and members system. We looked at it, and we said, look if weāre going to drive this business for the next 5 to 10 years, we need to fix this. Now, we decided to take the hard yards of fixing that. Part of that, to fix that, meant we would have to rebuild our moderation tool, and rebuilding that moderation tool was a massive undertaking. Because we looked at it saying OK we can rebuild our core system, and what we went to was a services architecture with a messaging platform behind Kafka. We brought in things like Cassandra for real-time tracking of analytics. We switched from a MySQL database to a ProQuest database and really tried to up our technology game. But that also meant I had to rebuild our tool and we looked at and we said, oh my gosh if we have to rebuild the tool, thatās going to be 6 months worth of development and itās going to take up, basically, my full team of developers.
So today we have a product and dev team with about 30 people. Weāre currently growing that. So if anybody listening, thatās interested in working in Thailand, let me know. But we said thatās going to take most of our team to rebuild. At the same time, Besedo came knocking on our door. So Besedo would come to talk to us about their solutions all the time. But for us, we were looking for just the moderation tool. And it happened to be at that point they had just purchased, or just joined forces with the AI company. Is that correct Emil?
Emil:
Yes, we acquired IoSquare back in 2016. Thatās correct. Yeah. And they had this new moderation tool that they were building with machine learning behind it.
Tiwa:
So when we talked to William at Besedo, we said, actually now is the right time and weāre keen on just your tool, Implio. Weāre not looking to outsource the moderation, because thatās very close to our heart. But could you build the tool that you have, can we integrate it and use that as our moderation tool?
So thatās kind of where we started and started the conversation. And if, correct me if Iām wrong, but I think we were the first integration that was purely a tech platform pure play for Besedo at that time. Is that correct?
Emil:
You were most likely, at least one of the first. Iām not entirely sure, that youāre the first, but definitely one of them for sure.
Tiwa:
Now with that, there were some challenges, and we faced some challenges. One of the challenges we faced was understanding the lifecycle of an ad and how passing that from our core system into Implio, and then receiving that back and how to manage that ad. So itās not like you just turn on Implio and youāre done. You actually have to think about the whole UX for your customer service team, your internal moderation team and how it passes between our core platform over into Implio.
The other challenges we had was, we had to feed them a lot of learning data. So we worked, I think a total of four months continuously, with Implioās data science team to try to increase the accuracy of the system.
We also discovered a lot of garbage in our own dataset, and we had to do a lot of data cleaning. We had to figure out how, you know, where is the garbage and how do we get that cleaned up so that weāre passing good quality data so that Implio can learn from our data and understand it in order to bring up the accuracy of the system. I think those are most of the challenges covered. What else do we have? There was another one.
Another challenge, in terms of implementation, was the policies that we have. In setting the policies within Implio to match our policies, that we have to abide by, or by the law. It took our team quite a bit of time to understand how it worked with Implio, and we had to spend time on that and take effort to understand how the policies affect your moderation rules, what gets rejected, what gets accepted, and what has to go to manual moderation.
Another challenge we had, was that the rejection cases (refusal reasons) that we had. We had a lot more rejection use cases than Implio did on their side. So we had to go figure out how we could map āthis ad is rejected because of X, Y and Zā, but that doesnāt reflect the status with Implio. So these are kind of the challenges that we had to overcome.
I think the total time, from the day that we decided to go forward with Implio to the day we launched, was right around 6 months and that was because we had to work on our side, on how to integrate Implio and also Implio doing all the data learning and data cleanup for us. Yeah. Emil, did I cover pretty much all the topics that we discussed? Iām not looking at my notes at the moment.
Emil:
Absolutely, and I mean a lot of the reasons why this was a time-consuming part as well, is because Implio was incredibly young at the time. And like you mentioned with the quality data. In order to build a quality AI model, that is able to catch a high number of bad content at high accuracy, you need to have quality data to train. So, if you train an AI model with poor data, thatās the result you will get as well.
Tiwa:
So the next slide is the results. How did this turn out for us? By leveraging this tool, today we have greater than 95% accuracy in moderation. We are now reaching upwards of 94% within five minutes from moderation to go live, and 85% of all ads are automatically, or auto-moderated, as we call it. Auto-moderated, which means itās all machine learning that does it for us today.
When we launched, we were at about 65% automation, and as we gained confidence and understood how to work with the policies and rules within Implio, we grew that to 70%. Then the Implio team themselves worked really closely with us to push that up into the 75, then 80 percentile and now 85% today. So that means about 15% of all our ads come back to the moderation team and we have to manually look through them. Trying to identify all the other rules, is it spam, is it fraud, is it real, is it fake? All the other things that Implio is not sure of when it sends it back to our team.
Yeah. So from our perspective with Implio as a partner, our team has said theyāve found it great as our partner. We work with a lot of different vendors and a lot of partners, Besedo has been really proactive and responsive to our team in how to make adjustments and improve.
Some of the other challenges. Hereās another key detail. Back when we launched with Implio, the UX needed a lot of improvement, in order to do the workflow so we could do it at speed. Implio worked really closely with us and understanding our teamās needs. We showed them our old tool and they really worked to improve that front-end experience and the UX experience for the moderators. In terms of choosing Implio, I honestly donāt know of other platforms that can answer our marketplace needs like they do, and weāre happy to have them as a partner.
I donāt mean that just as a sales gig, but I actually mean it, as itās been a key part and a key partnership for us in moving our business forward. The other result that we got from this, is it allows my tech team to not have to build this whole tool and actually maintain it. So we get a lot of cost savings in terms of our tech time because thatās offloaded to Implio. Now I donāt know how to measure that in terms of ROI on the budgeting costs, but I can tell you on the different side of what about our moderation team.
So pre Implio, we had 40 moderators working. Today weāre down to 18. If you look at the total cost, itās about break-even, maybe a little bit more expensive because of technology. But once you put in the cost savings of my team, of our dev time behind it, itās definitely much more efficient and effective for us. So that kind of brings me to the end of my story, or my journey as Kaidee.
Related articles
See allSee all articlesThis is Besedo
Global, full-service leader in content moderation
We provide automated and manual moderation for online marketplaces, online dating, sharing economy, gaming, communities and social media.