How Social Media and Search Engines Use Human Raters in Improving Online services?

o-BIG-DATA-facebookThere is a lot of information here about the different kinds of jobs that a rater does for companies such as Appen Global, Lionbridge, and Leapforce. And over the past year or so, there are a lot more jobs than just your average rater job. There are even more types of jobs now than before. Everything from recording your voice for voice recognition applications, to social media evaluation. What isn’t generally talked about it the process and what you are actually providing as a service.

What it mostly comes down to is data. In reality, most of these jobs are simply data collection. Facebook, Instagram, and Google all require some type of data collection in order to create programming for their algorithms. Most of you who work for these companies probably don’t realize what it is that you are providing. In fact, your job is a lot more important than you think.

Google was always at the forefront of providing the best user experience for its searchers or users. And many people think that it is just their algorithm that does all the work. But no one really knew until recently when the Google Guidelines were leaked online that humans actually had something to do with it directly. As a rater, you are not actually rating the website, or giving the website you are looking at, a grade. Instead, you are using the guidelines written by Google engineers, to give the algorithm its data.

The data that you return for doing rating is actually fed to the algorithm where it judges and grades websites based on the real world interactions through raters. It is often thought that the job you are doing is actually affecting those pages and ads that you see. In a way, you are affecting them, but not directly. It is only by the data you collect that will affect websites, ads, and services in the long run once the algorithms are programmed using your data.

The same can be said for Facebook and what some of the social media evaluation jobs do. For instance, the Falcon Video Recommendations program had guidelines that were written so that when raters were looking at videos, the algorithm would know what to do concerning video’s and the content of those videos, whether they were helpful, if they should be flagged, and why they didn’t meet any quality expectation. Facebook ads also have an algorithm which is programmed by the engineers from the resulting data collected from raters. Instagram is no different. This company needs real people to rate and check ads so that its algorithm can be programmed. The videos were judged on how relevant and interesting they were, and why the videos were interesting or not. It is the information that was given on what made a good video good, or a bad video bad that was the most important data needed.

This becomes valuable real world data in which future guidelines and algorithms can be programmed. But once again, when the guidelines will change, the data needed will also change.

This is the main reason why you see some projects come and go, and why some are continual projects. Once one project has enough data, the algorithm is programmed and data collection stops until more data is needed or they make some changes in any general guidelines. Anytime changes are made in guidelines, raters or data collectors are once again needed to evaluate the current content being put online by advertisers, website builders, or even people who run Facebook pages and ads.

Some other types of projects that include the collection of data are voice recognition applications where you get a project that asks you to record your voice saying certain commands. Once enough voice data is collected, the product is programmed and tested. Some of these projects can be very interesting and I’ve seen a lot of them being offered by Appen Global as part of the talent pool network.

All these companies have one thing in common. They seek to improve their user experience. They can only improve the experience by having real world testers or raters look at the actual content, and rate the content based on the carefully crafted guidelines. This data definitely improves services and ads for the best user experience possible. Google, Facebook, and Instagram know that it would be impossible to create this experience without its social media and website raters.

How does Google use human raters in web search?

Advertisements

Using Whatsapp for Instagram Rating (Truckee and FalconInstaAd projects)

Using Whatsapp for Instagram Rating

FalconInstaAd and Truckee projects which are offered by Appen and Leapforce involve rating Instagram media. The Instagram rating tool is only available only for the smartphone. Writing comments using this application can be inconvenient for a lot of reasons, small screen, small keyboard, and typing the comments can become a real chore.

However, I have found a way that uses Whatsapp Web Version that you can run on your PC. This allows you to use your PC Keyword so that it’s a lot easier to write comments. You can get the web version of Whatsapp by going to https://web.whatsapp.com

WhatsApp-Web-screenshot_thumb_20170526_160415

The process is simple. Once you have signed into the Whatsapp Web Version, you have to be able to send messages to yourself. The easiest way I have found to do this is as follows: (You can do these steps on the smartphone or the Whatsapp Web Version)

1. Make a group, call it “test”. Add any one contact to this group.

Whatsapp 2_20170526_160409

2. Once the group is created, remove this contact from group.

Whatsapp3_20170526_160412

3. Now only you remain in this group. Rename the group as “Instagram Notes”.

Now you are easily able to create comments from the pc in your group, copy those directly from Whatsapp from the group you created, and paste those comments into the Instagram Rating Tool.

I hope this helps anyone who wants an easier way to write their comments instead of having to use the tiny Instagram application. This is especially useful for anyone that has bad eyesight. Looking at your Android phone for hours on end can cause fatigue and poor eyesight by itself.

As always, if you have any questions, leave a comment below, or email me and I will get back to you as soon as possible.

Appen Connect Truckee Project

instagram-980What is Truckee project?

Instagram has grown to almost 500 million active users. And like other online platforms, Instagram also has ads. This is where the human element comes again into play. For this job it is important to understand which advertisements people want to see in their ads. So you would be looking at your OWN feed and deciding which ads are relevant to you and which ads are not. Some of the things you would gauge the ad on would be relevancy, how useful the ad is to you, if the ad is entertaining, if the ad is offensive or misleading, and how much you want to see the ad in your feed.

The Instagram ads assessor project has a short qualification exam that will ask you some questions based on ads you might see, and what your situation is, and ask you how relevant the ads are. This is the relevancy part of the exam. Once you are in the project you are allowed to work 1 hour per day.

When you do make decisions based on the ads that you are seeing in your feed, you will be given the chance to explain your decision using comments. Comments are an essential part of your task when assessing Instagram ads and are incredibly important. If comments are not meeting the client’s expectations, you could be removed from the project. It is very important to make good comments regarding the ads assessment.

If you are going to take the exam for this project, it is very important that you go over the 17 page rating guidelines very carefully to make sure that you are giving the ads the correct assessment.

Truckee project qualification

Falcon Insta Ads exam consists of two parts. In part one (reverse rating) you will be given 10 raters’ comments and you will select which rating you believe they assigned to the ad in terms of relevance, usefulness, etc. This part is easy and you should have no problem with it.

In part 2 you will be given 10 ads in which you will be asked to rate each ad and provide comments. All ads might be rated from either US location or in a local perspective. When doing part 2 the most important thing is that your overall rating should be in line with your comment.

Here are a few tips on how to write good comments:

  • When someone reads your comment, a reader should be able to understand what an ad is about without seeing the ad itself.
  • Your comment must include at least two rating aspects such as relevance/usefulness/entertainment/offensive/misleading/visually appealing.
  • Your comment must include words which indicate the level of each aspect (somewhat/vey/not at all).
  • Based on your comment a reader should be able to understand your overall rating.
Additionally, you may consider and explain in your comment:
 
  • Whether this is the first time you’ve seen this ad or whether it’s a repeat.
  • How you feel about the advertiser.
  • Did the likes and comments influence you?

Make sure you understand of the Overall rating of ‘Definitely don’t want to see’ in order to rate an Ad as a ‘Definitely don’t want to see’, the Ad would need to have a strong negative impact on you.

Keep in mind that only one attempt to take this exam is allowed. Within a few days after exam due date you will be notified about results. If the exam is passed, then you will receive instructions how to create an account with Appen Global and link to Payoneer. I suggest you using my link bellow to register with Payoneer so we both benefit 25$ once your Payoneer account is loaded with your first salary from Appen.

Payoneer As a Payment Method for Appen, Raterlabs, Lionbridge and Utest – How to Get Rewarded with 25$?

How to stay in Truckee project  for a long time?

The most common reasons for contract termination are low quality of service, productivity, or not meeting contract conditions regarding providing rating service at least 5 days per week. In order to stay on the project for an extended time, your quality feedback score should be not lower than 2.6 (you can see this score on your quality feedback which is sent by Appen on a regular basis). Also your productivity RPH should be not lower than 15 (the number of tasks/time invoiced). Ideally your quality score should be 3 and your RPH 20. Keeping good quality scores can guarantee your continued participation on the program.