Appen Arrow and Lionbridge Ads Rating (Ads Evaluator) Project Review

deep-links-within-mobile-app-engagement-search-ads
Appen Arrow and Lionbridge Ads rating projects overview
 

The Arrow Ads project and Lionbridge Ads rating are similar search engine evaluation project that is using the same Rater Hub platform that the other two large companies Appen and Lionbridge are using to rate search engine results depending on a query or intent of the user. Basically, you are doing the same thing as other search engine evaluators, but the difference is that you are judging the quality of ads and advertising-related data as they are calling it. Feedback that you provide is supposed to help the client monitor and improve their advertising as well as functionality.  

So what you are doing with this certain project is taking a look at different ads on web pages, and using the Rater Hub tool, you answer some questions on your findings. It sounds easy but answering these questions, and the answers that you provide are coming from guidelines that need to be closely followed. It’s not simply about providing your own feedback, but providing the feedback based on the guidelines themselves and specific metrics.  

Appen Arrow and Ads Evaluation program purpose 

As a human evaluator, you are not approving or disapproving the ads you evaluate, and you are not deciding directly which ads get shown or don’t get shown. In fact, even though you are providing scores and feedback about individual advertisements and advertisers, your evaluations don’t generally have any direct effect on those advertisements or advertisers. Sometimes the ads you rate are from a long time ago. Sometimes they are in a different form than they originally appeared. Sometimes they were never shown by Google at all, in any form. Basically what you are doing is collecting data to help train the algorithms that will eventually assess the ads being shown on their own. Without human interaction this would not be possible. So this job is very important to the engineers who are collecting the data from you.  

This is the main reason why it’s very difficult to pass the assessment part of this project. Your judgments are used to determine whether ads are getting better or worse over time, to see whether particular kinds of ads are working well or not, to see what kinds of ads cause problems, and to see what kind of impact a particular change to our systems will have. When Google engineers design new systems or propose changes to existing systems, the human evaluation data you provide is used to judge whether those proposals succeed or fail. This data is fed to computers that train the automatic algorithms.  

This is also a big reason that a lot of raters end up being terminated or losing their contracts. Accuracy and quality of your ratings are very important. You should always check the Ads Guidelines if you aren’t sure about something that you are looking at. Even some raters that have been doing this job for a while still refer to the guidelines.  

Appen Arrow and Lionbridge Ads rating program requirements 

Getting on this project can be difficult. There is a long assessment required. Its mentioned early on that you will perform all work and including the assessment tasks on a non-shared and non-public computer. That’s pretty straight forward. You’ve got to have your own computer with a high speed internet connection. And according to them you can’t take your laptop to the coffee shop and work from there. So it’s a very good possibility that your home IP address is recorded in the RaterHub, and you need to use this same connection to perform all work. Anything else is strictly prohibited. 

Another thing to mention is that you’re going to need to use either Firefox or Chrome web browser but that should hinder anyone since those seem to be the main web browsers being used by the masses. This is because the Rater Hub tool will not work on other browsers.  

If you do pass the assessment, then you may be offered a contract position. Usually the contract hours are part-time 20 hours a week, but Aztec states 19 hours, Monday through Sunday. Once you complete the assessment, the results are usually sent within 48 business hours after your deadline to complete the assessment has passed, not 48 hours after you submit the assessment.  

As with all projects we can’t stress enough the important of one thing. Thoroughly read the guide they send you and have it open and ready while you are taking the tests. Make sure the minute you get the link to review the guide, that going over it is the first thing you do. Give yourself enough time to digest everything in it at least 1-2 times before taking the tests. The guide itself has to be accessed directly through EWOQ which is part of the RaterHub portal. You’ve got to be logged in using the Gmail address you used when you signed up at Appen/Lionbridge. This Gmail account should be a dedicated email account.  

Since you are not able to download the guide, you should bookmark the page with the guidelines so that you can access it quickly and easily. We said that it cannot be mentioned enough and it’s very important that you read and understand the guidelines completely before starting or you will fail the test.  

Appen Arrow and Lionbridge Ads program payment rates 

Wages on each contractual hour depend on the country and can vary between $4 to $15 per hour. For more information on wages read here:

Agents will invoice vendors for rendered services once per calendar month. Fees to independent agents are paid (via direct deposit) within 30 days of receipt of a valid invoice. The payment is made on monthly basis via direct deposit into your bank account. Appen projects are paid now by Payoneer. If you do not have a Payoneer account yet you can get yours here: 

http://tracking.payoneer.com/SHRq

Note: By using this link for applying for a Payoneer account/card we will both benefit by earning 25$. 

Appen Arrow and Lionbridge Ads program exam

The first set of tasks are multiple choice questions (in total 45 questions) that come straight from the Search Ad instructions in the Ads Guide itself. After you have completed the comprehension questions, you will be shown a set of assessment tasks (in total 190 tasks of different types: search ads evaluation, user interest, key words, etc) that asks you to rate just the first section of a Search Ads task. Once this is done you’ll get a set that asks you to rate just the second section. Finally, you’ll get a set of complete Search Ads tasks, User to Keyword, Close Match Evaluation to rate.

The typical exam tasks is a query and an ad creative generated by a search engine in respect to the user query. You as a rater will need to apply rating rule to determine how much promising or unpromising is the ad in respect to user intent. Once you evaluate the ad then you will be asked to evaluate a landing page associated with the ad and to determine how satisfactory is the page and website content in terms of meeting the user intent needs.

Lionbridge Ads rating project/Appen Arrow Exam Tips

Additionally I would like to give general tips on how to proceed with Aztec/Ads Rating Project qualification:

As usual before proceeding with rating you need to make sure you clearly understand user intent. If not, use Google search to research the query and establish the dominant intent, and the secondary intent if one exists. Sometimes it’s hard to understand what the user intent is without doing the search yourself;

Search Ads Evaluation Tasks

Select appropriate query flag if required. For instance, if the query is in foreign language, or it is clearly a porn related query, make sure you select the appropriate flag. Remember that when you are doing ratings, the language should be in your contracted regional language. So if you are working in English, and you get a page in another language, then flag it appropriately.

Examine the ad creative and answer the question of how promising the ad is. You should refer to a specific section of instructions, and not evaluate the ad creative based on your own perception or personal likes or dislikes. Pay close attention to wording of the ad and the URL. In many cases, wording of the ad may indicate the ad deserves a porn flag, or has reference to another search engine.

Check the query and ad creative for the navigational flag. If the query is looking for a specific page or website and the ad suggests the website, then the ad and the query should be given a navigational flag.

There are a few scenarios in which you should pay special attention to. The first one is when the ad offers to repeat the search in another search engine. In this case, the appropriate rating for ads and LP (Landing Page) are somewhat unpromising, and don’t satisfy the query because the action won’t bring the user closer to his goal. Google wants to provide the user with the quickest possible and satisfying solution for the user intent and query. Sending a user to another search engine defeats that purpose entirely.

Select the ads creative rating, or how promising the ad is in relation to user intent. Once you’ve completed the first part of the task you will then be directed to the Landing Page section.

Visit the landing page and examine the page based on the guideline rules of how satisfactory the page is based on the query or intent. Once again, you should not use your own judgement but instead learn how to apply the guidelines rules. In many cases research on the website is required, for instance a quick product search will show you more information about the page, and help you understand if it meets user intent based on the query.

Make sure to pay special attention to the user location. If you see that the user is looking for something in a specific location, such as a restaurant in a specific location, and you get a restaurant in a completely different location, you should apply a negative rating. In this case it’s a good idea to refer to the guidelines and review typical user location scenarios.

User to Keywords/User Interest Tasks/Close Match Evaluation

Before proceeding to these types of tasks make sure you read and understand instructions, because the logic is different comparing to approach required for search ads evaluation tasks. You will be asked to rater how much is interesting for a user the suggested page/url based on examination of a user current web interest.

Once you have completed all assessment tasks, including the survey, you will temporarily run out of tasks. This is because your answers will be checked before you will be allowed to move forward. Either you will pass this part or not. You will not see the Acquire Tasks button at this time. Remember that you need to wait 48 hours after the assessment deadline and not 48 hours after you submit. The assessment will be complete after you submit all tasks available. 

WELCOME TO ADS EVALUATION EXAM SIMULATION TOOL (APPEN ARROW AND LIONBRIDGE ADS ASSESSOR PROJECTS)

Appen Arrow vs. Lionbridge Ads rating project  

Many people ask me which project is better and which one should I join. In my opinion I think that Lionbridge is definitely better in terms of offering a better payment rate compared to Appen. It’s also important to note that the exam qualification and training are paid by Lionbridge where at Appen it’s not. So take this into consideration when you apply for both of these companies. Three days of unpaid training is a lot for people to deal with and really when you think about it, no one wants to do an exam for three days, and then fail it having put all the time and effort into it to get a job.  

As always, if you have any questions or thoughts leave a comment or shoot me an email.  

Wishing you great success in your work at home career!

https://passleapforceexam.com/2017/10/15/common-issues-of-new-raters-aztecads-rating-project/

Advertisements

How to Pass Appen (Yukon) and Lionbridge (Internet Assessor & Internet Safety Evaluator) Exams?

How to pass Appen Yukon exam? How to pass Internet Assessor & Internet Safety Lionbridge exam? How to pass Yukon Raterlabs exam? Exam Guidelines 2019

Before you can start working on various tasks, you must pass the qualification exam. The qualification exam you will take covers two types of rating tasks which will make up 70% of all tasks in the project: Needs Met and Page Quality.

Once your candidature is approved for certification, you will get an exam email with detailed instructions. Within seven days you have to study 160 pages of the general guideline which consists of rating rules and concepts. The guide explains you how to do the rating of search results and assessment of quality of web pages. You should follow these rules and not use your personal judgment. What they want is for you to represent a typical user in your country. Before you proceed with the exam you need to study the guideline at least twice paying particular attention to practical task examples. Keep in mind that it’s 160 pages long. As I always advise, don’t wait till the last minute.

Note: At the stage of examination, Lionbridge provides candidates with very helpful exam preparation support. You will get access as an exam guest to the Lionbridge learning portal where you can listen to webinars and even try to do a few practical tasks before proceeding with actual exam.

Important update: Lionbridge is very selective in terms of recruiting new raters, up on revising exam results they will check  your activity on their exam preparation portal, with this in mind, I strongly recommend you go through all the webinars  on exam preparation portal before proceeding with the exam itself. 

There are three parts in the exam: you can proceed with the next part only if you pass the previous one. Once you complete any part of exam, within 3-10 minutes you will receive an email with information about results.

Google updates the way the exam is done from time to time. The main feature that has been changed is that you must rate pages from your smartphone (send to device tasks). If you do not have smartphone, they say you cannot apply for this job. This is due to the fact that the number of mobile users is constantly growing and the company wants to assess websites from the perspective of on-the-go mobile users.

Note: There is a recommended schedule that will give you plenty of time so that you’re not rushing to complete the exam at the last minute:

  • Day 1 – Study the Guidelines – Make sure to setup your smartphone so that you are ready to take the final portion of the exam.
  • Day 2 – Start the Theory part of the exam making sure you are taking time to CAREFULLY read each question. Some of them can be tricky and that’s meant to make sure you fully understand the concepts.
  • Day 3 – Go back and study the guidelines once again starting with the Page Quality section.
  • Day 3/4 You can start the second part of the exam which is the Page Quality section if you feel comfortable on day 3. You may want to study this entire day, and you’ve got plenty of time if you decide this to take the exam on day 4.
  • Day 5 – Read the Needs Met section of the guidelines again and make sure to take your time. You’ve still got two more days to finish. And as it has been mentioned before, have your guidelines open in case you need to refer back to them.
  • Days 5/6/7 – Get started on the last part of the exam ‘Needs Met Rating’
Internet Assessor and Yukon project exam part 1 (theory)

In this part of the exam you will be assessed on how well you understand the theoretical part of rating concepts, as well as on your ability to interpret questions and search for information in the general guidelines. It is an open book exam, so you can use the general guidelines to find answers to the test questions. This part has 32 question sections; each section has 4 parts, so in fact you have 132 true/false questions to answer. Read questions carefully, some of questions can be tricky in terms of their wording. You can consult with the guideline book while passing the exam and it’s strongly recommended to use this opportunity.

Note: Do not leave incomplete tasks more than for 1 hour, otherwise they will expire and you will fail the exam automatically. If you need to take a break, complete tasks and press “Submit and Stop rating”.

In most cases an hour would be enough to complete the theoretical part of the exam. The following message will be shown to you once you have submitted the last page of questions:

No tasks are currently available. Please try again later. 

Within a few minutes a result notification email will come to your gmail, and in the case you are successful with part 1, the next part will be available in a few minutes minutes.

Lionbridge Internet Assessor and Appen Yukon project exam part 2 (Page Quality)

In this part of the exam you will be asked to assess 7 web pages for their quality. My advice for this part is to check all quality aspects, and fill in the online form very carefully so you can give a correct overall quality score (from lowest to highest) to a page. You should expect 2-3 low quality web pages, 2 high quality web pages and 2-3 medium quality web pages. However this is not a rule, sometimes candidates get 4-5 pages of high or medium quality pages and only 1 or 2 of low quality pages to rate. Keep this in mind. In order to give correct ratings, examine web pages for ETA (Expertise, Authority and Trustworthiness) criteria very carefully.

Also, keep in mind that in this part of exam you need to give a PQ rating mainly to a web page and not to a website, although some quality aspects of a website have to be taken into consideration when assigning overall PQ rating, in particular in case of YMYL (Your Money Or Your Life) content which Google takes very serious.

Do not forget to write useful comments where required, otherwise the system may show an error.

You don’t need to finish this part at once. If you want, you can take a rest. The tasks are still available when you sign in. Again, if you pass this part, the company will send you an e-mail saying that you can proceed with part 3.

Note: The url/web page may not open on your smartphone, in this case do not mark these as “Did Not Load”. During the exam you should not expect to give a website this flag. If you do so, your answer will be incorrect. To solve this issue try to open link using incognito mode on your browser or/and give rating using other sources of information (website reputation, etc).

Снимок экрана 2016-01-10 в 17.25.24
Page Quality Task
Internet Assessor and Yukon project exam part 3 (needs met)

This is probably the most difficult part of the exam, and many candidates fail the exam at this stage. There are 7 tasks, and each task contains 8-12 result blocks. In each task you will be given a certain query, and a list of search results blocks with links where you have to give a usefulness rating to search results using a scale from “Fails to Met” to “Fully Met”.

Internet Assessor and Yukon project exam Passing score

In order to pass this part you have to get an overall score of at least 80%.

YUKON EXAM PART 3 (NEEDS MET) SEND TO DEVICE – OPENING LINKS ON MOBILE & MULTIPLE Accounts LOGIN ISSUE

Note: while doing Yukon (Appen) and Internet Assessor (Lionbridge) exam part 3, keep in mind that all links have to be opened on your phone because Google analyses web pages from the point of view of mobile users. If you do not have a smartphone, you may use any android emulator for this purpose, in some cases it is even more convenient than using a smartphone for opening links.In order to open the link on your mobile phone, click the  link on the result block on your desktop and then go to www.raterhub.com/url  on your mobile browser  (Google Chrome) to visit the link. You must be logged in your gmail account in order to have access to raterhub platform on your phone. The same rule works if you use android emulator.

Here is an official Leapforce (now Appen) video instruction on how to open links on mobile. Please note that this video was created by Leapforce and uploaded on Youtube by someone.

Note: Some candidates when accessing the link (www.raterhub.com/url ), got informed that Gmail account was unauthorized to visit the link. Most likely reason for this error is the fact of being logged on multiple Gmail accounts on a device. The solution for this problem is to go to android setting -> users & accounts -> add project associated Gmail account, then restart your device. This setting should fix the issue. 

Lionbridge Internet Assessor and Appen Yukon project exam part 3 (Needs Met) Expert Tips and recommendations 

Additionally I would like to give general tips on how to proceed with Yukon (Appen) and Internet Assessor (Lionbridge) exam part 3:

1. Make sure that you fully understand the query and user intent. If you do not fully understand user intent, make additional research on the Internet.

2. When you are evaluating landing pages in the exam, don’t place too much importance on the Page Quality slider. The focus needs to be on Needs Met Ratings. Do not worry about using flags in the exam such as the ‘Upsetting-Offensive Content’ flags.

3. One of the most important things is to absolutely know when to use Fully Meets. Fully Meets ratings are very rare compared to Highly Meets ratings. Avoid being too generous on landing pages. If you have any doubts at all, you should not be rating a page ‘Fully Meets’.

4. Determine what type of query (user intent) is:

o Single entity (business) query with local or non local or both intent/to visit in person/navigate to a website

o Business chain query or query which is looking for business within one category (e.g. car repair service near me)

o Simple know query (where the user requests a specific piece of information, do not assign the Fully Meets rating to any particular result, the correct answer must be present in an SCRB).Examples of simple know queries:paris weather, delta airlines customer service number, current time in Amsterdam)

o Information query seeking a long answer/piece of information (what cases stress)

Types of SCRBs (Special Content Result Blocks): ny weather (simple know query), how old is universe (simple know query), does god exist (long answer seeking), berlin airport (single entity), burger king amsterdam (chain), coffee shops amsterdam (categorical).

o URL/website query

5. Consider the following aspects while giving ratings to result blocks: user location, for local intent queries far away results are useless or slightly relevant. This aspect is very important for the following types of queries: tire shops near me, where to eat near me, Walmart near me, etc. When you get a task with this type of query do use in built map for researching user location/view port and results.

6. Make sure you give correct ratings to special content result blocks for single entity and business category queries. In case of business chain/category query, the result block with a list of businesses is always better than just result for a single business within one category.

7. Consider expertise and trustworthiness of search results for financial, legal, and health related queries; low expertise and trustworthiness automatically reduce needs met rating of the results.

6. Think of dominant, possible common, and minor interpretations for the query and take this aspect into account while giving ratings to a result block. Minor interpretation results should get a low usefulness (Needs Met) rating.

8. Take into account how well the web page/website is optimized for mobile users.

9. Once you have analyzed and considered all listed above aspects, you should give a rating to result blocks one by one.

Note: In some cases there might be some results (links) which are not accessible from outside U.S. (usually websites of well known retailers such as Target, Walmart, etc. They ban access from foreign IPs to prevent hacker attacks). Appen, Raterlabs or Lionbridge do not take into account this factor and therefore rating such results as fails to met may lead to overall fail.

To make sure you do not miss anything before proceeding with part 3, follow pre-exam instructions to pass this part. There will be a link to a video. Watch it and follow the instructions.

Снимок
Examination Needs Met Task

Note: In part 3 of the exam (Needs Met), most of results blocks have Needs Met and E-A-T (previously PQ) sliders. Main focus should be on providing correct Needs Met rating, which in some cases might be affected by E-T-A (PQ) rating when it comes to YMYL queries and results. Leapforce/Google re-named PQ to E-T-A in part 3 to make it clear that the most important aspects in PQ are expertise, trustworthiness and authority. In general it is similar to PQ concept. While giving E-T-A rating you should evaluate MC under these 3 criteria. In most cases you may do it fast at a first glance approach, but be sure to provide good evaluation for E-T-A when you have YMYL query.

Note: If the user location map does not show user location correctly, and you have a blank page, hit the black arrow button. The task will be closed, but you will see “Incomplete tasks” on the evaluation platform. Click continue and come back to your task with the updated user location field. Remember that it is very important to take into account the user location while giving ratings to block results. Also keep in mind that there is no need to finish the task in one sitting. You can take a break if you need to.

Once you complete 7 tasks you will get this message:

No tasks are currently available. Please try again later.

Yukon (Appen) exam results and Internet Assessor (Lionbridge) exam results

You will get overall exam results on the exam due date from Appen and exam due date plus one day  if your vendor is Lionbridge. Appen will ask you to sign a few electronic forms and in 2-4 days you will be given access to live tasks. At Lionbridge you will have to complete educational course with no pass/no fail quiz before you are granted full access to the tasks.

US YUKON Raterlabs and Lionbridge raters

Once you pass the exam you will then go through the employment process which might take up to 3 weeks. You will be asked to complete an online version of the IRS Form 8850 (Pre-Screening Notice and Certification Request for the Work Opportunity Credit), and a tax credit questionnaire from a vendor payroll provider. After you have completed these two forms, you will be presented with a formal employment offer letter. After acknowledging your offer, you will still need to complete the required activities in a timely manner. Try not to postpone the completion of these important steps: Providing bank details for ACH payments on Paycom website. Providing your I9 Employee Section 1 and I9 Employment Eligibility Documents (section 2) must be completed by specified deadline. It is very important that candidates complete all required steps as soon as possible to avoid termination of your employment.

 
NEW!!! Welcome to Search Engine Evaluation Exam (Yukon, Internet Assessor) Simulation Tool!
What is The Exam Simulation Tool? 

I have created a special tool that will help anyone who is getting ready or considering taking the exam. This tool was designed to assist candidates with exam preparation with the main focus on practical rating tasks that include Page Quality, and Search Results Satisfaction ratings. The tool has 5 Page Quality tasks, and 5 Search Results Satisfaction (Needs Met) tasks of all the major query types. (If you’re not sure what a query type is, that is the keyword that a user searches Google for). These include; simple-know, local search, information search, website/navigation, visit-in-person/business which cover basically all rating concepts/tasks types and skills which will be tested during a real exam.

How can this tool can help you pass the exam?

The way the tool is designed will show you exactly your problem area and what you need to focus on. It helps you identify your level of understanding of the rating concepts, and your ability to apply them by practicing first, and then identifying your weak points. You will receive your overall score (pass or fail), detailed feedback on your mistakes and know exactly what you need to go back and study in the guide. Of course we need to mention that there are no real actual exam tasks because that isn’t going to help you understand anyway. Each one of these is hand designed from the most typical exam tasks, and is also designed to be the best simulation possible. If you pass this, you will be ready to pass the actual exam. 

How do I get my hands on the exam simulation tool?

Exam Simulation Demo

If you’re still skeptical, we have a free demo version which you can try FREE right now! It contains a simplified Needs Met and one Page Quality task so you can see how it works. Once again, the demo is 100% free and remain completely anonymous.

Exam Simulation Pro

The tool has 5 Page Quality tasks, and 5 Search Results Satisfaction (Needs Met)  of all the major query types. These include; simple-know, local search, information search, website/navigation, visit-in-person/business which cover basically all rating concepts/tasks types and skills which will be tested during a real exam.

Explore the tool here: https://examsimulation.passleapforceexam.com/

Yukon and Internet Assessor Expert Support

If you are not confident about going through the Appen Raterlabs or Lionbridge qualification exam, you may always get my expert support and advice. For detailed information contact me here.

Payoneer Payment method for Appen 

Leapforce/Appen/Raterlabs candidate? If you get a job at one of these places, you’re going to need Payoneer account because that is the only payment option available for these companies. Simply sign up for Payoneer under my referral link and you’ll get the simulation tool subscription fee back as Payoneer subscription 25$ bonus once your account is loaded with 1000$! Normally it takes 1-2 months to make 1000$ for EU/USA/Canada raters and 2-4 months for raters from another countries.

The following posts are recommended for reading:

Common Issues of New Raters: Appen Yukon and Lionbridge (Internet Safety Evaluator) Google Rating Projects

Payoneer As a Payment Method for Appen, Raterlabs, Lionbridge and Utest

You Failed Appen Yukon project Lionbridge Internet Assessor Exam – Now What?

What Should You Do If You Fail Appen Yukon or Lionbridge Internet Assessor Exam Twice and How to Re-Apply?

 

Exam Preparation Tool To Help Candidates To Crack Appen (Yukon) and Lionbridge (Internet Assessor & Internet Safety Evaluator) Exams

What is The Exam Simulation Tool? 

I have created a special tool that will help anyone who is getting ready or considering taking the exam. This tool was designed to assist candidates with exam preparation with the main focus on practical rating tasks that include Page Quality, and Search Results Satisfaction ratings. The tool has 5 Page Quality tasks, and 5 Search Results Satisfaction (Needs Met) tasks of all the major query types. (If you’re not sure what a query type is, that is the keyword that a user searches Google for). These include; simple-know, local search, information search, website/navigation, visit-in-person/business which cover basically all rating concepts/tasks types and skills which will be tested during a real exam.

How can this tool can help you pass the exam?

The way the tool is designed will show you exactly your problem area and what you need to focus on. It helps you identify your level of understanding of the rating concepts, and your ability to apply them by practicing first, and then identifying your weak points. You will receive your overall score (pass or fail), detailed feedback on your mistakes and know exactly what you need to go back and study in the guide. Of course we need to mention that there are no real actual exam tasks because that isn’t going to help you understand anyway. Each one of these is hand designed from the most typical exam tasks, and is also designed to be the best simulation possible. If you pass this, you will be ready to pass the actual exam. 

How do I get my hands on the exam simulation tool?

Exam Simulation Demo

If you’re still skeptical, we have a free demo version which you can try FREE right now! It contains a simplified Needs Met and one Page Quality task so you can see how it works. Once again, the demo is 100% free and remain completely anonymous.

Exam Simulation Pro

The tool has 5 Page Quality tasks, and 5 Search Results Satisfaction (Needs Met)  of all the major query types. These include; simple-know, local search, information search, website/navigation, visit-in-person/business which cover basically all rating concepts/tasks types and skills which will be tested during a real exam.

Explore the tool here: https://examsimulation.passleapforceexam.com/

How to Pass Appen (Yukon) and Lionbridge (Internet Assessor & Internet Safety Evaluator) Exams?

How To Apply for Search Engine Rater and Social Media Evaluation Jobs at Appen and Lionbridge

Seacrh Engine evaluation jobs Application process – Where to start?

Sometimes finding these types of jobs online takes a bit of research. Most of the big companies that offer these types of jobs don’t usually advertise in common places or online job boards. You usually have to go directly to the company and apply on their website. I have seen that Appen Global advertises their jobs on Flexjobs.com, but that website charges a monthly fee. I never quite understood how a company can charge you to find a job, but they are the exception.

Finding these jobs and applying for them are different for each company. Going to each individual website is the best way, as long as you know where to go, and how to apply. With that being said, this article, and the videos we have provided, will show you how to find the work from home jobs.

One of the other important things to consider when looking for these types of jobs is your location. Some of the contracts that are offered through companies like Appen and Lionbridge require you to live in the demographic area that the project requires itself. The reason for this is because the data from different regions will be different depending on location and the language.

Before you begin to apply for these jobs, or really any job for that matter, it’s probably a good idea to go over your resume and make sure it’s up to date, and that it includes only the important information that is necessary. It might also be to your benefit to have your resume checked by a professional. The resume experts at Resumewriters.com is an awesome service that I have used in the past, and having your resume edited or corrected by a professional is a sure fire way to get noticed and get you the job you want. Many of our readers have had very good results with them.

To visit their website Click Here: Resumewriters.com

Another important note is that if you have worked previously on other social media projects with different companies, don’t mention this on your CV/resume. The two most important factors about this are that you do not need previous experience for these jobs. And second, if you have worked on these types of projects before you will most certainly be looked over and turned down for similar projects. The reason for this is uncertain, but we have seen other people turned down because of this.

You can work on two different projects for more than one company. However, you need to use a different IP address for one or the other. So if you work for Appen and want to work on another project with Lionbridge, you will likely need a different IP address. Appen seems to be the only company that records an IP address and this is shown in the backend or the portal of the work dashboard. This is why it’s a good idea to use a separate IP address for another project. It might also be a good idea to use a different email between companies when applying for and working on these jobs.

Projects and Vendors Compatibility: How to Work on Several Projects and Do Not Violate Vendors Conditions? How Much Can You Earn With Lionbridge and Appen When Combining Several Projects?

Some advice when working on different projects so that you don’t overwhelm yourself is to get some experience working on one project with a company before trying to get another contract with a separate company. Most of these contracts are part time. So its beneficial to have more than one project at a time if you can handle it.

A really important thing to note here is that you can only have one contract per IP address when it comes to these companies. So if more than one person is working for any of these companies, it is important to have a separate IP address. You can usually order another IP address from your internet service provider for about $4-5 per month extra. Check with your ISP to find out if you require more than 1 IP address per household. You can read more about this in FAQ

Application process at Lionbridge – Ads Assessor, Internet Safety Evaluator, Ads Assessor 

Lionbridge search rater project is called the Google rating project (ads assessor, internet safety evaluator, ads assessor) which is the same as Yukon at Appen (Raterlabs). They also have the positions of Personalized Social Media Assessor, Personalized Internet Assessor, and Personalized Web Assessor.

Application process at Appen – Search Engine Evalutor, Rater, Internet Analyst 

At Appen/Raterlabs you would apply for search engine evaluator position first, and then based on project availability, you would get invites for Yukon, Nile, (Facebook social media evaluator) Truckee or Shasta projects. You can work on more than one project at a time.

Appen Global

Many of my readers will be interested in how to get invited to other projects at Appen Global. Appen Global offers a lot of different types of projects that you are able to work on. Unfortunately, is not likely that you would be contracted to start on projects such as the Thunderbird music project from the beginning. You would be more likely to start on a larger project first such FalconInstaAds or the Arrow project. Once you have started working at Appen, and you are on a Falcon project, like any of the social media projects that they offer, you will likely get an invitation to start on other projects as well. The more you work, and the better your performance is, the more offers you will get from Appen.

Those projects include:

Arrow (ads assessor);

Yukon (search engine evaluator);

Nile/Truckee Facebook/Instagram ads assessor projects (social media evaluator).

application process video instructions -Lionbridge, Appen, Appen Global

We thought it would be a good idea to create some quick walk-through videos to show you how to apply for these jobs and the different companies. Some of these:

Lionbridge, go to http://www.thesmartcrowd.com/workers/job-opportunities/country/russia/#jobs-list

Appen, go  to https://connect.appen.com/qrp/public/jobs/list

Appen Global go here: https://talent-appen.icims.com/jobs/intro

How long does take to hear back from Lionbridge and Appen?

It depends on many factors, sometimes immediately, and sometimes it can take 3-4 months.

It might be that at the moment of your application submission, quota of raters for your country was reached and therefore Appen or Lionbridge does not hire new rater at the moment. As soon as they fire unsuccessful raters, they continue hiring new people to maintain the required number of raters in your country.

Lionbridge Ads Rating Project Massive Timesheet Disapproval: on Purpose or Unprofessional Approach? 

Ads Rating Project massive timesheet disapproval: on purpose or unprofessional approach? 

It appears that lately there are a lot of problems with the Lionbridge payment systems and it’s not actually a new thing. According to comments of my readers and discussions on https://www.reddit.com/r/WorkOnline/comments/9b0n2n/lionbridge_scammers/  (2018), https://www.reddit.com/r/WorkOnline/comments/cvol9y/lionbridge_scammers_2/ (2019, August). The problem started to happen in May-June 2018. It just seems that now it’s becoming worse and there are more and more raters complaining that the time sheets that are being submitted are being returned. Lionbridge is asking people to carve a lot of hours from their time sheets and it’s obvious that there is a big problem somewhere, but the company isn’t acknowledging that there is an issue, or perhaps they are just doing this to save themselves a lot of money and get away with it. And the raters who are affected by this Lionbridge payment problem aren’t being asked to take an hour or two off, in fact, in some cases, people have been asked to cut 30-40 hours from their time sheets, some of them are asked to remove all hours from July timesheet. This is huge and it’s a lot of money for someone. In fact, it appears that it’s happening to a lot of people as one rater who has been working for the company says that he has 6 friends who all got the same notifications. In one case, one of our readers PrestigiousExplorer says that after working one year for Lionbridge the same thing has now happened to him and the company wants him to deduct 68 hours!  

The problem on their ends appears to be that the hours that are being submitted don’t match their data. What it means is that the amount of tasks completed isn’t matching up with what your submitted amount is. But here’s the thing; if suddenly the Lionbridge payment department starts seeing a lot of discrepancies in time sheets and the data that they have, shouldn’t they realize that there is a problem somewhere? Now suddenly here you have a bunch of people being asked to shave a lot of hours off their time sheets, and even people who have been working for the company for a long time and then suddenly are having issues. It seems that Lionbridge doesn’t care about any of this and are sticking to their guns and won’t budge on time sheets.  

The big question is does no one at Lionbridge see this as a problem? Or is there something else going on?  

As you may know raterhub automatically records the time and the number of tasks completed by each rater on the platform. It is very unlikely that the problem takes place there, however many long-term raters remember that raterhub used to have built-in task counter which was very helpful in terms of recording completed tasks, but for some reason this useful tool was removed from the raterhub functionality.

It looks like the Lionbridge system is just an Excel spreadsheet which corresponds timesheet data with data from raterhub (time recorded/the number of tasks completed) and the problem is there. Many raters worked lots of hours in July and got an email with 0 hours/0 tasks recorded by the system. Lionbridge seems to be very unprofessional in the handling of this problem. It undermines the project and the company’s reputation.  

But the fact that no one has caught the problem or made any statement about it since it started happening in July leads one to believe in some kind of conspiracy here. Some people are calling Lionbridge scammers because of what is going on. If you’re suddenly asking a lot of raters to cut hours off their paychecks, there’s an obvious problem somewhere.

It does appear the company had the same kind of problem in May in which they sent out incorrect data. It’s quite possible that this is the same issue, but instead of trying to figure out what is going on, it looks like the raters are getting the short end of the deal.

A company can’t just suddenly take away your pay when you put in the hours and did the required tasks to the best of your ability and as per your contract. There are some laws that protect freelancers and independent contractors, and if you are doing the work, then you should be paid. But for freelancers and independent contractors, your options are limited depending on what country you live in.  

Real timesheet correction required due to low productivity vs. Lionbridge error 

In some case raters might be asked to correct heir timesheet due to low productivity and it is OK, keep in mind that your average productivity rate  should be 1,5 – 2 minutes/per task.  

In this project, most of the tasks do not have any recommended time limits. Raters have to manage their own productivity and their own time. The customer does not indicate average estimated time because the priority is quality in rating the tasks rather than productivity, or how many tasks you rate. Raters have to keep in mind that the productivity and time invoiced should be within reasonable metrics. It is OK to spend more time in the beginning and increase your productivity when becoming a more experienced rater. 

Appen and Lionbridge have productivity metrics called RPH. It is assumed these metrics are based on the average raters’ performance in the project which is calculated as the ratio between the number of tasks and the time spent within an invoice period completed by all raters. In my view this metric is not useful, because in many cases raters get different types of tasks which require a different amount of time to complete, therefore the RPH metric is not accurate at all. This can lead to a situation where if your productivity doesn’t fall within their RGP metrics, your invoice will be returned for correction and they will ask you to align your RHP to average even though you spent a reasonable amount of time for completing more time-consuming tasks. The customer understands this issue. That is why they do not indicate the average estimated time. But it would seem that Appen and Lionbridge have again invented their own metrics to pay less to its raters. 

What raters can do in this situation?  
  1. To calculate the number of tasks completed weekly and entered into time sheet vs. Lionbridge records, if you have a huge discrepancy (like most of raters have) this is a clear indication of wrong data sent by Lionbridge. 
  2. Send an email to Lionbridge explaining the discrepancies.  
  3. If necessary as a proof of working hours/number of tasks a browsing history can be sent, it can be found, filtered by dates and website here: https://myactivity.google.com/myactivity
  4. Additionally I recommend sending an email directly to the Ads rating project admin (Google Ads Eval: ads_eval@google.com) to make them aware that this is some kind of issue that really needs to be resolved. 
  5. Do not correct time if you clearly identified discrepancies until Lionbridge responds to your email and provides you with correct data 

Perhaps if the right people receive a large response on the issue, someone will take a look and fix the problem. But as of right now things aren’t looking too good. For those of you who have lost wages, hang in there and hopefully, someone will get this straightened out.  

If you have questions or comments then leave them below.  

Appen Connect Ipsoot Project Review

Ipsoot project 

There is a new project that we’re going to go over today called Ipsoot (also known as Pearl and Falcon PT) where you are shown a random post on Facebook, and then you have to decide what topic that post fits under. It is basically a categorizing system job which aims to put the posts that are made into the correct categories of broad topics. 

Ipsoot project qualification 

The qualification process for this project is straight-forward and not difficult provided candidates study and understand project guidelines. The qualification consists of 22 questions, candidates will be asked to apply categorization and assign relevant topic to randomly selected images. 

Ipsoot project Rating process

The posts you receive are random and in no order and appear on the left, including the ad and page information under it such as the page name, who the author is, etc. You will also notice on the top left a Post ID and a Job ID number. 

экрана 2019-08-05 в 20.44.33

The objective is to look at the post and spend 30-60 seconds making sure that you understand it. Of course, it is important to consider the text in the ad along with the media. Basically, you want to think about how a photo might be understood or interpreted in combination with the text in the ad. 

It’s important to pay special attention to everything that is in the ad, including the photo and any text that may be overlaid on the photo as well as any text appearing above the photo. 

If the ad is text-only it’s important to understand that text and including any emojis that might be used in the post to understand what the ad is trying to accomplish and how it should be grouped. 

Sometimes you will see a link in the ad, and at this point, you should click on the link and quickly scan the content of the page it takes you to and consider if the ad itself or the text relates to that landing page. 

Sometimes an ad will contain a video, and you should watch that video for up to 60 seconds. However, if the video is too long then watch the first 10 to 15 seconds, and then click through five spots and watch another 5 to 10 seconds. You should also consider any accompanying text that is inside of the video. 

On the right-hand of the ad, you will see a box that says ‘To which topic(s) is this post related. Select all that apply.’ You should select every topic to which the post is related on the other hand if the post isn’t related to any of the topics then select the no topic checkbox underneath the box of topics.  

Underneath of this, you will see a panel that says ‘Additional Attributes’ and you should select every attribute which applies to the ad. Of course, if there aren’t any attributes that apply to the ad then you should select the no attribute checkbox. And finally, the last thing to do is to click submit which will serve you up another random ad to check. 

Next, to the submit button, you’ll see some skip buttons. You will use these if you encounter any error that prevents you from evaluating the post and they are as follows:

Skip: Tool Error – You should use this if for some reason the tool doesn’t load. This can mean that the ad area will appear blank, or you may not see all the buttons or functions. 

Skip Other Language – the majority of the time you’ll receive ads in the language which you are assigned to so if you work in the United States your ADS will be either English or Spanish depending on what type of position that you apply for and if your multilingual. However, if you do not understand the language in the ad then you should do nothing else but click on Skip: Other Language button.

That’s pretty much it for the tool and it’s quite straight forward. 

The biggest challenge to this type of job is trying to understand Topic Relevance. To give an example, if it would make sense to see the post in an Instagram feed about a certain topic, then the post is probably related to the topic itself. 

However, it is not sufficient for a post to merely mention the topic. While it’s true that some posts explicitly mention the topic, some do not address the topic as it would show up in a search result. 

A good example of this would be an ad about a school competition winner who is pictured with his parents, his sister, and a dog. Simply looking at the ad isn’t going to help you unless you take a look at the text. So you wouldn’t tag this as “animals and pets” simply because there is a picture of a boy and his dog in the photo. However, if that same photo mentioned something about ‘man’s best friend’ you could tag it as animals and pets.

One of the questions that you may have is ‘What if the post is about more than 1 topic?’ Well, you should pay particular attention to a post that can be related to multiple topics because many posts can be coded with more than one category. 

We’ll give you some examples. 

For instance, let’s say that you have a post about a new economic policy. In this case, you would tag ‘politics’ + ‘business finance and economics’.

If a post was about someone using a new fitness routine to improve their health, then you would tag ‘health and medical’ + ‘fitness and workouts’.

A post about a politicians stance and welfare programs you would select ‘politics + social issues’ 

If the post is about the best restaurant three friends found while traveling through Italy then you would tag it ‘food and drink + travel and leisure + relationships friends and family’ 

As you can see, it’s quite possible many posts can have more than 1 topic. 

There are a few other rules when it comes to tagging topics about a post when it comes to regard for quality, professionalism, or the size of the audience for the post. 

We’ll show you some examples of how a topic doesn’t change regardless of these attributes. 

If the post is a professional video of a Justin Timberlake concert then you would tag this under ‘music and audio’.

But let’s say that the post is of a band performing in a bar. You would still tag it ‘music and audio’. Even though that band may not be as popular as Justin Timberlake.

Even if it is a post of a cell phone video of a 3-year old singing in a car, you would still tag this is as ‘music and audio’.

However, it is important to pay special attention to whether the post is related to any entity such as unique people, places or things. For example

The post is about President Trump – You would tag ‘politics’

If the post was about a McDonald’s restaurant, then you would tag ‘Food and drink’

And if the post was about The Beatles, then you would tag ‘Music and audio’

However, you should be careful to not assume that every post that mentions an entity is it about that entity itself. For instance, a video about the Olympics might show a logo of its sponsor, McDonald’s, but that is not enough to consider the post to be related to McDonald’s itself and you wouldn’t tag the post ‘food and drink’. 

When the author of the post is a well-known individual like Barack Obama, and he’s posted something saying that the Chicago Bulls are the best team ever, you would tag this as politics because it’s just a personal opinion by an individual strongly associated with politics. 

If you use Facebook, you probably understand that memes are something that you see quite often and its important to understand how to tag a meme. Memes often used content from one topic to make a statement about another topic. In the case of memes, you would actually tag both topics. For example, if you see a meme of a TV character looking sad with the caption ‘how I feel when my pet walks away from me’ you would tag this TV & Movies + Animals and Pets.

There’s going to be a lot of times when you’re going to have to do research because you’ll find names or phrases in a post that you do not understand. You should always do a search to find out if you’re not sure when referencing a topic. 

It’s also a good idea to identify some of the definitions in the guidelines. 

Topics describe the subject of the content. It is important to determine if the content in a Facebook feed is relevant to the topic. This means that it’s not sufficient to call something ‘related’ to a piece of content that merely mentions the topic. There are some examples of topics and how they should be grouped. And although the guidelines go over each one and give inclusions and exclusions, it is not an exhaustive list but merely examples.

Lionbridge & Appen Connect Platform – List of Projects and Code Names

Exam Preparation Tool To Help Candidates To Crack Appen Arrow and Lionbridge (Ads Assessor) Exams

WHY CANDIDATES FAIL ARROW/ADS ASSESSOR EXAM?

When you apply for ads evaluation jobs, you have to pass qualification exam that is quite difficult. Each company has a name for their ads assessor project. Appen Ads Assessor project is called Arrow if you work for Lionbridge you work on the Ads Assessor project.

Despite all the fancy names, the exam and rating process are the same for these companies because the customer is one, only vendors are different. The biggest problem with this exam is that it is difficult to pass this qualification with only one attempt. In fact, even Appen and Lionbridge explain in a welcome mail that there is high chance of failing it. With that said, you’re going to need all the help you can get.

Keep in mind that unlike Yukon project/Personalized Assessor and Maps Analyst (Shasta) projects’ qualification, the Ads Assessor/Arrow project qualification allows only one attempt to pass the exam.

STUDYING THE GUIDELINES AND DOING THE EXAM SIMULATION PRACTICE ARE ESSENTIAL IN SUCCESS IN PASSING THE ACTUAL EXAM

If you think this is an exaggeration, then just search for comments on passing the exam and see what you will find. You’ll find in a lot of cases people who claim that they studied for several days before the exam began. With that said, it’s just not possible to demonstrate the knowledge of these guidelines without investing a significant amount of effort in the one-week time frame they give you to study the guide. The guide itself is designed in a way that assesses your ability to understand and apply rating concepts and the rules based on instructions. There is a lot of material to go over, and it can be a bit confusing. But once again, you’re not going to get anywhere near passing if you don’t start going through the guide.

WHAT IS ADS EVALUATION EXAM SIMULATION TOOL?

The tool will help anyone who is getting ready or considering taking the exam. This tool was designed to assist candidates with exam preparation with the main focus on practical rating tasks that include: Search Ads Evaluation, User to Keywords, User Interests and Close Match Evaluation tasks. The tool has 10 Search Ads Evaluation tasks, 7 User to Keywords tasks, 5 User Interests Evaluation tasks and and 5 Close Match Evaluation tasks, these tasks are the main exam tasks types which cover basically all rating concepts, which will help you to develop rating skills which will be tested during a real exam.

HOW USING THIS TOOL CAN HELP YOU PASS THE EXAM?

You might be wondering how using this tool can help you pass the exam. The way that it is designed will show you exactly your problem area that you need to focus on. It helps you identify your level of understanding of the rating concepts, and your ability to apply them by practicing first, and then identifying your weak points. You will receive your overall score (pass or fail), detailed feedback on your mistakes and know exactly what you need to go back and study in the guide. Of course we need to disclaim that there are no real actual exam tasks because that isn’t going to help you understand anyway. Each one of these is hand designed from most typical exam tasks, and is designed to be the best simulation possible. If you pass this, you will be ready to pass the actual exam.

HOW TO PROCEED WITH EXAM SIMULATION TOOL?

Exam Simulation Demo

If you’re still skeptical, we have a free demo version which you can try FREE right now! It contains 1 Search Ads Evaluation task, 1 User to Keywords task, 1 User Interests Evaluation task, and 1 Close Match Evaluation tasks so you can see how it works. Once again, the demo is 100% free and you’re completely anonymous.

Exam Simulation Full Version

The tool has 10 Search Ads Evaluation tasks, 7 User to Keywords tasks, 5 User Interests Evaluation tasks and and 5 Close Match Evaluation tasks, these tasks are the main exam tasks types which cover basically all rating concepts, will allow to develop rating skills which will be tested during a real exam.

EXPLORE ADS ASSESSOR/ARROW EXAM SIMULATION TOOL HERE:

https://adsevaluatorexamsimulation.passleapforceexam.com/

iSoftStone Ad Copy/Bing Ad Evaluation Project

Bing Ad Evaluator Project Purpose

The Ad Copy project is Microsoft Bing analogue of Google ads rating project for Appen called the Arrow project (Ads Assessor at Lionbridge). An evaluator gets queries and your job is to evaluate how satisfied users would be with the ads proposed by Bing search engine. The purpose of the project is to help Bing to decide which ads are the most helpful and the most relevant to a
searcher. This, of course, improves the overall quality of ads that Bing presents
to their users. It sounds like a daunting task, and it can be confusing at first.

iSoftstone is another vendor and is regarded as the main vendor for Microsoft Bing. They also have the 3 test qualification and that test seems to be the same no matter who you apply for. The first test goes over the guidelines, the second test is an English Grammar test, and the third exam tests your computer and internet skills. All work is done in the HRS platform and you have to complete a qualification for each task. 

Rating Logic

There are however basically only five steps when it comes to determining if the ad
is going to make the user happy by satisfying their needs.

  1. Consider what the user had in their mind when making the query, or their
    intent when they typed the query. You need to take into consideration that
    people also sometimes misspell something when searching and in most cases you
    will understand what they meant.
  2. Do some quick research to understand the meaning of the query unless you
    understand it immediately.
  3. When presented with the ads, determine whether the Ad covers any of the
    user intent and how well it satisfies them
  4. The ad is then given a rating based on a seven-point scale to indicate how
    useful the ad would be to users who type in the query.
  5. Sometimes you need to explain additional information on a rating and explain
    it.

If all that still sounds tough, there are some tips that can help as you perform the
rating job:

 When considering the ad, make sure you are reviewing the content that is
displayed. No, you don’t have time to read over the content of an entire
website, but a quick glance at the top-fold of any website will tell you right
away if the ad is relevant or not.

 Often you will need to research possible intents with a query but you
should never base your rating on how the ad is treated in the search
engines.

 The rating you provide is based on the query which is the keyword or string
of keywords that a user types into the search engine. You should consider if
it’s a perfect match or not. Ask if the query is broader than the ad or if the
query is narrower than the ad.

 Don’t base your rating on a particular item like the title, description, or the
display URL in the ad.

 Examples are in the guidelines and the guidelines should always be handy
in case you get stuck on something and aren’t sure what to do. Of course
the queries in the guidelines aren’t exhaustive but they do give you a basic
idea on many types of ads that you will run into.

Bing Ad Evaluation project Qualification process

The qualification process for getting into the Ad Copy project for online ad
evaluator are just like most other applications for search engine rating projects.
When you apply at isoftstone for the ad copy project and are selected to go
through the training process, you are sent an email telling you that you’ve been
added to the training group on the system with a login.
It is important to understand what you need to do in order to pass training:

  1. The most important thing that cannot be stressed enough is to read
    through the guidelines as many times as you need to fully understand
    them.
  2. Once you feel confident enough to try out what you know, there is a
    system that gives you what are called training hits where you can start to
    judge some ads. Hits are refreshed every so often on the system and you
    need to aim for 70% correct accuracy because this is the requirement to
    continue on and qualify for the project. If you’re not getting 70% then go
    back to the guidelines and read them again.
  3. If you are confirmed by the trainer to be abler to achieve 70% accuracy or
    better, then you are added to the qualification group to take the exam.

IF YOU FAIL THE EXAM MORE THAN TWICE THEN YOU WILL NOT BE ABLE TO
CONTINUE ON…SO MAKE SURE YOU ARE READY!

Once you pass the training the company will issue you a contract and you can
begin working.

type of tasks and rating scale

When doing the job, the most important thing that we mentioned before was
that you should understand the query and the intent of the user when they were
typing it into the search engine. So you must evaluate it by first understanding
the query meaning and if not then you must do quick research to understand it
before you can determine the query intent. To determine the intent of the query,
you need to consider why the user entered the query and what the results the
user would have liked to see. There are three basic intents; Navigation,
Information, and Transactional like websites with a product or service that can be
purchased.

The next thing of course would be to evaluate the level of specify and ask
yourself; do the query and the ad match perfectly or not. With that said, you
should always disregard marketing terms like “cheap”, “best”, “highest quality”,
“superior”, “great”, and “greatest”. The meaning of these words is arbitrary
because what may seem “cheap” to one user may not be cheap to another.
The guidelines go over everything from how to understand the ad, how to best
research the ad, and then give you the correct options for rating it. Ads are given
a rating from perfect to bad and plenty of examples are given in the guidelines
that cover just about everything you are likely to face.

Where to apply & requirements

If you are interested in applying for the job, then iSoftstone is currently hiring for
ad evaluators and you can do apply here: https://issworld.isoftstone.com/JobDescription/tabid/104/jobid/9630/title/Onlin
e%20Ad%20Evaluator%20-%20United%20States/Default.aspx?language=en-US

The requirements for getting this job should be a good computer running a
Windows operating system (sorry MAC users) with a high speed internet
connection. You should have some strong computer skills for this job and strong
communication skills when you are evaluating ad copy and have to provide
additional information. You also need to make sure you are fluent in the language
that you applied for and live in the country where you applied as well. The current
job openings want a native proficiency in English and must reside permanently in
the USA.

If given a contract, you are an independent contractor and can usually get 10-25
hours a week if you stay in the accuracy range you need to be in. Currently, the
company doesn’t pay for the training and instead says that it’s a ‘free training’ to
make it seem more attractive. However, the time involved in getting ready for this
does take some hours that should be paid by the company. It could be that
training is not paid because many people fail the exam. So make sure you read
the guidelines like they were the bible.

As always, if you have any questions, then please send me an email or leave a
comment and I will always reply right away and help you with anything you might
need.

Lionbridge & Appen Connect Platform – List of Projects and Code Names

As you may know Appen acquired Leapforce in 2017, since then the company has decided to close it is own project management platform known as Appen Global and move all projects to Appen connect. The group of projects known as Falcon (mainly Facebook related projects) now is no longer actual, these projects also have been moved to Appen connect platform.

Taking into account the fact that all projects have code names and little description is provided, many candidates might be lost in terms what project to go for. 

Bellow you will find a list of most popular projects and links to more info about each project:

Appen connect
Project code nameDescription Reference for more info
YukonGoogle Search Engine Evaluation Project Click here

Exam Simulation Tool
ArrowGoogle Ads Evaluation Project Click here


Exam Simulation Tool
ShastaMaps Evaluation Project

Provide relevance and accuracy ratings for one of the world's largest and most popular mapping applications.
The job has an ABOVE average volume of work.
Click here
Echo Apple iTunes Music Search Results Evaluation Project

Improving the relevance of search results for music-related content.
Raters must have access to an iOS device capable of running iOS 12.x. and higher. The job has an average volume of work.
Click here
CableApple TV Search Result Evaluation.

Search Relevance task focused on improving the relevance of search results, based on the most likely intent of user searches. Raters must have access to an iOS device capable of running iOS 12.1.4. The job has an average volume of work.
Similar to Echo
JavaApple Store Search Relevance project focused on improving the relevance of search results based on user search intent.
Raters must have access to an iOS device capable of running iOS 12.1.4
Similar to Echo
SharpApple Search Relevance task focused on improving the relevance of search results within different media categories.
Raters must have access to an iOS device capable of running iOS 12.1.4
Similar to Echo
IndexApple App Store Search Results Evaluation Project

Search Relevance task focused on improving the relevance of search results based on user search intent.
Raters must have access to an iOS device capable of running iOS 12.1.4. The job has an average volume of work.
Similar to Echo
Wouri Apple Safari Search Result Evaluation project. The goal of the project is to understand the user intention as represented by the query and determine how well or how completely the result satisfies the user's need. Coming soon
Ipsoot (also known as Pearl and Falcon PT)Post categorization on Facebook. You have to decide what topic that post fits under. It is basically a categorizing system job which aims to put the posts that are made into the correct categories of broad topics. Click here
TruckeeInstagram Ads Evaluation Project

Help improve ads quality for one of the world’s largest image sharing sites.
Required: An active Facebook and Instagram account – The Instagram account must be connected to your Facebook account. You also need a smartphone with Android or iOS. The job has an Above Average work volume.
Click here
NileFacebook Ads Evaluation Project

Help improve ads quality for one of the world’s largest social networking platforms.
Active Facebook account required.
Click here
RattleThe goal of this project is to improve the relevance of search results for one of the world’s largest search engines. Click here
ParadiseThe goal of this project is to improve the accuracy of search results for businesses and entities on one of the world’s leading search engines. Click here
Mohawk Help improve ad relevancy on a popular social media platform.
Similar to FB
Falcon projects
Prospect MI Facebook Falcon Projects. Help improve ad relevancy on a popular social media platform.
Click here
Zeya Facebook Falcon Projects. In this task, you will be asked to research and evaluate claims stated in various pieces of content (e.g., articles, links, photos, or videos). 20 hrs per week, work is done via Facebook rating tool.
Click here
Copper The aim of this project is to help the client evaluate and improve the quality of the Ads that they present to their users.
Requirements are a personal computer running Windows 8 or better and a desire to look at different ads.
Click here
Alkali The aim of this project is to help the client evaluate and improve the quality of the Ads that they present to their users.
Requirements are a personal computer running Windows 8 or better and a desire to look at different ads.
Average volume of work.
No info
TigrisThe project consists of rating tasks focusing on improving the relevancy of advertisement results from a major social media platform. Consultants will rate advertisements to help the client understand which advertisements (also known as ads) people want to see, and why. The daily task of the consultant consists of rating a batch of ads in a client-owned rating tool. FB project?
CarmelUtterance annotation and evaluation.Microsoft Bing project aimed to learn search engine to recognize voice and human speech. No info

*group of projects known as Falcon (mainly Facebook related projects) now is no longer actual, these projects also have been moved to Appen connect platform. Newly added projects such as Mohalwk, Prospect MI, Zeya, Copper and Alkali are most likely related to small Facebook testing projects. If you have been participating in one of the above listed projects, feel free to share your experience with us via leave a comment option!

Lionbridge
Lionbridge project code nameDescription Reference for more info
Internet Assessor, Internet Safety Evaluator, Personalized Internet Assessor Google Search Engine Evaluation Project Click here

Exam Simulation Tool
Multimedia JudgeBing Search Engine Evaluation project Click here
Personalized Ads Assessor Google Ads Evaluation Project Click here


Exam Simulation Tool
Maps Analyst Maps Evaluation Project Click here
ISoftstone
iSoftStone project code namesDescription Reference for more info
Online Ad EvaluatorBing Ad Evaluation project Click here
Search Engine EvaluatorBing Search Engine Evaluation project Click here

How to Work at Appen and Lionbridge from Abroad without Any Risk – VPN & Teamviewer Free Solution/How to Apply, Qualify and Work from Abroad for Any Appen Projects of Any Locale (Provided You Have a Work Permit and Language Expertise Required for a Specific Country/Project)

You need to login to view this content. Please . Not a Member? Join Us