How to pass the Leapforce (Raterlabs), Appen (Inca) and Lionbridge exams? (Exam Guidelines 2018)

How to crack Leapforce exam? How to pass Yukon exam? How to pass Lionbridge exam? How to pass Inca exam?

Before you can start working on various tasks, you must pass the qualification exam. The qualification exam you will take covers two types of rating tasks which will make up 70% of all tasks in the project: Needs Met and Page Quality.

Once your candidature is approved for certification, you will get an exam email with detailed instructions. Within seven days you have to study 160 pages of the General Guideline which consists of rating rules and concepts which teaches you how to do the rating of search results and assessment of quality of web pages. You should follow these rules and not use your personal judgment. What they want is for you to represent a typical user in your country. Before you proceed with the exam you need to study the Guideline at least twice paying particular attention to practical task examples. Keep in mind that it’s 160 pages long. As I always advise, don’t wait till the last minute.

Note: At the stage of examination, Lionbridge provides candidates with very good exam preparation support. You will get access as an exam guest to the Lionbridge learning portal where you can listen to webinars and even try to do a few practical tasks before the exam!

Important update: Lionbridge is very selective in terms of recruiting new raters, up on revising exam results they will check  your activity on their exam preparation portal, with this in mind, I strongly recommend you go through all the webinars and tasks simulation on their exam preparation portal before proceeding with the exam itself. Make sure that you get a pass for Needs Met simulation tasks. You may do them several times until getting a pass.

There are three parts in the exam: you can proceed with the next part only if you pass the previous one. Once you complete any part of exam, within 3-10 minutes you will receive an email with information about results.

Google updates the way the exam is done from time to time. The main feature that has been changed recently is that you must rate pages from your smartphone (Send to Device tasks). If you do not have smartphone, they say you cannot apply for this job. This is due to the fact that the number of mobile users is constantly growing and the company wants to assess websites from the perspective of on-the-go mobile users.

Note:There is a recommended schedule that will give you plenty of time so that you’re not rushing to complete the exam at the last minute:

  • Day 1 – Study the Guidelines – Make sure to setup your smartphone so that you are ready to take the final portion of the exam.
  • Day 2 – Start the Theory part of the exam making sure you are taking time to CAREFULLY read each question. Some of them can be tricky and that’s meant to make sure you fully understand the concepts.
  • Day 3 – Go back and study the guidelines once again starting with the Page Quality section.
  • Day 3/4 You can start the second part of the exam which is the Page Quality section if you feel comfortable on day 3. You may want to study this entire day, and you’ve got plenty of time if you decide this to take the exam on day 4.
  • Day 5 – Read the Needs Met section of the guidelines again and make sure to take your time. You’ve still got two more days to finish. And as it has been mentioned before, have your guidelines open in case you need to refer back to them.
  • Days 5/6/7 – Get started on the last part of the exam ‘Needs Met Rating’

Part one Theory (Leapforce exam part one)

In this part of the exam you will be assessed on how well you understand the theoretical part of rating concepts, as well as on your ability to interpret questions and search for information in the General Guidelines. It is an open book exam, so you can use the General Guidelines to find answers to the test questions. This part has 32 question sections; each section has 4 parts, so in fact you have 132 true/false questions to answer. Read questions carefully, some of questions can be tricky in terms of their wording. You can consult with the guideline book while passing the exam and it’s strongly recommended to use this opportunity.

Note: Do not leave incomplete tasks more than for 1 hour, otherwise they will expire and you will fail the exam automatically. If you need to take a break,complete tasks and press “Submit and Stop rating”.

In most cases an hour would be enough to complete the theoretical part of Leapforce exam. The following message will be shown to you once you have submitted the last page of questions:

No tasks are currently available. Please try again later. 

Within 10 minutes a result notification will come to your gmail, and in the case you are successful with part 1, the next part will be available in 10 minutes.

Part two Page Quality (Leapforce exam part two)

In this part of the exam you will be asked to assess 7 web pages for their quality. My advice for this part is to check all quality aspects, and fill in the online form very carefully so you can give a correct overall quality score (from lowest to highest) to a page. You should expect 2-3 low quality web pages, 2 high quality web pages and 2-3 medium quality web pages. Keep this in mind. In order to give correct ratings, examine web pages for ETA (Expertise, Authority and Trustworthiness) criteria very carefully.

Also, keep in mind that in this part of exam you need to give a PQ rating mainly to a web page and not to a website, although some quality aspects of a website have to be taken into consideration when assigning overall PQ rating, in particular in case of YMYL (Your Money Or Your Life) content which Google takes very serious.

Do not forget to write useful comments where required, otherwise the system may show an error.

You don’t need to finish this part at once. If you want, you can take a rest. The tasks are still available when you sign in. Again,  if you pass this part, the company will send you an e-mail saying that you can proceed with part 3.

Note: The url/web page may not open on your PC, in this case do not mark these as “Did Not Load”. During the exam you should not expect to give a website this flag. If you do so, your answer will be incorrect. To solve this issue try to open link using incognito mode on your browser or/and give rating using other sources of information (website reputation, etc).

Снимок экрана 2016-01-10 в 17.25.24
Page Quality Task

Part three Send to device (Leapforce exam part three)

This is probably the most difficult part of the exam, and many candidates fail the exam at this stage. There are 7 tasks, and each task contains 8-12 result blocks. In each task you will be given a certain query, and a list of search results blocks with links where you have to give a usefulness rating to search results using a scale from “Fails to Meet” to “Fully Meets”. Lionbridge  and Leapforce exam passing score: in order to pass this part you have to get an overall score of at least 80%.

Note: while doing Leapforce and Lionbridge exam part 3, keep in mind that all links have to be opened on your phone because Google analyses web pages from the point of view of mobile users. If you do not have a smartphone, you may use any android emulator for this purpose, in some cases it is even more convenient than using a smartphone for opening links.In order to open the link on your mobile phone, click the  link on the result block on your desktop and then go to www.raterhub.com/url  on your mobile browser  (Google Chrome) to visit the link. You must be logged in your gmail account in order to have access to raterhub platform on your phone. The same rule works if you use android emulator.

Note: Some candidates when accessing the link (www.raterhub.com/url ), got informed that Gmail account was unauthorized to visit the link. Most likely reason for this error is the fact of being logged on multiple Gmail accounts on a device. The solution for this problem is to go to Android setting -> Users & accounts -> add project associated Gmail account, then restart your device. This setting should fix the issue. 

When you are evaluating landing pages in the exam, don’t place too much importance on the Page Quality slider. The focus needs to be on Needs Met Ratings. Do not worry about using flags in the exam such as the ‘Hard to Use’ flags.

One of the most important things is to absolutely know when to use Fully Meets. Fully Meets ratings are very rare compared to Highly Meets ratings. Avoid being too generous on landing pages. If you have any doubts at all, you should not be rating a page ‘Fully Meets’.

Additionally I would like to give general tips on how to proceed with Leapforce (Lionbridge) exam part 3:

1. Make sure that you fully understand the query and user intent. If you do not fully understand user intent, make additional research on the Internet.

2. Determine what type of query (user intent) is:

o Single entity (business) query with local or non local or both intent/to visit in person/navigate to a website

o Business chain query or query which is looking for business within one category (e.g. car repair service near me)

o Simple know query (where the user requests a specific piece of information, do not assign the Fully Meets rating to any particular result, the correct answer must be present in an SCRB).Examples of simple know queries:paris weather, delta airlines customer service number, current time in Amsterdam)

o Information query seeking a long answer/piece of information (what cases stress)

Types of SCRBs (Special Content Result Blocks): ny weather (simple know query), how old is universe (simple know query), does god exist (long answer seeking), berlin airport (single entity), burger king amsterdam (chain), coffee shops amsterdam (categorical).

o URL/website query

3. Consider the following aspects while giving ratings to result blocks: user location, for local intent queries far away results are useless or slightly relevant. This aspect is very important for the following types of queries: tire shops near me, where to eat near me, Walmart near me, etc. When you get a task with this type of query do use in built map for researching user location/view port and results.

4. Make sure you give correct ratings to special content result blocks for single entity and business category queries. In case of business chain/category query, the result block with a list of businesses is always better than just result for a single business within one category.

5. Consider expertise and trustworthiness of search results for financial, legal, and health related queries; low expertise and trustworthiness automatically reduce needs met rating of the results.

6. Think of dominant, possible common, and minor interpretations for the query and take this aspect into account while giving ratings to a result block. Minor interpretation results should get a low usefulness (Needs Met) rating.

7. Take into account how well the web page/website is optimized for mobile users.

8. Once you have analyzed and considered all listed above aspects, you should give a rating to result blocks one by one.

Note: In some cases there might be some results (links) which are not accessible from outside U.S. (usually websites of well known retailers such as Target, Walmart, etc. They ban access from foreign IPs to prevent hacker attacks). Raterlabs or Lionbridge do not take into account this factor and therefore rating such results as fails to met may lead to overall fail.

To make sure you do not miss anything before proceeding with part 3, follow pre-exam instructions to pass this part. There will be a link to a video. Watch it and follow the instructions.

Снимок
Examination Need Met Task

Note: In part 3 of the exam (Needs Met), most of results blocks have Needs Met and E-A-T (previously PQ) sliders. Main focus should be on providing correct Needs Met rating, which in some cases might be affected by E-T-A (PQ) rating when it comes to YMYL queries and results. Leapforce/Google re-named PQ to E-T-A in part 3 to make it clear that the most important aspects in PQ are expertise, trustworthiness and authority. In general it is similar to PQ concept. While giving E-T-A rating you should evaluate MC under these 3 criteria. In most cases you may do it fast at a first glance approach, but be sure to provide good evaluation for E-T-A when you have YMYL query.

Note: If the user location map does not show user location correctly, and you have a blank page, hit the black arrow button. The task will be closed, but you will see “Incomplete tasks” on the evaluation platform. Click continue and come back to your task with the updated user location field. Remember that it is very important to take into account the user location while giving ratings to block results. Also keep in mind that there is no need to finish the task in one sitting. You can take a break if you need to.

Once you complete 7 tasks you will get this message:

No tasks are currently available. Please try again later.

Leapforce exam results and Lionbriage exam results

You will get overall exam results on the exam due date from Leapforce and exam due date plus one day  if your vendor is Lionbridge. At Leapforce you will be  asked to sign a few electronic forms and in 2-4 days you will be given access to live tasks. At Lionbridge you will have to complete educational course with no pass/no fail quiz before you are granted full access to the tasks.

US Raterlabs and Lionbridge raters

Once you pass the exam you will then go through the employment process which might take up to 3 weeks. You will be asked to complete an online version of the IRS Form 8850 (Pre-Screening Notice and Certification Request for the Work Opportunity Credit), and a tax credit questionnaire from a vendor payroll provider. After you have completed these two forms, you will be presented with a formal employment offer letter. After acknowledging your offer, you will still need to complete the required activities in a timely manner. Try not to postpone the completion of these important steps: Providing bank details for ACH payments on Paycom website. Providing your I9 Employee Section 1 and I9 Employment Eligibility Documents (section 2) must be completed by specified deadline. It is very important that candidates complete all required steps as soon as possible to avoid termination of your employment.

The following posts are recommended for reading:

You Failed the Leapforce (Raterlabs) or Lionbridge Exam – Now What?

Common issues of new raters (Yukon Raterlabs/Leapforce and Lionbridge Google Rating Projects)

What Should You Do If You Fail Leapforce or Lionbridge Exam Twice and How to Re-Apply?

 

Advertisements

236 thoughts on “How to pass the Leapforce (Raterlabs), Appen (Inca) and Lionbridge exams? (Exam Guidelines 2018)

  1. Really good information here. I found your website and read over everything. You got all the information 100% correct. I just went through the exam and passed it, but it was nice to know what to expect, and your site helped me out a bunch. Thanks!

      1. I used VPN while I was performing the test part 1 what will happen 😓

  2. I have taken my final section of the exam but didn’t receive any sort of email intimation about pass/fail. How long should I wait for the results ?

  3. I passed part 1 and 2 but i failed in part 3
    they give me another chance
    my question when I will retake ,I will need to answer whole the exam (part 1,2 and 3) or only I need to answer only part 3

  4. Thank you so much for educating me on what it takes to pass the LP exam. Your thoughtfulness will never be forgotten. The fact that you took the time out to create this blog is awesome.
    I appreciate you sharing the knowledgr on how to become a successful LP agent.

    Thanks

      1. Thanks so much for all this information! I wish I had found it before taking the Leapforce exam the first time (which I didn’t pass 🙁 but am taking again for sure). My bad, but now I know and am here.

        Can you please clarify your reply above re: including comments: Are comments only necessary on Part 2? I made the assumption that anytime there was a comment link one was required and thus commented on every single task and every single results block in Part 3. Thanks for any clarification you can provide.

      2. Are you sure about comments sir? I am going to give exam in next week. Do I really need to give comments in third part or its optional?

  5. what is the difference between the ‘L1’ and ‘R1’ blocks in section 3? This is located in the upper left corner of the result blocks. I couldn’t find where in the documentation it clarified this information and what these naming codes meant.

  6. In 3 days l am to do the exam for Lionbridge Ads Assessor, l am in Australia, whilst reading this blog l am very grateful for your efforts, but l cannot pinpoint anything pertaining to the above Exam. Maybe l missed something.

    1. Thank you for your question. Unfortunately I do not have any experience in going through Ads Assessor exam.Me and other people would appriciate if you could tell us any info about it…

      1. Great article Tim! I was wondering about the Android emulator though… Is it really ok to do the mobile part of the exam on an emulator? Don’t Leapforce check the IP address of the phone or its location, and use of an emulator be detected? (I live in UK)

  7. if you have already went through Ads Assessor exam, could you give more information regarding what to expect, etc? Your reply will be appreciated, thank you.

  8. l just did a preliminary exam of sorts, it was quite hard for me, everything was from overseas, so l had no idea, not one thing was Australian that l could relate to. If l get through this first bit then maybe there is hope??? The actual Exam does not come for another week or so – if l am given the opportunity to do it.

  9. I just got a notice that my study guidelines and exam for Lionbridge will arrive in my email when it is created on 4/13 and the exam will expire on 4/20. I am set to be out of town for most of that time frame. Can a request be made to delay the exam for another week, and if so do i just reply to the email? I’ll be on vacation staying in a hotel and am not sure i can really focus on studying and taking an exam, but really do not want to lose the opportunity.

  10. In reply to Kelly Roberts’ question, in part 3 you should not pay attention to writing comments, focus needs to be on Needs Met Ratings.

    1. Hey Tim, there is one odd thing, which is what made me ask my original question. The below note was in both “you passed/can take the next exam” emails I got after completing parts 1 and 2:

      NOTE: When there is a comment box, please be sure to enter a well-thought-out and descriptive comment. Leaving comments such as “about a store” or “highest quality” are not helpful or descriptive.

      In part 2 there was an actual comment BOX for each task. In part 3 there were comment LINKS in each tasks’ multiple result blocks—when I *clicked* on them, they would expand into a box below the rating scales where I wrote comments. Could the note only be referring to part 2 since that was the only test with actual boxes vs. links? There were no notes in the emails that said anything like “comments will be disregarded/not read.” Maybe there was in the instructions in part 3 and I just missed it?

      1. Actually all comments are disregarded and nobody reads them, Leapforce gives instruction on writing comments in part 2 only because of the fact that the sytem may show an error if there is no comment left. All exam tasks are assessed automatically by robot algorithm on Google server…so, again, I would like to point out that there is no need for writing comments in part 3 of the exam =:)

  11. Hi, thanks for the helpful post, but I have a question about part 3. You wrote: “In order to open the link on your mobile phone, click the link on the result block on your desktop and then go to http://www.raterhub.com/url on your mobile browser (Google Chrome) to visit the link.”

    I’m not clear what you mean by raterhub.com/url. Do I need to change the url part to the url I’m supposed to open or do I just leave the url as is? thanks

    1. Hi Debra, thank you for your question.

      In part 2 and 3 of the exam, you will be asked to open links on your phone.
      1. Click on a result block/landing page link on your desktop, you will see the following message “URL sent to mobile device, please visit http://www.raterhub.com/url”
      2. Type in http://www.raterhub.com/url in your mobile Google Chrome browser and you will land on the webpage you clicked before on your desktop. Every time you click on new link on your desktop, http://www.raterhub.xom/url will be updated automatically .
      3. You always need to visit only one url (www.raterhub.com/url) to visit new web page.
      4. Once you have passed the exam and have full access to raterhub system, I recommend you to download raterhub app , this app will open links on your phone automatically, you will not need to type in http://www.raterhub.com/url every time you need to visit the link…

      1. Thanks so much for the explanation, Tim. I also didn’t realize I needed to use the Chrome browser on my iphone as well. I’ve been using Chrome on desktop because that’s what I’ve been using for years. On my phone, I’ve been using Safari, but I’ll install Chrome on my phone now since I plan to start part 2 tonight or tomorrow. Thanks again.

  12. Thanks for this. Do you know how many times you can retake the exam? I’m wondering if it’s only once.

    1. Hi Tiffany,
      In one week after an unsuccessful attempt, you will get the second and the last chance to re-take the exam. You will have to go through all parts of the exam again, practical tasks in part 2 (Page Quality) and part 3 (Send to Device) will be different from those you had on your first exam, although there may be a few tasks that come from previous exam.

  13. This guy is very helpful. His services are legit and highly recommended. Til next time!

  14. Can you provide clarification on the “due date” of the exam? I passed parts one and two earlier in the week. My email from LeapForce said to complete the exam by May 2, which I assume meant I could also use this day to test. However, upon going to the rater hub site, I see the “No tasks are currently available.” message. Has anyone taken any portion of their exam on the date listed in their email? I am still awaiting the reply from their cs department. Thank you very much!

    1. Thank you for your question.

      Most likely, you have missed an exam due to expiration where you have missed the exam due date. All examiners need to keep in mind that exam times are in PST. Once Leapforce emails you the exam results, you can request to retake the exam.

    2. I had the same exact issue and now I’m having to retake all 3 parts. I tried contacting Leapforce, but never received any reply. From researching them further, it seems they don’t respond to communication much.

  15. Your blog is the best information I have found on this subject and your help has been so appreciated! Your services have proven to be invaluable. If anyone needs help understanding what you are doing incorrectly or needs tutoring on this job type I completely recommend him. He is amazingly helpful & trustworthy!!!! Thank you again!!!!!

  16. Hello,
    I have a question please,
    Why in part one in the guidelines we called the rating task PQ rating, and E-A-T was part of it to be evaluated, then in the second part about user needs, suddenly the landing page evaluation called E-A-T, is this the PQ rating because it has the same levels “High, Low…”, or it is only evaluation for the E-A-T, no MC taken in consideration,

    Thanks

    1. In part 3 of the exam (Needs Met), most of results blocks have Needs Met and E-A-T (previously PQ) sliders. Main focus should be on providing correct Needs Met rating, which in some cases might be affected by E-T-A (PQ) rating when it comes to YMYL queries and results. Leapforce/Google re-named PQ to E-T-A in part 3 to make it clear that the most important aspects in PQ are expertise, trustworthiness and authority. In general it is similar to PQ concept. While giving E-T-A rating you should evaluate MC under these 3 criteria. In most cases you may do it fast at a first glance approach, but be sure to provide good evaluation for E-T-A when you have YMYL query.

    1. Hi Ena,

      At the stage of examination, Lionbridge provides candidates with very good exam preparation support. You will get access as an exam guest to the Lionbridge learning portal where you can listen to webinars and even try to do a few practical tasks before the exam!

      Important update: Lionbridge is very selective in terms of recruiting new raters, up on revising exam results they will check your activity on their exam preparation portal, with this in mind, I strongly recommend you go through all the webinars and tasks simulation on their exam preparation portal before proceeding with the exam itself. Make sure that you get a pass for Needs Met simulation tasks. You may do them several times until getting a pass.

      at examination stage LEAPFORCE does not provide candidates with such tool (task simulation).

  17. Thank you for the information!! It’s too late to find your blog before I take the Lionbridge exam and I failed in part 3:( Although I got another chance to take the exam, I got an email later telling me that they decided not to give me the chance. Is it possible to reapply for this position?(wondering whether they have keep my log in IP, PC ID, etc., and reject for reapplying )
    Thank you so much!!

    1. What should you do if you fail the exam twice how to re-apply?

      If you fail the exam the second time, Leapforce will not allow you to retake it a third time. In this case I would advise that you apply to another vendor like Lionbridge. Before proceeding with registration, make sure that you use a new gmail account, when filling out the application and answering the application questions, indicate that you have never applied/worked for search engine evaluator position before. A new IP address is also required. You may use VPN to change your IP address. Once you have started the application and qualification process, I recommend you keep the same IP address during the process. Successful outcome of this approach is not guaranteed, but it is possible.

      100% working solution is to apply on behalf of another person you trust, using new IP/PC and gmail account.

      1. Hi Tim!
        I actually received a 3rd chance to retake the exam. That’s weird.
        I’m studying now like a fool xD. Tomorrow I will try again.

  18. I am working on part 3 and have only done 2 questions, when I wanted to continue today it says there are no more tasks. Could I have failed just with 2 questions!!??

    1. Hi Olga,
      Sometimes it may happen that once a few tasks are done some raters may see “no tasks are currently available, please try again later”. This happens due to issues on Google/Leapforce exam server, the solution to this problem is to wait for some time (normally 1-2 hours) for the rest of tasks to appear.

      1. yes thanks, 2 hours later I was able to finish the exam. Hope I did good

  19. Every time i open the raterhub.com i get this message
    “No tasks are currently available. Please try again later.”
    Iam running out of time and do not know what to do ?? Please help

  20. I passed the qualification exams a day after a signed a contract and filled a w9 after a day of waiting a received an email saying that unfortunately they didn’t have a position for me… What??! How is that possible??

    1. Sometimes some successful candidates get such message from Leapforce: unfortunately we are unable to offer contract at this time…

      The reason for this is unknown to me but I have assumptions that this could be due to: IP related issues, violation of non disclosure agreement, discrepancies in personal data or simply leapforce got enough people for the project…

  21. I’m about to take the exam for Leapforce next week. Is Google Chrome required on my phone, or can I use a different browser? Chrome is not supported on my model.

    1. I have a Windows phone. I’m assuming it’ll be fine. I was just wondering because in the job description it mentions android/iPhone only at the top, then Windows at the bottom.

      Anyway thanks for your quick reply 🙂

  22. When i clicked the link for the guidelines, the page displayed a Forbidden error. It’s my second day for the exam and still i cannot access the page.

    1. Make sure that you logged on with associated gmail account or if you have multiple gmail accounts make sure that gmail account you applied for Leapforce is set as the primary one.

      1. I go through the captcha page and then try to log in with my only gmail account and all of the guideline pages are totally blank, won’t open. I am worried I won’t be able to study for the exam, has any one else had this problem?

  23. If exam is available and the only problem is access to guidelines, email me at examtutoring@ yahoo.com, I will sent it to you.
    Only please do not use gmail for this purpose.Use any other email provider…

  24. Hi there, I just want to ask that what are the chances that my application form will be accepted.

    1. It depends on many factors…

      It might be that at the moment of your application submission, quota of raters for your country was reached and therefore Leapforce or Leanbridge does not hire new raters at the moment…As soon as they fire unsuccessful raters, they continue hiring new people to maintain required number of raters in your country…

      You CV does not meet Lionbridge standards. Lionbridge is very selective in terms of quality of CVs of applicants in India and another developing countries. Make sure that you CV looks professional and accurate and there is no gaps in your experience.

      Your IP address might be suspicious or does not meet Lionbridge requirement. If you have dynamic IP address (IP which changes each time you go for Internet) – you will be rejected for sure. Make sure that you have static IP address (this valid only for Lionbridge).

      Someone uses the same IP address for rating project (in case of sharing Internet network), make sure that your IP address is unique.

  25. I feel stupid… I took the test fornthe 2nd time and still couldnt pass the theory. Argh. I went question by question looked them up and still couldn’t pass. Wow.

    I guess what messes me up most are multiple true false questions under one question. Miss one and you got all four wrong.

  26. Hello I passed all 3 parts of the leapforce exams received positive results and been told to wait for my paperwork to be done but few days later received an email that I failed has anyone been in this same situation??

    1. Sometimes a few successful candidates get the following message: unfortunately we are unable to offer contract at this time…

      The reason for this is unknown to me but I have assumptions that this could be due to: IP related issues, violation of non disclosure agreement, discrepancies in personal data or simply leapforce got enough people for the projec in your locale.

  27. Do you realize that you are majorly violating the Non-Disclosure Agreement you signed to work at Leapforce? I think that is in effect even if you no longer work for them (and if you do, you are risking your job). IJS

    1. I do not disclose any specific info regarding tasks/exams etc. only general tips and recommendations based on my personal experience, you will not find exam answers on my blog.
      Google “Leapforce exam answers” and you will find screenshots of exam and more, so please write to owners of those websites saying that they are violating NDA, not me.

    2. Terri, I’m pretty sure that this forum shows up easily if you search on internet. If I could find it and you could find it, it means that everyone can (i guess LF or LB know how to search on Google…:)
      Therefore, If no early closure or warning whatsoever has come for Tim, it may mean that after all he’s not quite violating any NDA.
      Actually it’s a good thing even for those companies that someone helps with supplementary guidelines so that people can better understand

      Thanks Tim, btw.

  28. Hi,

    Thank you for a great blog! I wrote the Lionbridge exam last week and the tips were very helpful.
    I passed Part 1 & 2, but fail Part 3. I studied really hard (because as a single mom I really needed this job) and used my guide as far as possible, but I think I don’t understand the Needs Met task correctly. Would you please be so kind to tell me how I should approach these task. What my mind set should be. Please help…

  29. Hi!

    I just got an email TODAY from Lionbridge saying that I passed all three exams and will receive a “Welcome to the Program” email. Do you know how long before I receive that email?

    1. You will get overall exam results on the exam due date from Leapforce and exam due date plus one day with Lionbridge. At Leapforce you will be asked to sign a few electronic forms and in 2-4 days you will be given access to live tasks. With Lionbridge you will have to complete educational course with no pass/no fail quiz before you are granted full access to the tasks.

  30. Hello! I just received an email from LF saying that I passed their exam. THANK YOU, Tim. Your posts were as helpful as the official guidelines.

  31. Hello, I applied at Lionbridge but failed the exam. After a week, I was given a chance to take a re-test. However, I received this email ….”Unfortunately we were unable to enter you into our Online Exam. According to our checks it appears that you have the same IP Address as another person in our system. Can you please explain why this has occurred?” ….what does this mean? It’s sad because I prepared so much for the exam and i don’t know anybody who has the same IP address as me. Please enlighten me about this. Thank you so much.

    1. Hello,

      Most likely they could not eneter you into exam, because you have dynamic IP address. It might be very risky to have this type of IP address because it means that many people have the same shared IP address. This may lead to:

      Multi-accounts conflicts (when people use the same IP address for going to raterhub platform).

  32. Hello Tim, thanks for the reply. I have an internet at home and i intend to do the online job there. I think they detected the IP address at the office when I opened their email and registered for the educational materials. I already emailed them and explained my side and I also explained that I intend to do the online job at home. Do you think I will still be given a chance? I’m sad, this happened.

  33. Hi Tim! Thank you for the tips, they’re really helping me in the Leapfoce exam. Yeah, I’m in studying to the second part now 🙂 I’d like to make a question, is there a problem if I use an iPhone instead an Android? I was wondering because Android is an OS that kind of works better with google, more tasks can come to Android, and all the examples on the Guidelines are from an Android phone, or it really doesn’t matter? Thank you!

    1. hi Caio,

      As far as I know iphone users get the same amount of tasks as android users. The only thing which makes android phone more convenient for raters is the possibility to set up rater app which will open links automatically on your phone when you click links on your desktop.

  34. Hello,
    I have a question: if you have a VPN, could you use a private IP to log in or would they find out that it’s a Proxy?
    Thanks

      1. no, I don’t use a VPN, I work from my home country but I was just curious about it. Just to understand how it works

      2. Hi Tim,
        I’m having a doubt. today I did the first part of the exam, answered all the questions and awaited the response by email.
        However, after waiting more than 4 hours, I still haven’t received any reply or notification and when I went again on the raterhub page where I passed the exam it appears that the same one is still available. So, I’m wondering whether something may have happened and the exam wasn’t over but actually I’d say yes because at some point it seemed over )no more questions and basically seemed the end of it)
        Is this normal? should I worry or take the exam again?
        thanks for your reply.
        Fabri

  35. Hi, thank you for your blog! I tried to apply to leapforce twice but in both of them they refute my candidature, they say that there is no project available for me, but they said that there are projects open for my country, could help me to understand how to apply for these jobs, what should I put in the application? Thanks in Advanced

    1. Hi David,

      if no projects are availble in your locale then you can do nothing about it, just wait..
      It might be that at the moment of your application submission, quota of raters for your country was reached and therefore Leapforce or Leanbridge does not hire new raters at the moment…As soon as they fire unsuccessful raters, they continue hiring new people to maintain required number of raters in your country…

  36. Hi Fabri,

    Sometimes it may happen that once a few tasks are done some raters may see “no tasks are currently available, please try again later”. This happens due to issues on Google/Leapforce exam server, the solution to this problem is to wait for some time (normally 1-5hours) for the rest of tasks to appear.

    1. well, no, in my case I’ve done part 1 and I was waiting for either the link to the next exam (in case I passed) or an email saying that I didn’t pass.
      i got nothing since at least thursday or friday

      1. It looks like you have encountered a server problem in this case you should contact Leapforce and ask for support.

      2. I did. the response I got was one of the least helpful I ever got by a support team. Appallingly careless, you could tell he didn’t give a damn. Although he realized the mistake was at the source, he refused (with a single response line) to extend my deadline and when i replied explaining that at least because of what happened they should at least keep that into account, he replied: “oh, sorry to hear that. Regards

        I decided to give up.
        Being treated with such disrespect and I’m not even working for them yet makes me shiver. Horrible communication, despondent and spiteful attitude.

  37. Hello, I have to past the Lionbridge test. I read the guideline. Can you tell me how to get a pass for Needs Met simulation tasks ? Thanks

      1. Sorry Tim, one more question: I’m about to face part 3 of the exam and it’s friday. I have until monday to deliver. It could sound like a silly question but passing the test on saturday or sunday would be possible even if it’s weekend? I could still do it today but I’d rather give myself 1 more day to assimilate/absorb the GL.

  38. Hi Tim,

    I just only received an email from Lionbridge saying that I passed the rating exam. I took the exam twice actually. I would like to thank you for giving such wonderful tips here. Thank you very2 much.

    1. You are welcome! you may say thank you with buying me a coffee by sending a small amount via PayPal (buy me a coffee widget on my blog). I will appriciate it!

  39. As a couple others have mentioned, I completed the Leapforce exam on Thursday, July 28 at around 11:00pm central. Exam due date was 12:00am Pacific. So I completed it with four hours to spare. It is now the morning ofSunday July 31 and I still have yet to receive an email regarding my test results.

    Is the cause for concern?

  40. Thank you for this information! It’s really helpful. I failed the exam on part 3 and will be retaking the exam this week. One thing I was wondering about are the tasks. I’ve heard people talk about how long LF expects a task to take. If for instance, you are given a side by side task how long do they expect this to take generally? I ask because on the third part of the exam it seemed to take me at least 20-30 minutes to do one side by side task. Any insight you could give would be awesome. Thanks!

    1. If you mean the tasks on the exam, you can spending time per task about maximum 2 hour. If you don’t submit the task after 2 hour, it will automatically expired. Probably you will fail the task.
      In the real job, per side by side task usaually in average 9 minutes. Some task maybe lower or higher depend on the task difficulties.

  41. Hi,
    My name is Alain, i’m french but i’ve been living in Spain for almost 15 years now. Thank you very much for all this good information and advises, that really helped me because now i’m working for Leapforce at home as Freelancer.
    I did pass the examen at the second try, the first time i did fail at the third part, but a week after they give me a second chance, so it was much easier to get it right. I’ve been working now for about 2 weeks and i really love it. When you start the job, you start with level 1, but if you practice in the simulator available in the platform, you can reach level 3 very easily and work up to 4 hours a day. Actually i’m in the level 3.
    Thank you again!!!!

      1. yes i’m still working, at the end of this month it gonna be my first year in Leapforce.

  42. I got an email yesterday saying I passed and asked me to complete the independent contractor documents.

    Then today I got an email saying:

    “Thank you for your interest in becoming a Leapforce At Home Agent. Unfortunately, we are unable to offer you a contract at this time. ”

    Any thoughts?

    1. Hi,

      It might be that Leapforce got enough raters (quota was reached) so they cant offer you a contract or you did not use mobile phone while completing the exam…

  43. Can I use the android emulator for the smart phone verification in the application process? Or if it does not work would my application be denied or just delayed?

    1. Hi,

      As far as I know, now Leapforce can detect the fact of using android emulator, thus in order to make successfull verification, you have to use a real smart phone.

  44. I got the exam link and study links (guide) today. I am nervous as this is a lot to soak in, but will do my best. I was very thrilled they extended me this work opportunity only after 6 days after sending in my initial application. I have always wanted to work from home (now that I am older) yet remain active in the workforce and contribute to family income. Hoping all goes well and that this will be a wonderful work experience.

    1. Took initial testing mid November…took too long to take the exam, therefore was sent an email later that evening letting me know I was no longer a candidate. However, today, I receive the 4th email from Lionbridge asking me to retake the exam. I’m really confused since they point blank tell you up front that if you do not pass tests the first time, you will no longer be considered. I have ignored the emails they have been sending me asking me to retake tests. So I am really confused because I really don’t think I would pass the exam at this point, even if I tried to take it again. I do need a part time gig from home, but just have bad vibes on this company. Another issue is the fact they pay via ‘wire transmittal’, thus my bank would charge a fee for this. Going to sit on this and rethink.

  45. If I am taking no breaks on the Theory part, do I then hit the Submit button to carry forward to next pages? It is kind of confusing as another message I saw earlier gives me the impression that between pages you still hit Submit/Quit Rating. Here is is day 3 and I have not taken the Theory part yet. Hopefully tonight I can tackle it. Thanks…

    1. If you feel that you need to take a break, press submit and stop rating. You should not leave open exam task for more that 2 hours otherwise it will get expired and it will be counted as a failed task.

      1. I took the exam just last night and I didn’t see any “submit and stop rating”, it was just like “next” to go to the next question. there was only 30 questions and not more as what’s previously mentioned. I also haven’t received any reply or notification if i passed or should retake even after many hours.

      2. Hi,

        Most likey you confused Nile/Truckee exam with Yukon project exam. Leapforce will get in touch with you regarding further actions provided your exam was done sucessfully.

      3. Hi Tim,

        Thanks for the reply! You are right, I’m taking the Truckee exam. Can you please tell me how long is the usual wait for them to get back at me? Also, are they going to send me an email whether I passed or failed the exam?

      4. Thanks Tim! I just got an email from them asking for additional details like my facebook and instagram accounts. I do have a question, would it be alright for me to give them a new instagram account I created for this application? I created an instagram account before (way way before!) but I never really used it as I’m more of an fb person. I’ve already forgotten my username and password. Do you think this would be an issue? Thanks again!

  46. Hi Tim,

    Do you know what may be the reason why I got this email:

    “Thank you for your interest in becoming a Leapforce At Home Agent. Unfortunately, we are unable to offer you a contract at this time. We will keep your qualification information on file, should other opportunities become available.”

    right after I submitted all required documents including tax requirements and was already qualified for a project? I feel very disappointed.

    Thanks!
    Roger

    1. Hi,

      It might be that Leapforce got enough raters (quota was reached) so they can’t offer you a contract this time. Actual reason for their desicion not to offer a contact after succefull qualification is unknown and they will never tell you about it.

  47. Hi Tim,

    I am going to take the exam for Lionbridge. Do I have to study all the guidelines for taking the first part of the exam or Can I only study the “Part 1” and If I pass the first stage continue reading the rest of the guidelines? Thanks for your help.

    1. Hi Elena,

      Yes, you need to study the whole guidelines because part 1 includes questions which cover all theoretical aspects. In this part of the exam you will be assessed on how well you understand the theoretical part of rating concepts, as well as on your ability to interpret questions and search for information in the General Guidelines.

  48. Hi Tim, thank you for your answer. I passed the first exam but I failed the second one, I really need to pass all their exams, Do you have more specifics tips or something that could help me? I have another opportunity to take the exams so I really need to pass them. Even if I studied a lot, it is clear that in the the second exam I couldn’t apply all the “knowledge”. Do
    you have some tips or advice? Thanks again!!

  49. Hi Tim,

    Greetings from India!!
    2 weeks earlier i applied for search Engine evaluator at Leapforce as well as social media assessor at Lionbridge.
    Fortunately both replied and they consider me as an eligible candidate.
    Is it possible for me to give exams for both of these companies?
    also if i pass in both, will i be able to work for them simultaneously?
    Kind regards.

    1. Hi Shivam,

      You may apply for the same project at Leapforce as well as at Lionbridge, but once you get an invitatation for exam you have to choose only one company to proceed further.
      According to Leapforce and Lionbridge policy, one account is allowed per one person/IP address/household.
      Leapforce and Lionbridge can find duplicate accounts very fast, and as a result, you will lose both accounts.

  50. I live in a tiny rural town that has excellent wireless internet but a harsh winter day can be a problem. During LeapForce Part II, my internet connection crashed, and I do have proof of the ridiculous snow/wind we are getting, despite it being March. I have yet to return to the exam today but it will be interesting to see if after all my work studying, I have failed because of the internet crash. I hope not but even so, this is a great study for anyone who builds and markets websites. I had read the leaked guidelines moons ago but never with this diligence.

  51. I was told by LeapForce *not* to use the “submit/cancel” button to take a break on Part 1, even if all questions on the page were answered. They were emphatic. Tim said it could be used to take a break. I also read that elsewhere. I tried it. I had completed all questions for the exam page displaying on the screen. It worked. So do trust Tim. In fact, it worked for a break that lasted all night. On the other hand, my snow storm weather internet crash occurred when exam 2, page one was open and incomplete. that was yesterday. Exam is due at 24:00 today. We’ll see if that causes a fail when page is incomplete. I suspect it will but we shall see. Internet is now restored but the restore occurred today — a day later.

  52. Hi friends

    I am from India.
    I applied for Lionbridge (Search evaluator), Appen (search and social media evaluator) as well as in Leapforce (Search evaluator). I got reply from Appen (social media evaluator) first then from Lionbridge but it’s been 3 months no reply from Leapforce. Lionbridge asked me whether I have given any exam of Appen or Leapforce. So I told them that I have given exam of Appen for social media evaluator and waiting for reply. Lionbridge send me a mail telling unsuccessful application and that I can’t work for them. This is bad because all I did being honest to them. They didn’t even warned me just rejected my application. I do want to work as Search evaluator for any of above company. I don’t like working as social media evaluator. Please tell me what I can do so I can work as search evaluator.

    Thanks.

    1. Hi,

      Try to apply for Leapforce (search engine evalutor), but it might take some time to hear back from them. Be patient and good luck!

  53. Confused about how long a break one can take. Tim wrote: “You don’t need to finish this part at once. If you want, you can take a rest. The tasks are still available when you sign in.” and “You should not leave open exam task for more that 2 hours otherwise it will get expired.”

    Am I, thus, correct in understanding:

    1. Regardless of which Exam Part (1, 2, or 3), if you start an Exam task, you must submit it within two hours or you will be failed.

    2. You cannot take a break during a task. Complete and then submit/cancel if you want to take a break. But complete the entire page of questions — not just a few of the questions.

    3. Part 1 had six screen pages of questions (or six tasks, however you want to say it). Each screen (or task) has multiple questions on it, each with multiple answers to select from. You have a total of 12 hours to complete all of the questions for Part 1. Is that also true for Part 2 and Part 3?

    All I can get from Leapforce is “You have seven days to complete all parts of the exam”

    1. A few clarifications to your comments above:

      1. Once you open the task you have to complete it within 2 hours otherwise it gets expired and it will not be counted towards a total score.
      2. You are right, you have to complete the whole task before you can press ‘submit and stop rating’. Only in this case you will be able to resume your exam later on.
      3. You have 7 days to complete all 3 parts of the exam, no limitations in terms of hours to spend on each part.

      1. Thank you, Tim. I sincerely appreciate your helpful and speedy replies. I do want to share that I asked this question of support @ leapforce and what an experience! The first time I sent the question to them, the reply was “You have seven days to take the exam.” I reworded the same questions and resent. I rec’d a reply that said “Each part has a set time limit.” That was all. I worked on my wording and resent it a third time. I received a reply saying that they did not know what I meant by an expiration of a task and that the exam could be done in seven days. I wrote again, this time saying that I was feeling frustrated at the to-fro. The reply I received, “Why is it so hard to understand that the test can be done in seven days. And why are you being rude to a potential employer?” All I truly said was that I was frustrated with the to-fro and wished that I could have a clear answer to a carefully worded question. It was also interesting to me — although I did not say it — that they used the word “employer.” Independent contractors are legally classified as businesses. There is not an employer/employee relationship. You have a relationship with a contractor, not an employer. On the other hand, I have to wonder about Leapforce’s relationship with subcontractors as my read of so much online leads me to conclude that they are violating the Independent Contractor laws. I wonder if anyone has questioned that behavior. Again, thank you. Your business-like behavior is admirable.

      2. I have a confusion. Lionbridge send me exam invitation mail on 17 may. The due date said in the mail is within 7 days of the email received i have to complete all the 3 parts. After 12 hours i received another email invitation stating i have 10 days to complete the whole parts of the exam specifying due date 27 may with time. Which one is my due date. I got internet accessor agent profile.

  54. Hi Tim,
    I was taking a look at your information about Leapforce and the exam. I recently applied, and failed on exam 3. If you would be so kind to answer a couple quick questions for me I would greatly appreciate it. I’m not sure if I’ll bother with trying to retake it with how much time I’ve already invested.

    1) One major concern I had in the first place is allotted task time. There’s a lot of information about how Leapforce pays, and it’s pretty clear. My question is, are their estimates for task times fair? For example, how much time would they give for one task from exam 3? It took me 30min-1hr for each of those 7 tasks. I’m sure with practice I would get faster, but in order to reasonable research each LP, it takes time.

    2) I was very careful to leave thorough comments for each result block, and I wonder if too long of comments could be what failed me? Also, in regard to comments is it okay to copy and paste if justification would be the same for both? For example, query for a specific school’s girls’ volleyball team’ Twitter page. Multiple results come up with a different school’s girls’ volleyball team Twitter page. Would copy and pasting of those comments be acceptable/appropriate? I didn’t count them as dupes because they were different school’s, should they have been dupes? Finally, in that situation I rated FailsM+, except for a page belonging geographically close to the queried school, I rated SM as both were local to user, does that sound appropriate?

    3) On the subject of dupes, query was for a pizza place. Would all results for other incorrect pizza places be considered dupes if they have different names/locations? I didn’t label them as dupes.

    4) Finally, more of a curiosity question about rating…If a user searches for restaurants nearby, and SCRB comes up with a couple options, but all are known to be terrible restaurants with poor reviews…but that is all that is near the user…Would that be a high needs met or low? Haha.

    Allen, thanks for your time and helping me to decide if I should retake the exam. Your site had a lot of helpful information, and would be high PQ for this user! Take care!

  55. Hiya Tim,
    At first I was doubtful signing up at Leapforce, because I first signed up on Lionbridge and they kinda declined me just because I have don’t have a android phone(which bummed me out
    because when i first emailed and inquired about the job they said an Iphone 4s/higher will do.)

    Then I tried looking up for other similar opportunities and found Leapforce. As I researched about the exam and company for reviews, I found most are negative and most have failed. But I still tried anyway because I really need the income.
    I just passed all 3 first try. And I was even doubtful that i would and was unsure how i did, but I did anyway. So i think i at least am on the right mind-track. I didn’t even “fully study” for it.(im the type if i cram more, the more i couldnt remember) I went over the guidelines at least two full times.
    I guess the people who posted bad reviews and comment about the work and exam are the ones that slacked off, didn’t really put time and effort in it, or really are not just cut out for it.

    I’ve received an email for needing my signature for a document(Terms and Agreement) and answered some optional question(age, gender), my documents are being reviewed and then they will finalize my registration.
    Last I saw of the workload available for the project, it was something like “extreme” (i forgot the exact term, but it was definitely something that means “alot”)
    My question is, do you think/know if there is any chance they would reject my application at this point? I’ve seen some comments that even after passing all 3 exams and additional documents they get a note stating “we are sorry, we have no available projects for you…….. something something,
    At this point after reading your posts, I’d believe your word more than other source in the net.

    Thanks for your time,
    And oh, yes, I’m as nervous as a chihuahua all the time. Like when i didn’t get an email on the hour of the deadline, i was beating myself up cause i screwed up somehow.

  56. Hi, I applied for this Social media internet assessor job with Leapforce yesterday. Today I got the mail saying that I was selected to proceed for the Qualification process.
    they gave a link and asked me to review and sign the necessary documents. I clicked the link and quickly I agreed everything
    immediately I got an email thanking me for completing the required documents. asking me choose project to qualify for. then I got an email saying that based on the business opportunities and my submitted information, I may be invited to continue for the qualification process.

    now I got confused. what does all these mean. wont I receive any study materials and test process?

    also I applied for Lionbridge and appen , is Lionbridge and leapforce are one and the same ?

    any help will be much appreciated as I am confused really.
    thank you

    1. How long does take to hear back from Lionbridge/Leapforce/Appen?

      It depends on many factors, sometimes immediately, and sometimes it can take 3-4 months.

      It might be that at the moment of your application submission, quota of raters for your country was reached and therefore Leapforce or Lionbridge does not hire new rater at the moment. As soon as they fire unsuccessful raters, they continue hiring new people to maintain the required number of raters in your country.

      It could be that your CV does not meet Lionbridge standards. Lionbridge is very selective in terms of quality of CV’s of applicants in India and other developing countries. So it’s very important to Make sure that you CV looks professional and accurate and there are no gaps in your experience.

      Your IP address might be suspicious or does not meet Lionbridge requirement. If you have dynamic IP address (IP which changes each time you go for Internet) – you will be rejected for sure. Make sure that you have static IP address (this is valid only for Lionbridge).

      Someone uses the same IP address for rating project (in case of sharing Internet network), make sure that your IP address is unique.

  57. Hi Tim,

    Thanks for your info. I just got ‘Exam Info’ from lionbridge saying i will be given Exam portal and access th Exam on 24th. the attachment in this email only has 2 pages with same content with the email. I wonder the Exam guideline will be a seperate PDF file (missing attachment?) or its the same date 24th, when they give me the Exam Portal, then I can read the Exam Guideline?

    7 days will include reading guideline and the Exam?

    thank so much & look forward to hearing from you

    Helen

    1. Hi Helen,

      Candidates are given 7 days to study and complete the exam, thus I recommend you to proceed with studying materials immediately up on receiving the General Guidelines.

  58. Hi,

    I failed the first exam. After reading the article above, I know what I did wrong. At the third part of the exam, I marked “didn’t load” on some LP, which is (I believe) have high ETA, It’s CVS, this site only allows US IP address.

    I got a chance to retake the exam next Monday. will be a problem if I’m using VPN while taking the exam?

    Thank you.

    1. Hello,
      I do not recommend you to use VPN while doing the qualification exam, because technically it will be violation of Leapforce/Lionbridge policy.
      However you may use VPN only on your mobile to visit links (US websites) which are prohibited to visit from non US locations.

  59. Hey i have applied for social media assesor at lionBridge. The mail came in today regarding the test but they have sent a link to learning website in which first link says page not available for tutorial videos.
    Second page i watched all the slides and there is small mock test. But i dnt know on what basis am i supposed to give that mock test as i dnt have general guidelines as they have told they will send me the link to test soon. And what about the first link what to do about it?? reply asap test is from 28 june

  60. Hi Tim,

    I took leapforce Yukon qualification exam and passed it. And then I got email about contract agreement. Then I log in to leapforce and signed digitally and then submitted. After that I got a mail saying, we have received your documents and after review we will finalize registration. And the same message is showing in leapforce status when I log in to leapforce.

    Not, it’s been 3 week and I did not get any email or response from their side regarding my contract. Now I am concerned and contact them through their email but no response. Have anybody experienced the same situation. Please provide your views on this matter.

    Thanks

    1. This case was discussed a few month ago, nobody knows why they do not respond but it might have do with the fact that quota of raters in your locale has been reached.

    2. Hi samir, I have the same situation and i contact them, they said “your account is in the verification process” and yaap.. they said high of volume applicants in my locale.

      But.. how about you? Have you worked for them?

  61. Dear blogger, 3 days ago lionbridge has put me on review. This is the second time I am under a quality review after a year, Do they explain why I am under a quality review? Do you know what how much chances I have to survive this review? Lionbridge is the only source of income for me right now and I am really scared 🙁

    1. Do not worry, it is a standard procedure in case Lionbridge quality team finds any quality issues. You should wait for an email from them and follow instructions. Most likely you will be assigned elearning educational course.

  62. Hi Tim,

    First of all I would like to thank you for this incredibly great and informative blog and for all the time and effort you are taking to answer so many questions!!! I highly appreciate this!!!

    Regarding the qualification exam (Yukon project) I have a question about getting localised search results.
    I live in Germany and will be rating the tasks from Germany at my user location.
    Now my question is this: the exam tasks have the user locations in the US, I rate the queries from my local chrome browser and my local google search engine (mobile and desktop).
    I will not get the same google search results as a locale US user. Any idea what to do about this problem? Is this a problem at all?
    And after I send the various task links to my device, am I expected to only use the device for the research necessary to come to a conclusion for my rating?
    This is my 2nd attempt, I failed the 3rd part in my first exam.

    I am very much looking forward to getting your thoughts on this.
    Thank you!

    1. Hi Anna,

      While doing the qualification exam (part 3 in particular) you have to rate results from the perspective of US user and user location.

  63. Dear Tim,it was so useful reading your post.
    I wish i could read it before my exam 🙁 anyway I finished part 3 exam but haven’t heard anything from them yet (already 32 hours from exam due date) . I just would like to know whether they perform as what they mentioned in the email or I should not take it seriously.
    Your kind answer will be appreciated 🙂
    Thank you

    1. Hey
      It looks like this position is new and it is available only in India. If you manage to join this project please share your experience!

  64. Hi, I did not pass the third part of the Leapforce exam.
    In this blog you say give a second chance, but I do not understand when ??
    They said “We would like to remind you to shred all instructional materials you might have downloaded and printed from our site”

    Shred all instructional material? Should I supposedly have a second chance because I was going to “shred the instructions”?

    Thanks

    1. hi,

      Standard fail notification email from Leapforce sounds like this:

      “We would like to remind you to shred all instructional materials you might have downloaded and printed from our site. You may have the one-time option to retake the qualification exam. Please check your Gmail address for additional information”

      It says: You may have the one-time option to retake the qualification exam.

      Normally invitation for exam retake is sent on exam due date+1-2 days, if not try to contact them and ask for retake directly

  65. Hi! This site is very helpful! Thank you!
    I failed part 3 but have been given a second chance. I just passed part 1 and 2 again but I’m hesitant to try part 3 again. I’m so nervous! I keep thinking back to the queries and pages the first time I tried so that I can figure out what I did wrong. There are 2 queries that I have questions about. Can I ask your opinion? I think the most confusing aspect is taking reputation into account. One of the queries was for shoes and 3 of the landing pages were well-known shoe stores… however, though the mobile pages were great and worked well for online shopping, the site and company had some bad customer reviews regarding shipping and customer service. If the site is popular and well known with great MC, but has some bad customer reviews, how much does that affect the EAT and Needs Met? The other query was illness symptoms.. since both of these are YMYL, then I think I may have been rating too harshly. I should point out that I got timed out of one query question, which I think accounts for 8 missed questions. So hopefully that was my problem the first time. Definitely won’t let that happen again!! If you can’t answer my questions, it’s okay. Thank you anyway 🙂

  66. Hi Tim,

    I was invited for Exam. But on the exam schedule date. I received this email. What does it mean.

    “We thank you for applying for a Work from Home position with Lionbridge.
    We regret to inform you that we can no longer proceed with your application on this occasion.

    Following a recent review on IP checks the customer has not permitted entry into
    exam at this time.

    Thank you for your time and interest shown in this position and we wish you every
    success in your future endeavors.”

  67. Hi Tim,
    For one person per household. Does this mean we cannot use the same postal address, also?

  68. Hello, I’m on the second attempt to take the exam.

    They give you a margin of 7 days to take the exam, but my question is: Can you do the 3 parts on different days? For example; Part 1 on Monday, Part 2 on Wednesday and Part 3 on Friday?

    Is this possible? Or once you start you must complete it in one day??

    Tranks!

  69. Hi I applied for Leapforce exam first and I entered my details they rejected me I haven’t written any exam when I applied for them.I got a message saying we don’t hire candidates now please try later and after that I deleted Leapforce Account.After 1 month of that I applied in Lionbridge with same IP Address and E-mail id and same mobile phone I told them I never applied in Leapforce before.I got selected to take the exam.I got a mail yesterday to confirm from me to take the exam.After taking exam do they come to know that I applied in leapforce before and they reject me.or should I tell them now that I applied in leapforceleapforcef I tell them they will reject me now.I am in dilemma what to do now??Am in need of this job now?
    Please help me out in this issue
    Please give me reply fastly as I don’t have much time

    1. Another important note is that if you have worked previously on other social media projects with different companies, don’t mention this on your CV/resume. The two most important factors about this are that you do not need previous experience for these jobs. And second, if you have worked on these types of projects before you will most certainly be looked over and turned down for similar projects. The reason for this is uncertain, but we have seen other people turned down because of this. Thus you should never indicate and/or tell your vendor that you have applied for the same project at a different vendor. Once you are invited to participate in the exam you should proceed further only with one vendor.

  70. Hi, I do not understand anything.

    Leapforce is supposed to give you two opportunities to take the exams, sometimes even 3 opportunities.

    My case:
    -The first opportunity I approved part 1 and 2. Part 3 failed.
    -The second chance only approved part 1. Part 2 failed.
    -The third opportunity I approved part 1 and 2. Part 3 failed.

    They give me another chance. Does anyone explain this to me?

    I am grateful for this, but at the same time very discouraged, I have tried 3 times, I have put all my effort and knowledge and still failed. I do not want to continue trying this, although I will do this to take advantage of this opportunity.

    I knew they could give you up to 3 opportunities, but 4?

    If anyone knows why they give so many opportunities to explain it to me.

    Thank you.

  71. Hi Tim,

    I just past the part 1&2 but failed on part 3 for leapforce Yukon exam yesterday. I am quite confused what the difference between results on left side and on right side, especially when most of them are same. And I also would like to know if I can say “duplicate” if some results on one side are the same with some on the other side.

    Could you please give me some ideas before there may be a 2nd chance for me to retake it? Thanks a lot.

  72. hai tim,
    I applied for leapforce one month back.Till now i dont even receive any feedback mail.how much time they will take to consider/give back for my account .please tell me.
    thank you

  73. HI Tim
    Maybe you know the answer for my question regarding the lionbridge exam part 1
    whether the 2 hour limit is for all of part 1 (32 questions) or rather for each separate page of questions.

    Thanks

    1. As far as I know, in part 1 there is no limit in terms of how much time the page can be opened before submission, even if it gets exparied after 2 hours of inactivity, it will become available once you decide to resume part 1.

  74. Hi tim

    In the lionbridge exam part 1 the multiple choice questions:
    whether the 2 hour limit is for all of part 1 (32 questions) or rather for each separate page of questions.

  75. after writing the exam of falcon ads Project in appen how much time they take to give my results it’s been 4 days already i have taken the quiz in appen if i don’t pass in the exam they don’t send me the mail that means i should understand that i am failed in exam?

  76. “What they want is for you to represent a typical user in your country.” Are there several general guidelines with different rules according to the country? For example: a french one, a japanese one, a spanish one…

  77. Frustrated.
    I believe there was a server problem when I attempted to take
    part two of the exam (The Page Quality Exam) last night.
    I attempted to began the exam and was given a true/false question
    asking about explicit queries. I answered it, and hit submit.
    Then I got the message stating that there are no more tasks.
    I never saw any of the 7 questions pertaining to Page Quality Tasks.
    Then, I received an email telling me that I failed the exam.

    I’ve emailed Lionbridge at three different addresses concerning the issue hoping to hear back quickly,
    since of course, I’m running out of time. Considering this happened on a Friday night, I’m now concerned that I may not hear back until Monday. What else can I do?? Any suggestions? Thanks.

    1. I was wrong. Not a server problem. I messed up and did not answer the last question on part one. I missed it completely. Then when I went in a day or two later to take part 2 of the exam, that last question came up. I thought it was strange that it did not look like the type of question I was expecting, but I went ahead and answered it, thinking I could move on to the rest of part two, but because that was the last question of part one, the exam ended there for me and I got the email stating that I had failed. It only just occurred to me today that maybe the reason I failed was because I took too long on part one. I’m hoping that’s the reason, anyway!

      They are giving me another chance, so back to studying I go!….

      1. Tim Allen, Thank you for this post. It’s been most helpful. I’ve passed both the first and second parts of the exam thus far, and this post helped me prepare. Wish me luck on the final part! =)

      2. You are welcome! I am glad that you found my blog helpful, and I wish you success with going through the final part of the exam!

  78. Hi Tim,

    Thank you for your great website. I have a question about queries for test 3. Are we supposed to assume queries are recent, or are they based on the date Google created the test? Let’s say the task query is “Veteran’s Day 2013” and you’re taking the test in 2017. Are you supposed to assume someone in 2017 is wanting to know what day Veteran’s Day was in 2013, or are you supposed to assume Google created this test example in 2013 and the user was searching for current/upcoming information.

    Another thing I’ve noticed while going through the 2nd and 3rd tests that’s frustrating is Google is having you rate LIVE websites that it has no control over. What if a website was up and functioning when Google added it to the test, but on the day you’re taking the test, the site is down. Now you have a situation where Google is expecting you to rate a website that’s up and running, but you can’t do that because the site is down. Sure you could use the Way Back Machine to see how the site used to look, but then you question yourself, is the site supposed to be down and I should rank it that way, or are you supposed to assume it’s gone down since being added to the exam and you should rate it like it was still up.

    It’s frustrating to think I could invest so much effort and something as simple as a website not being up when I take the test could destroy my chances at getting a job. Since Google doesn’t own all the sites we’re being asked to rate, they can’t make any guarantees.

    Thanks.

  79. all queries with a user location have both local and non local intent?? is this true or false cus i didnt get what non local intent means exactly thank you

  80. Hi Tim, thanks for your thorough information, its really helpful. I failed part three, and want to try my second attempt. In part 3, the YouTube video was empty with caption ‘cannot find video’ and I rated failsM. Was it because my country? What should I do if I face it again? Because I don’t know the content of the video, how should I rate it?

    1. Hello,

      You cannot do anything about this fact (Youtube video has no content), you should rate this result as it is.

      1. I failed my retake exam this second time and they give me another chance! Why part three was so hard? I don’t know where I did it wrong. Query ‘Britney Spears image’ results in Britney Spears website but they don’t have some sort of gallery, and I rated MM… Right?

  81. Hi,
    Thank you for this very helpful post. I had passed the exam in one shot by carefully referring the guidelines and reading the tips from this post!

    Cheers!

  82. So I know this post is older but I just got done taking Part 2 of the test. Just thought I would let anyone know I used this website to a “T” when taking the first part so I decided to use the recommendations for the 2nd part also. This is where I would like to add that most of the PQ for my second part were considered “Deceptive”. Which freaked me out to no end when I didn’t see that on this page. Especially since the PQ rating tool looked exactly like the example provided here. But I did get the email saying I passed part 2! So don’t freak out if you have to rate 3-4 “misleading, deceptive, ect”.

  83. I find reputation research a hard nut to crack. I don’t get any results researching certain websites. I am not sure what to answer then.

    1. While giving E-T-A rating you should evaluate MC under these 3 criteria: expertise, trust and authority. In most cases you may do it fast at a first glance approach, but be sure to provide good evaluation for E-T-A when you have YMYL website/page, in this case it is important to research reputation of a website/business.

  84. Hi Tim,

    I am wandering what is the longest anyone has ever worked for Lionbridge or Leapforce as a rater. Has anyone ever worked for more than 3 years? If you continue to meet their monthly scores, will you be able to work forever or till the project ends?

    Thanks.

    1. I know people who have been working as search engine evaluator for more than 5 years.

  85. This reminds me when I was asking my lawyer about my divorce ,all I could hear was him using words that made or make no sence to me ,but Once he said how much it could cost me or would cost me,that when my ears open wide and mighty.Now i reading about the test , part a,but part c might be part j ….Realty Sorry about my WTF, but I guess when making money it all comes now to is keeping your ears and mind wide and mighty open.

  86. I finished the Theoretical exam and as I was closing my laptop accidently clicked the button on the main page which launched the exam from scratch again. There is a button that says report a problem/ release this task but it also says in the email they sent – if you release one Send to Device task with 8 unique result blocks, it will be counted as missing 8 questions. DO NOT RELEASE EXAM TASKS. So I am unsure of what to do. It seems like a bad design that that is even allowed to happen.

  87. Is it possible for me to get another chance for Yukon qualifications after failings for more than two times attempts?

    1. The only advice I can give you is to write an email to Leapforce and ask about the third attempt.

  88. Hi Tim,
    I just cleared first two part of exam and going to appear for the third one. I have a different query, if I got selected for the project is it necessary to join immediately. My problem is I am going out of country on vacation for one month; which is already planned before applying for the evaluator job in Leapforce. Do they consider my request to take me on project after a month.
    Please reply I am really worried. I need this job.

    1. As far as I know there is an option called ‘my black out period’ which is available on the project portal, you may select the dates of your unavailability.

  89. Hi Tim,

    I have finished the three parts of the exam on Leapforce. My exam due date was on Apr 13, 2018 12:00 AM PDT, but I have not yet received the result of the third part. How soon they send the result.

    Thank you,
    Michelle Rodrigues

  90. I was schedule to take exam on 25th Apr but on 24th I received an Email from Lionbridge “Unfortunately we were unable to enter you in to exam as we are currently experiencing technical issues with the exam; We are looking into the problem at present an we will get beck to you as soon as possible”
    Dear Tim is this a legit reason or just an excuse to denied me into exam?

    1. I may assume that this explanation is a true reason, because based on my experience if Lionbridge does not want to proceed with a candidate to the next step they send another kind of email. Lionbridge Unsuccessful Application

  91. Hi, I was called to quality map analyst on the lion bridge. I have already signed the contract and must receive the material for the test in a few days. Do you have any tips on what is most important for me to study?
    I’m from Brazil and my intention is to study the material is Portuguese, I speak English but studying for my language is easier, do you think it can work?

  92. Hi.. regarding pre-learning practice portal (Lionbridge) I see only theory exam quiz, where can I find practice questions for PQ and needs met questions? thanks!

  93. Dear Tim I failed the 3rd part of the exam and I am still waiting for the LB to allow me to retake the exam but didn’t got invitation yet. How much time usually LB takes to offer someone a retake?

  94. I used VPN and I forgot to turn off while I was doing my exam part 1
    What will happen in this case😢?

    1. It is very tricky to use VPN for all these projects (what is the purpose of using VPN in your case?) because sooner or later VPN will go off and your real IP address will be recorder by the system.

  95. hello Tim, my first try on the theory exam of lb, after answering all questions, I click submit but it’s not responding, I also try clicking on ‘Submit and Stop Rating’, nothing happens. The site later went down without me submitting the exam; please what is my faith now? Will I be allowed to retake the exam? And why I am not able to access the site?

    1. Hello, I have no idea about the reason of your issue, probably it has to do with server error. I do not work at Lionbridge, thus I cannot predict their decision about your case.

  96. Excellent information on this blog! Great work you’ve done here Tim. Followed the instructions and passed the LB exams on the first seating. Bookmarked your blog for future reference and further reading. Thanks.

  97. Hi Tim,

    I failed the exam at second part in first attempt. They then invited me to take another attempt and I cleared first two parts and completed third part as well. I never heard back the final result and then after a week they sent me an email to attempt for third time. What’s the reason? Why are they asking me to attempt for third time while their policy is to give two chances? Why didn’t they inform me of the final result? I am really confused. Please help.

    1. I cannot help you in this situation I have no influence on the process, my recommendation is to use the third chance and finally crack the exam! Wish you good luck!

      1. Hi Tim,

        Thank you for the reply. I understand and am sorry for acting desperate. I am now preparing for the exam and have a couple of questions if you could help me out.

        1- In part III there are two sides of search results. Out of 7, at least 3 or 4 have special blocks on top of both sides which provides clear information. For example, a query of “distance from Mississippi to Florida”. Can I mark results of both blocks as duplicates? I know for a fact that one side is from Google and the other side of results is from Bing. It is wise to mark them as duplicates? In my last exam, I marked a couple as duplicates but then didn’t mark other two since those were a little different.

        2- Can I mark duplicates on same side? In one question, I marked two results on same side as duplicates because they the data was almost identical. HOwever, the website were different. It was for a search result of “xmas wreath ideas”.

        3- Is it possible that for a search query there won’t be any FullyM or HighlyM search result?

        Thank you for your help. I know I’m asking a lot but if you or anyone who has passed the exam can help me out would be great. I live in Pakistan and $9/hr matters a lot. Two hours daily on this rate and I’ll be earning as much as I earn from my day job with 8/hrs, six days a week. 🙂

  98. Hello! I passed part 1 for Leapforce and received email with access to part 2 and part 3. At first part 3 wasn’t available, but in the middle of performing part 2 I noticed I got access to part 3. I received no more emails from them. What could that mean?

    1. Hello, the process changed a few months ago now after passing part 1, candidates are allowed to proceed with part 2 and part 3 immediately, the overall results are sent on exam due date.

  99. Hello,
    I am search engine evaluator in Leapforce but i want to join Lionbridge, if i say to lionbridge that i will quit Leapforce if Lionbridge give me a chance to work with them,then will it be appropriate? or I should not disclose that i am working in Leapforce and after passing Lionbridge exam i will quit Leapforce.

      • Hello, in order to give you an advise on your question, could you specify what Leapforce project are currently work in? and what project are you going to apply at Lionbridge?

      1. Hello,
        In Leapforce i m working in yukon project and in Lionbridge i applied in personalized internet assessor.But i did not disclose that i am currently working in Leapforce yukon project.I thought that after passing recruitment exam i will quit Leapforce. will Lionbridge know that I am working in leapforce?what should i do now if Lionbridge give me chance to appear in exam? is there any risk?

      2. This will not work due to this issue: Leapforce IP change/Network sharing

        In some cases people may share their Internet network, while working as search engine evaluator make sure that you have your personal unique IP address and no one uses the same IP to go online for rating project.Once you are in the Project, you may change your IP address many times, it will not affect your project status. Make sure that you do your project tasks in a private place as it stated in the contract.

      3. Multi-accounts

        Be informed that it is prohibited to have multiple accounts, without special arrangement. Leapforce and Lionbridge can find duplicate accounts very fast, and as a result, you will lose both accounts.

  100. if i give lionbridge recruitment exam with another IP address then can they find ? but i have not changed my name.should i use another mobile for exam?

      1. Thank you. If i apply to Lionbridge after quitting leapforce then will Lionbridge allow me to join?

      2. Yes this should work, but why do you want to quit Leapforce Yukon?

  101. because Lionbridge is better than Leapforce. Leapforce pay rate is less in India. and Leapforce is acquired by appen and some raters say that appen can decrease pay rate.is it true?

    1. Yes I confirm this information, Leapforce decreased pay rates in many markets including India, Indonesia, Brazil and Russia.

Leave a Reply