Common issues of new raters (Yukon Raterlabs/Leapforce and Lionbridge Google Rating Projects)

In this post I will discuss some common issues that new raters face. If you have other issues, feel free to share by leaving a comment below.

What kind of tasks to expect while providing search engine evaluation service for Leapforce/Lionbridge? Rater Tasks Review

If you get a position as a Search Engine Rater with Leapforce or lionbridge (Internet Assessor), you may encounter many different tasks. Some of these tasks are your normal rating tasks, and some are side by side, and you may even run into experimental tasks. This article was written to explain the different tasks that you’ll face as a rater. Before I go on, I should note that not all these tasks will be available at one time. All tasks are given out and are on a first-come first-served basis.

Some of the tasks are easier than others, like experimental tasks. Each task has a different set of instructions, so it’s best to make sure you know exactly what you are doing, and read very carefully each of the task instructions.

Side By Side

Side by Side rating tasks are very interesting and have everything to do with Google algorithm changes. The human role or ‘rating’ in Side By Side tasks is to determine which side, left or right, is better than the other. In this task you are shown blocks on the left and right side. Each block has a slider from Fails to Meet to Fully Meets, and you should choose which one is best for each block depending on the user intent and query. The same guidelines apply for the blocks as they would for a page rating. Meaning that if block meets user intent, it should get the appropriate rating. Once you have chosen the ratings for each block, you will then be asked to choose on a scale which side is better than the other. A comment may be required to give your own opinion on why you’ve chosen which side, and why it is the best over the other side. It’s very important that you base all your ratings on user intent and taking their location in mind. You will also have a quality review on Side by Side tasks  almost each month.

Page Quality

This is the main rating task that a rater is hired to rate. You will be given a website URL along with the first 5 questions which check things like Foreign Language, which if you’re doing English/USA ratings, would need to be in English to be understood from your location. Pages that don’t load need to be checked, as well as flagging for porn.

The second question is asking you to describe the purpose of the page. The purpose of the page and the user intent are entirely different aspects. Make sure you’re checking the website out to see if it matches user intent, and by looking at the website, you should be able to understand what its main purpose is. If the page is malicious, harmful, or just lacks its purpose for what it is searched for, then you should mark that here. Pages that are simply existing to show ads, without any help to the user, should be flagged. And lastly, it is important to make sure that you understand if the page is a YMYL (Your money or your life) webpage. Understanding this is important because it will change the overall rating of the website.

Once you have completed this, you will then rate the different aspects of the page including its Main Content Quality, and the amount of content. Expertise, Authority, and Trustworthiness, who is responsible for the website, the supplementary content, page design, layout, and website care and maintenance are all graded on a scale from lowest to highest. The last thing to do is to give the website its overall rating. Usually these types of tasks are allowed 9 minutes to complete. A quality review is done each month to see how you rate. So it’s important to make sure that you are taking the time to evaluate each website properly.

Needs Met

This type of tasks you have already saw while doing part 3 of the qualification exam. Each task contains 8-12 result blocks. In each task you will be given a certain query, and a list of search results blocks with links where you have to give a usefulness rating to search results using a scale from “Fails to Meet” to “Fully Meets”

Experimental

Sometimes during rating of Side by Side, you will see Experimental tasks pop up. In most cases Experemental tasks are standard Page quality or Need Met tasks, but sometimes you will get new types of tasks. Experimental tasks have a wide range of instructions. It’s important to read the instructions for each task as they will be different each time. Experimental tasks can be very simple, or take a few minutes to complete. They are not always available, and each task can be completely different than the other.

Quality of your service

New raters do live tasks immediately after getting access to the task portal. It is highly advised that you hold off on these if you do not want to be restricted for quality in the next month. Typically tasks which are available for new raters are quality tasks on which raters are accessed for their quality. Instead, new agents should focus on doing simulation tasks and self-education. Time spent doing this will really pay off, and you wont be restricted for quality in the future. Also, by doing a certain number of simulation tasks correctly you will upgrade your status in the system, and will be allowed to work more hours.

During your participation in the project your service will be evaluated on quality by means of quality review tasks.In the beginning of each month, a certain number of tasks are uploaded into the system. These tasks are quality performance tasks up on which your quality is measured each month,in the end of the month you will get your quality score feedback.

If your ratings often falls out of general range of ratings provided by another raters in the project, most likely your account will be flagged by the system automatically and your work will be checked for quality manually.

Read more about this topic here:

How to Stay with Leapforce For a Long Time and not get fired?

Time Management and the Leapforce Extension

Time management of the work you complete can become a problem if you aren’t managing how much time you are spending on tasks. You should not sacrifice quality for time. In the beginning you may spend more time than the average estimated time that Leapforce allocates to the task, but make sure that in the invoice you put average estimated time that they give you. If you spend less time than average estimated time per task or set of tasks, be informed that your invoice will be returned for correction, Leapforce will ask you to put actual time spent, that is why there is no sense to complete tasks faster than average estimated time. Take your time, do everything correctly and watch your time.

Do not forget to log on to the Leapforce extension each time you work in the system.

According to the Leapforce policy: any time spent logging on/off, reading, studying, and break times are not billable. Any tasks that are not submitted or are released are also not billable. Please make sure you are not including any of this time on your invoice.

Also please keep in mind that consecutive invoices submitted with productivity below 100% may result in removal from the project or you may lose your contract with Leapforce.

Multi-accounts

Be informed that it is prohibited to have multiple accounts, without special arrangement. Leapforce and Lionbridge can find duplicate accounts very fast, and as a result, you will lose both accounts.

Leapforce IP change/Network sharing

In some cases people may share their Internet network, while working as search engine evaluator make sure that you have your personal unique IP address and no one uses the same IP to go online for rating project.Once you are in the Project, you may change your IP address many times, it will not affect your project status. Make sure that you do your project tasks in a private place as it stated in the contract.

Non-completion of a minimum required number of tasks

This issue is very common among new Leapforce agents and may lead to termination of your contract, and happens when new agents show no activity in the first month of their service. In particular this can happen if new agents enter the project in the second half of month, and for whatever reasons, they did not complete a minimum required number of tasks. In order to avoid this issue, make sure to show the minimum required activity in the system as per your contract.

Tasks availability and time restriction

In general Leapforce and Lionbridge guarantee at least 2 hours of work per day but task availability may depend on your country. There might be some days when tasks are available for more than 4 hours.

You should understand that the system of task distribution is based on a “first come first served” basis and you need to be ready to catch your portion of tasks when they are uploaded into the system. To identify time slots when task availability is the highest please look at task completion graph, usually tasks are uploaded every day into the system at the same time slots.

Lionbridge does not provide raters with a task availability instrument, so raters have to identify time slots when tasks are uploaded into the system by themselves.

Leapforce also has a system that restricts access to tasks for new raters, and those who are undergoing their quality review. To lift this restriction, you have to complete a certain number of simulation tasks or wait till the next quality review, if your quality score is good, the restriction will be lifted automatically.

Locked for quality audit or restricted for quality?

If you receive an email notifying you that your account has been placed under quality review,this is a good time to identify your weak points and improve your rating skills. Below you will find some tips on how to deal with a “Locked for quality audit” situation.

  1. To speed up the process and to get feedback on your mistakes as quickly as possible, I recommend writing to LP/LB and ask why exactly your account has been placed under review.Sometimesthe automatic system locks raters accounts without specific reasons. Usually such cases are being resolved within 1-2 days.
  1. While waiting for detailed feedback for LP team, start doing simulation tasks in order to improve your rating skills. In most cases the issue is related to Side by Side tasks. Make sure that you understand how to deal with this type of task and that you provide well written comments where required. In many cases, raters are placed under quality review due to poorly written comments.
  1. Once you receive the feedback email with your mistakes/quality issues, read it carefully and reply back with an explanation on how you will improve your weak points.
  1. Once your status is moved to “Restricted for quality”, keep in mind that your service is under inspection, thus making sure that you do your best to provide the best possible service.

Why is my Leapforce status restricted with a meets expectations rating?

Sometimes some raters do not get their restricted status changed to unrestricted with getting a meets expectations or above quality score. This happens because they were restricted for Side by Side or PQ tasks quality issues and feedback was released for needs met tasks. In order to lift up all restrictions a rater will have to wait for the next quality review cycle for type of tasks a rater was initially restricted for.

And finally, at the end of month, if you get meets expectations or an above quality score your account will be unrestricted again.

Here are two videos and link to the article which will help you to understand how you will contribute to improving Google search engine.

Leapforce US raters will become part-time employees: no more full-time work

In  April, US raters received an e-mail from  Leapforce, which states the following “Effective June 1, 2017, [Raters in the US] can work up to 26 hours in a calendar week (Sunday to Saturday).” All raters will be moved to a new platform called raterlab and will not be able to work on another projects at Leapforce. Read more about this change here:

https://arstechnica.com/features/2017/04/the-secret-lives-of-google-raters/

How Does Google Search Work?

 

Survey:Leapforce/Lionbridge working hours spent per month

Have you ever wondered what hours raters work ?

Knowing these statistics can be useful for raters in terms of estimating  possible productivity .

The survey is completely anonymous and once completed will show the overall statistics.

Thanks for participating!

Advertisements

143 thoughts on “Common issues of new raters (Yukon Raterlabs/Leapforce and Lionbridge Google Rating Projects)

  1. Thank you very much!!! for all your help and responding so quickly to all of my many questions. I would not have been so successful at this job without your help ! I will recommend you to anyone I know who is in need of assistance.

  2. Extremely valuable information in one source! Saved a lot of time searching the net, as all the info one needs is in one location. Thank you very much.

  3. Tim was a lifesaver. I passed the leapforce exam all because of him. I trust him with any advice or recommendations that he makes. I assure all of you 100% to all those that use his services that he will help you pass the exam and assist you in many other ways to keep your employment and profile with leapforce or lionbridge active.

  4. I recently got an offer from lionbridge, although I still have to take the exam. When I told my boyfriend he said he looked into it to make some extra money but it’s limited to one account per IP address (we live together). I know it’s supposed to be one account per household but I was wondering if he could work for one of the other online companies like leapforce? I like to do everything by the book, especially when it could jeopardize my income but I wasn’t sure if there were any rules against this. I was hoping someone here would know the answer. Thanks.

    1. According to Leapforce policy you may have one account per IP address, while Lionbridge allows to have one account per household…Therefore I recommend you to arrange two different IP addresses (networks), one unique IP address for your PC and one IP address for your boyfriend PC. Make sure that each PC is connected only to a designated network. You may ask your internet provider to provide you with one more IP address or use SIM card internet for this purpose (SIM card intenet has dynamic IP address, it is not suatable for Lionbridge application process but ok for Leapforce).

  5. Thanks to Tim now I am part of the company, without him I never would. I recommend their services for all seeking to work with Google.

  6. I started kinda fast to do tasks and did 2:23:00 hours in the last 3 days, but 23 minutes of them are not payed. Now i fear that my Quality could be not good enough for leapforce, is it possible to still raise my Quality until the next month? And how does this work best?

    1. Technically you cannot change your quality score for current month if you have already done your quality tasks.Typically tasks which are available for new raters are quality tasks up on which raters are accessed for their quality. Time spent for completing tasks has no affect on your quality. At the moment continue doing live and simulation tasks as normal and wait for your quality score which will be available in the end of this month…

      1. DId you see anyone getting fired in their first month .Do new raters get warnings before they get fired??

      2. Please are simulation tasks rated and can i be placed under review cause of it?

  7. Based on my experience, only those new agents are fired who get very low quality score for thier first month of service, the rest of raters with substandard quality performance get restriction on access to tasks until next revision. This is not valid for Lionbridge, they seem to be less strict on new raters…

  8. Please kindly advise if it is possible to get payment by paypal? i could not find an answer on that.

    1. Leapforce and Lionbridge do not make payments via PayPal. You have to have bank account registered on your name in order to be eligible for this job.

  9. Hello Tim , right now I’m on level 1 and sometimes I get to work 1 hour per day and sometimes don’t , when I’m on level2 am I gonna work 2 hours every day or just sometimes ?

  10. I got a contract for Leapforce but I want to leave the apartment for a new one which means I will change IP.
    Does it make any problem for me?

    1. Once you are in the Project, you may change your IP address many times it will not affect your project status. Make sure that you do your project tasks in a private place as it stated in the contract.

  11. You have been permanently blocked from acquiring tasks in the Yukon project due to quality issues with your submitted work.

    Please visit the Projects page on the Leapforce website for other projects that may be available to you. We would like to remind you that you are obligated to maintain the confidentiality of the Yukon project and any information related to it. Please destroy or securely discard all instructional material related to this project that you might have downloaded or printed from EWOQ or the Leapforce at Home website.

    In this case what can I do?

  12. In case I have received this kind of email, what can I do?

    “The Leapforce at Home quality review team has recently conducted a review of your completed Needs Met evaluation tasks. Your tasks were inspected for accuracy and compliance with Leapforce’s quality standards. Your Needs Met Quality Review Score is very important, please be sure read this entire message. Also, please be sure to review the personalized feedback for these tasks. This can be found on your Leapforce Project Yukon homepage under Needs Met Quality Review. Note: personalized feedback may not be available in all locales.

    YOUR NEEDS MET QUALITY SCORE: Unacceptable

    Your quality review is scored on a six point scale, ranging from Perfect, Excellent, Exceeds Expectations, Meets Expectations, Substandard Quality, to Unacceptable. Receiving a score of “No Score Available” typically indicates that you did not complete enough tasks to produce a review. “No Score Available” is treated as a neutral score.”

  13. Dear ADVISORFIRST than Q for clarify leapforce Problems actually I passed all 3 exams of leapforce and after 3 days I filled forms and payment method too now i got New Evaluator Level 1(project 1) but i want to stop leapforce work completely up to 4 months due to my personal problems busy life
    It may cause BLOCKED leapforce Account??? answer ASAP.

  14. Dear ADVISORFIRST than Q for clarify leapforce Problems actually I passed all 3 exams of leapforce and after 3 days I filled forms and payment method too now i got New Evaluator Level 1(project 1) but i want to stop leapforce work completely up to 4 months due to my personal problems busy life
    It may cause BLOCKED leapforce Account???

  15. You should cosult with your agreement with regards to min. required number of tasks to be completed per month in oder to stay active in the sytem…If you do not meet the requirement regarding min. required number of tasks, your account will be deactivated. To become active again you will have to go through the qualification process one more time.

  16. I’m very new to leapforce is it compulsory to Complete 1.Needs Met Simulator 0 of 193

    2.Needs Met with SXS Simulator 0 of 90

    3. Page Quality Simulator 0 of 102

    how do I need to do the invoice, does it needs to have a certain format? Where do I have to submit it?when will i submit it before starting task or after finished task Thanks

  17. You are not obliged to complete all/any simulation tasks, but I strongly recommend you to practice on these tasks befor going for live tasks. For more info please read my post “Common issue of new raters – Quality”.

  18. I have selected for Project 1 (New Evaluator Level)
    10 days back but still I’m reading Academy Next QUIZ then Simulation totally it takes 40 days to complete all.

    what will happen if I will not start New Evaluator Level 1???

    what is the due date of to start 1st New Evaluator Level 1

    Plzz Reply ADVISORFIRST

  19. HI Tim,

    “…new agents should focus on doing simulation tasks and self-education. Time spent doing this will really pay off, and you wont be restricted for quality in the future.”

    How many weeks do you suggest doing sim. tasks & self-education upon being a new hiree? Or, does that depend on when you started employment?

    Thanks,
    Susie

    1. It depends on you, you may need a few days of training on simulation tasks to feel confident yourself in terms of proceeding with real tasks. if you get stable quality level when doing simulation tasks, it means that you can do live tasks with no risk of being put under quality review next month. Make sure that your quality level/expertise is good in relation to Side by Side tasks, because when you do quality review tasks, there are 14 side by side tasks and if you rate 5 tasks incorrectly it means that you might get substandard or unacceptable score ((5/14)*100%=35% of tasks are incorrect))

  20. Hi! I’ve a question about ip address. I’m italian and I’ve a dynamic one because a static ip is expensive! This is a problem for leapforce? Thanks a lot

    1. It might be very risky to have this type of IP address because it means that many people have the same shared IP address. This may lead to:

      Multi-accounts conflicts (when people use the same IP address ):

      Be informed that it is prohibited to have multiple accounts, without special arrangement. Leapforce and Lionbridge can find duplicate accounts very fast, and as a result, you will lose both accounts, or if you are at the stage of qualification (provided someone has the same IP in the Leapforce or Lionbridge project), most likely you will fail the exam, due to this reason.

      IP/Network sharing

      In some cases people may share their Internet network, while working as search engine evaluator make sure that you have your personal unique IP address and no one uses the same IP to go online for rating project.

  21. Hi, I’ve a question about leapforce. They don’t reply..so I hope you can help me! I’ve an ISP named Linkem that allows more users to connect to the same ip address..ip is not public! So it’s possibile that I connect to my ip from my house and another user, unknown to me, connect itself to the same address from another italian region! IS this a problem? I’ve to change ISP for a public ip? thx a lot

  22. 1. Can i apply both lionbridge and leapforce?
    2. You mention IP restriction is that means that if I work on diffrent networks or away from home I can’t do my rate jobs?

    1. Hi,

      1. Yes you can apply for both Leapforce and Lionbridge, but once you are invited for qualification exam, you have to choose only one vendor, otherwise it will lead to gmail/ip address conflict and termination of qualification process or your contract.

      2.You should keep the same IP address only during the qualification process, once you are in you may change your IP address many times.

      1. Ok thank you for your answer i have abandon the leapforce one then.
        Can I email lionbridge to notify me more task to me if i can where i can email to?

  23. Is it in the contract that you cannot work for both companies at once? I applied to both not knowing much about the background of each company, just knowing it was similar work. I read the contracts as best I could and I was accepted into both programs and passed both exams and sent in all my bank details. I started working a week with one and then started the other a week later because I did here in a blog that once you apply you can never apply again. So I didn’t want to lose out in case the first one didn’t renew the contract. Well a few days ago, I was terminated from both and I assumed it was because Of my productivity. Then I search and find your blog which is very helpful by the way. 🙂 I’m really bummed out and worried because I’m a stay at home mom who’s broke and this job was perfect and I didn’t expect this. Is here any way they would reconsider me if I reapply to only one of them this time or even reinstate me?

  24. Yes, you cant work at both companies at the same time under one name/gmail account/IP address.

    In your situation I would advise that you apply for search engine evaluator position on behalf of your husband or mother or whoever you trust. Before proceeding with registration, make sure that you use a new gmail account, when filling out the application and answering the application questions, indicate that you have never applied/worked for search engine evaluator position before. A new IP address is also required. You may use VPN to change your IP address. Once you have started the application and qualification process, I recommend you keep the same IP address during the process.

    1. Thanks Tim! Hopefully I’ll pass it again. Lol. Those were tough tests. I had a lot of “practice” while working for them, so we’ll see. 🙂

  25. what if i press the wrong button while in exam page on raterhub?

    here is my case

    im accidentally enter the exam page without know that is the EXAM PAGE while testing the raterhub navigation.. i want to back or i dont want to start my exam yet because I have not had enough study the guidlines.. then i press the “cancel” button, and then i sign out from raterhub.. fear that im doing it wrong i singed back again and there is button “unfinished task” then i press that again.. and notice the question of the task is change from last time i got there (is this another page / did i just miss or failed the exam page 1?)

    im not answer the “true false” question yet.. im just pressing cancel – sign out – then sing in again then while im searching for the answer of my problem i got countdown time “this page will terminated with the timer.. then i had to choose expired page to back to home”

    my question is : was i just failed my exam accidentally?? did i had to start all over again from the beginning to retake the exam? i heard that need 1 week after LF sending new retake exam…

    i sending email to the company and they only answer “we are cannot give you any feedback during your exam.. best of luck”

    still confusing until now

    1. Hi,

      That is actually is a very good question. In part 1 you may leave incomplete test form/web page and come back to it at any time, it will not expire and will not affect overall outcome, but be careful with part 2 and 3, tasks in those parts will expire in 60 min automatically. Expired task is counted as “failed” task.

      On exam re-take You will have to go through all parts of the exam again, practical tasks in part 2 (Page Quality) and part 3 (Send to Device) will be different from those you had on your first exam, although there may be a few tasks that come from previous exam.

  26. Hi, I am new to leapforce. I’ve got a question about the leapforce extension. When it says ‘on’ is it already counting my time? Because even if its already on, I can click on it and it still says ‘on’ but its shaded grey. (So to say like a pressed button).

    Which of these two is the way to track time? Is there a video or a section in the FAQ about this?

    Thx for your good work 😊

    1. Maybe my question was not so easy to understand: Do I additionally have to click on the extension to log my time when the extension is already on?

      1. Hi,

        You have to log on to the Leapforce extension each time you work in the system. This extension records time on Leapforce server in order to compare time you invoice them for your service with actual time spent in the sytem.

        Thus you have to count your time spent for doing tasks by yourself. Here is an app whaich might be helpful to track time.

        The first one is called RaterAide which is a task tracker and timer which keeps track of all tasks and shows the time you are spending on each task. It keeps an accurate record of how much time you worked so you can submit accurate time on your invoice. Your data can be stored on Dropbox meaning that everything can be synced across all your mobile devices.

        Link to app website: http://www.rateraide.com

        In the beginning you may spend more time than the average estimated time that Leapforce allocates to the task, but make sure that in the invoice you put average estimated time that they give you. If you spend less time than average estimated time per task or set of tasks, be informed that your invoice will be returned for correction, Leapforce will ask you to put actual time spent, that is why there is no sense to complete tasks faster than average estimated time. Take your time, do everything correctly and watch your time.

        Was my answer helpful? If yes, buy me a coffee!

  27. Hi I accedently didn’t use rater extension when doing task its 2 hours long because I do it in laptop, usually in desktop PC and I forgot to install it 🙁
    Is that 2 hours long can’t be reported? 🙁
    And I get email that say my quality not very good and has to do learning portal what should i do now?

    1. Hi Nitraion,

      You should forget about 2 hours session because you cannot invoice it if your extansion was off during working process.

      As to restriction due to quality of your service, now you should focus on doing simulation tasks and self-education. Time spent doing this will really pay off, and you wont be restricted for quality in the future.

      1. The for your respond my only problem it seems language barrier as English is not my main language
        Also I start work at middle of month so is it okay that I didn’t meet 10 hours requirement?

  28. Hi,
    I had an issue with my url on my phone and it took me some time to fix. I was on my first question on part three of the exam and it timed out before I could complete all of the assessment. Do you know if that counts against your score, or if you are just issued another question?
    Thanks!

    1. Hi Georgia,

      Unfortunately yes, the expired task will not be counted as complted task and most likely you will not get sufficient passing score.Do not leave incomplete tasks more than for 1 hour, otherwise they will expire and you will fail the exam automatically. If you need to take a break,complete tasks and press “Submit and Stop rating”.

  29. Hi, thank you very much for your posts, they are very helpful !
    I signed my contract yesterday and today I was informed via email that my account was active.
    Since i joigned the program later (July 26\27), how will it be possible for me to complete the required tasks at the end of this month (literally in 3 days) ? Will i be penalized? Will my account be deactivated? I was planning on doing self-education and simulation tasks before taking live tasks..
    Thank you in advance for your response.

  30. Hi Tim, thank you very much for your posts, they are very helpful!
    I signed my contract yesterday.and today iI was informed that my account was active.

    Since I joigned the program later (july 26\27), how will I be able to complete the required number of tasks at thend of this month (literally in 3 days)? Will I be penalized? Will my account be deactivated?
    I was planning on doing self-education and simulation tasks before taking live tasks.

    Thank you in advance for your response.

    1. Hi Soralya,

      I do not think that as a new rater you will be penalized for non completion of required number of tasks, take your time and upgrade your rating skills by doing simulation tasks…

  31. Hello Tim! Thanks for giving so many information about LeapForce
    i am new rater so I want to ask you some questions
    I want to know when (date) usually you submit your invoices ? in the policy it’s stated that “Invoices may be submitted any time after the invoice period has ended.”. Does it mean that for Invoice Billing Period July (07/01 – 07/31) I can click ‘Submit Invoice For Approval’ on 08/03 ?

    And when they usually transfer the money to us ?

    1. Hello,
      I am wondering if it is normal to not hear back from Leapforce for 3 days after I completed part 3. The first time I took the test, i did not pass part 3 and I was notified of that within about 6 hours. I completed part 3 this time on Thursday evening, and the test was set to expire on that friday at 12am. I still have not had any correspondence from them. Anyone else have this experience?
      Thanks!

  32. Hi
    I had got a termination notice on mail from Leapforce after six months of working with them and its as below:
    Leapforce, Inc. finds it necessary to inform you that we are hereby terminating the Independent Contractor Agreement between Leapforce, Inc. and yourself due to the material breach of your obligations under the Agreement.

    I mailed them back but no reply on why ths termination
    Can I reapply for the same job, if so after what period I can do so?
    Thanks

  33. Hello Tim ! I want to ask something regarding payment.
    For August 2016 invoice, I already submit it on September 2nd 2016, and the status is already approved, but until today (September 17th 2016) I still haven’t got my payment in my bank account. Do you ever face same problem like me ?

    1. Hi,

      According to Leapforce payment policy, the payment is made within 30 days once your invoice is approved. Normally they pay on 22nd-28th.

  34. just received an email from lionbridge saying I have the same IP address with other person so I was unable to take the exam. I didn’t know that sim card internet had dynamic IP address. Will I ever get the chance to work for similar companies with dynamic IP address??

  35. Hello Tim ! I worked for Leapforce science 2014 with different accounts , I am from Egypt, recently I have been permanently blocked for my last account, I want to reapply again, I know how but at many times I got no answer back, I want to know how I insure that I will be accepted to move to qualification process.

    1. Try to arrange new IP address, update your CV, create new gmail and apply one more time, if possible on behalf of a person you trust, because it might be that your name is blacklisted on Lionbridge/Leapforce database.

  36. Hello Tim ! I worked for Leapforce science 2014 with different accounts , I am from Egypt, recently I have been permanently blocked for my last account, I want to reapply again, I know how but at many times I got no answer back, I want to know how I insure that I will be accepted to move to qualification process.

  37. Havent heard back for months. Im aware on how to create accounts but nothing is getting through to the contracts in order to get to the exams. Has the US hiring been on hold in most states?

  38. Tim I have a relative who has been working with LB for a while. I just got invited to take the test, will having a close relative already working with LB be a conflict of interest if I was to pass the test? I don’t want to get him in trouble.(Different households)

    1. Hi,

      If you use your own landline Internet and pc for this project then it won’t create any ip related conflict or problems.
      While working as a search engine evaluator, make sure that you have your personal unique IP address and no one uses the same IP to go online and work on for these companies.

      If you have two or more people in your household, it is advised to get two unique IP addresses, and you can do this for an extra charge with most internet service prooviders.

  39. Hi Tim

    Thank you for the helpful post. Regarding the ‘Quality Review’ done by Lionbrige, are you aware of any other algorithms they use to choose the ones to be placed ‘under review’.? I noticed that they are quite responsive with SXS comments as you mentioned.

    1. hi Tom,

      As you may know in the end /beginning of each month, a certain number of quality review tasks are uploaded into the system. These tasks are quality performance tasks up on which your quality is measured each month.Tasks have to be done by all raters and they can be identified by the fact that they are available all the time for completion.

      In most cases those quality review tasks are Side by Side tasks. Normally there are 10-15 Side by Side tasks and if you rate 3-5 tasks incorrectly it means that you might get substandard or unacceptable score ((5/14)*100%=35% of tasks are incorrect), quality score below 80% may lead to restriction or quality audit or in case of getting unacceptable score it may lead to removal from the program.

      PQ review tasks are usually uploaded once per 3-4 months..

    1. Hi Sam,

      Honestly I do not know, but from technical point of view, Payoneer bank account is the same as any normal bank account. You better write to LP and ask them directly.

  40. Hi Tim. I am wondering, do you know if Leapforce or Lionbridge require you to have an actual smartphone, or do they allow someone to use a free android simulator?

    Thank you.

    1. Hi,

      Now Leapforce and Lionbridge require all applicants to verify real smartphones during application process, if you use Android emulator their system will detect this fact…

  41. Hi Tim,

    Thank you for this great website and all the effort you put into this.

    I’m a new Lionbridge Rater and looking for some advice to improve my productivity. When working on a task, I am always far behind the estimated time (i.e. I need more than 20 min for a 9 min task). I know that I will get faster with more practice, but I can’t imagine how it could be possible to check the reputation for 10 pages within 9 minutes. And for Side by Side tasks there is so much more to do in this small time frame.

    I already rely more and more on my feeling, do not really check or assure things, especially regarding PQ. And this doesn’t feel right. Lionbridge says that quality is more important than time, but this doesn’t make sense to me, if I get just paid for the AET.

    I’ve done some web research, but couldn’t really find other raters speaking about time issues. So maybe my procedure isn’t the best? Do you have any advice for me?

    1. Hi Steph,

      Many new raters need more time than AET allocated to a specific task and it is ok. When you get more experience you will do tasks within ATE or even less time.

      You should not sacrifice quality for time. In the beginning you may spend more time than the average estimated time that Lionbridge allocates to the task, but make sure that in the invoice you put average estimated time that they give you.

      As to PQ tasks: while giving E-T-A rating you should evaluate MC under these 3 criteria (E-T-A). In most cases you may do it fast at a first glance approach, but be sure to provide good evaluation for E-T-A when you have YMYL query.

      1. Hi Tim,

        Thank you for your reply. So you think (or know) that Lionbridge won’t accept the real time in the invoice? Lionbridge says “it is expected for you to take some time to be fully up-to-speed”. But it’s not okay to bring this time to account?

        Last week I worked about 25h (incl. doing tasks, practicing, reading instructions and several guidelines – English isn’t my native language, so this needs time), but I couldn’t accomplish the expected 10h allowable time. I suppose it’s fine to don’t reach the goal in the first two weeks, especially with the holidays around, so I don’t worry about this. But it rankles me to put so much time into this and not being paid for at least the hours of working on tasks.

        And regarding PQ tasks, or let’s say Side by Side tasks with Needs Met and E-A-T rating included: With some experience, is it really possible to rate Needs Met and E-A-T for about ten results (YMYL or not), to assign the SxS rating and to provide a good comment in just 9 minutes without sacrificing quality? Hope this doesn’t sound harsh, I’m just sooo far from AET that I need some confidence that this work pays off in some weeks.

  42. Hello,

    I’ve just received a message from LB telling me I couldn’t work for them because there was someone else registered on their system using the same IP adress……………… how is that even possible?!

    Nobody in my house work for LB. I don’t share my Net with anyone, only in my house it’s being used by me and my parents.

    I would appreciate if someone could help me to solve this issue, or else I won’t be able to proceed on the program.

    Thank you

    1. Hello,

      Before assigning exam, Lionbridge and Leapforce check your gmail IP history for IP address match with another raters.There are two possible scenarios which may lead to IP address conflict:

      a. you have dynapic IP address and another rater also has dynamic IP address, both are using service of the same Internet provider. Sometimes Internet provides may assign the same IP address to its customers. In this case Lionbridge will see the case as one rater has two accounts due to IP address conflict.

      b. You connected to someone network which is already in use for rating project.

      Solution to the issue: make sure that you use dedicated and static IP address.

  43. Is it ok to do tasks quickly and build up extra time. Say I submit tasks 2 min early and build up an excess of 10 minutes. So on my last task I let the timer run for an extra 10 minutes?

    I have been doing this but sometimes get my invoices sent back and there will be one day they say I have to take time off of. I was wondering if this could be the problem.

    Thanks!

    1. Hello,

      In the beginning you may spend more time than the average estimated time that Leapforce allocates to the task, but make sure that in the invoice you put average estimated time that they give you. If you spend less time than average estimated time per task or set of tasks, be informed that your invoice will be returned for correction, Leapforce will ask you to put actual time spent, that is why there is no sense to complete tasks faster than average estimated time. Take your time, do everything correctly and watch your time. You should invoice only AET!!!

  44. Tim. And my first time in a qualifying process for Appen. Falcon Ads Project. I am anxious and afraid of making mistakes, so I decided to study all the Ratings Explanations before starting the qualification. That’s why I found your blog, it has an excellent reputation. My question is: my computer and my phone have more than 3 years of use, I can not buy new devices before the exam. Can I be harmed by this?

    1. Hello, Marcelo.

      Do not buy new equipment specifically for this project. Any PC even with Windows XP OS will be OK to participate in this project. Your phone also should be ok for this project.

  45. i am restricted for one day i don’t know why. one thing i did was to click submit and stop rating twice regularly, please explain is this the reason.

  46. When we begin rating, would be like the exam? For instance, once we click on the task it will last up to hour?

  47. I recently applied for a position at RaterLabs. However, I received an email from them asking for my email password. I do not feel comfortable giving this information. Is this a legitimate request and why do they need that information?

    1. Hi,

      Are you sure that they asked you to provide them with your Gmail password? I have never heard about this before, you either confused something or it is scam. Could you share with us the exact wording of the request?

  48. I am from india. I have qualified for Nile project but did not receive any email for becoming frt. When would i get the email ensuring that i have been added in frt?

    1. Hello,

      It depends on many factors. The procedure is the following:

      Once you are invited for the project it means that your application has been reviewed and approved for the project and you are placed in a project queue.

      It might take up to a few months before moving to the next stage (production), it has to do with fact that the project has limited capacity and vendor and customer need time to fire unsuccessful raters and replace them with new raters.

  49. I am working for Lionbridge. I am put under review for quality for a week. Will I be paid for the work which I have completed till date?

    1. Quality audit is a normal process, many of new raters are going thruogh it. If Lionbridge or Leapforce quality team find out any issue in your service, they will assign you e-learning educational course, once you complete this course, you will be allowed to continue working in the project. All work done previously will be paid as per your contract terms and conditions.

  50. Hi Tim

    This might be a silly question, but I got accepted and sent all my paperwork and they said Im all set to login to start work. But what is the address to login to work? Ive looked everywhere they never gave it to me in an email
    Thanks

    1. Hello,

      You need to logon your Raterlabs/Leapforce profile in order to get access to your personal page and all links/resources which you need in order to proceed with work.The link is available on Leapforce /Raterlabs website.

  51. Hey Tim, quite a job you’ve done here leaving no comment unanswered, thanks so much for your work. So my question is, that I just signed the independent contractor’s agreement, however it is not very clear to me how I’m going to be compensated since at no point I was asked for any relevant information. Is this something filled at a later stage?

  52. Hi Tim,
    How to record time for mobile task in leap force. Rater aide pro is paid. Is there any free app to record it.

  53. Hi Tim, I’m working for Lionbridge. My score for last October (NM=91,9% and SxS=100%) are meet the expectation from Lionbridge standard (85%), but suddenly I received email that they indentified quality issues with some of the tasks I have recently rated, so they conducting general review and put my account under review for 7-10 days. How could that happen when my score is fulfilled their minimum standard?

    1. Quality of raters is measured not only by means of quality review tasks (monthly feedbacks). Once per a several months vendors may conduct global quality audit, even raters with high scores might be placed under quality review process in order to examine their work in depth.

  54. How would you rate a page where nothing is found? I was taking part two of the exam and has 2-3 tasks that had nothing on the landing page but the website itself was fine. Just confused on how I should rate it for quality.

    1. Hello,

      No you cannot. Bank account holder name must be identical to a independent contractor name, otherwise you will not be able to receive any payment and as a result your contract will be terminated.

  55. What is leapforce extension and Where can i find it to download it ? Should i download on my pc before doing tasks and I want to do simulation tasks but i cant find the page Where i can do this. I hope you can help me with this
    Thank you very much.

    1. Hello,

      Go to your personal Leapforce page, there you will find the page called Leapforce extension, read the info on the page carefully and follow the instructions.

  56. there is website reputation research mentioned so often, but i found that on the page quality rating exam, it was difficult to locate any reputation for at least 3 of the examples. I know wiki, bbb, etc but even then, it was difficult. Any tips?

    1. In my view the profound ETA research (including reputation) is important for YMYL pages, in another cases if you cannot find reputation, you just select ‘no reputation found’.

      1. Hi Tim,

        Are there simulation tasks for shasta project. And for rating is there difference between rating with fresh viewport age and stale viewport age? Or should one rate the same way both? Thanks

  57. I have been working for Lionbridge for almost four months. But how do you know that you are under quality review?

    I have always met the quality scores for each months that I have worked for. But Today I received two emails from the Senior Quality Controller asking me to explain why I rate what I rated on specific tasks that I had rated. I have not yet received any emails informing me that my account has been placed under quality review.

    Am I under quality review? Please help me. I am freaking out.

    1. In many cases raters might be asked to explain some of their ratings, it is normal and it does not necessary means that they are under quality review. However, very often rater’s account might be flagged for quality by the system automatically, so it takes time for Lionbridge or leapforce to get to know about it. In this situation, if you have an assumption that your account is placed under review you may write email to support and clarify the status of your account.

  58. Hi Tim,

    I work for LB and its been 6 months I am with the project earlier until l last week I never had restriction on time i can tend to work as many hours possible but suddenly from last week i am allowed to work only for 3 hrs/day will it resume to normal could you please explain? is this because I am not doing simulators frequently? Kindly assist me on the same.

    1. Sometimes some raters do not get their restricted status changed to unrestricted with getting a meets expectations or above quality score or some raters get restricted without a proper reason. This happens because they were restricted for Side by Side or PQ tasks quality issues and feedback was released for needs met tasks. In order to lift up all restrictions a rater will have to wait for the next quality review cycle for type of tasks a rater was initially restricted for.

      And finally, at the end of month, if you get meets expectations or an above quality score your account will be unrestricted again.

  59. Hi Tim,

    I appilied for leapforce Yukon project and its a option to reschedule it :
    1. how may times we can reschedule it and
    2. will it affect your second chance for exam(if failed first time).

    pls advice.
    Thanks

    1. You may reschedule your exam a few times, it will not affect your probability of passing this exam.

  60. Hello tim
    I received an email from quality team with 3 errors listed in an email
    They ask me to provide explanation to these errors
    I am convinced that they are errors and i rated it wrongly
    Can you please tell me how to answer to such email
    Thanks

    1. Hello,

      You should explain why you made rating mistakes and what you will undertake in order to prevent making the same mistakes in the future.

  61. what I read here about this information is very interesting. I wanted to know if: a person has given the yukon exam 3 times and has failed. You can be called back or reapply to redo the yukon exam after some time or it is completely excluded?

    1. In some cases a few raters are allowed to take the exam up to 4 times, maybe you might be one of them ;)!

      1. Really? I had never heard of having up to 4 chances to take this exam, but it is possible that they recall even after 3 months?

  62. Hi,
    I am from Pakistan and passed the rating exam of Lionbridge. I kept logged on for hours many times but found tasks only one time. Those tasks were also for maximum of 30 minutes only. Are there some strategies for getting tasks? I am able to get only 30 minutes tasks from January 02, 2018 to February 27, 2018. Please guide me. If we don’t get enough tasks for at least 10 hours per week then there is no logic to continue on the program. Please guide me.

  63. Can I complete the Yukon project work from different places with my laptop? Or is this just allowed from the original location (home) where I applied for the job?

    1. Hello,
      it is highly recommend that the qualification process is completed from one place/IP address. Once you are in the Project, you may change your IP address many times, it will not affect your project status. Make sure that you do your project tasks in a private place as it stated in the contract.

  64. Can I be locked for productivity for not working enough hours during a working period? I just started with less than a week left on the working period and could not meet the minimum 10 hours.

    1. Hello, I do not thinks so, only if you have multiple cases of not meeting productivity requirements.

  65. While taking LB exam I faced some internet connection problem. So I switched the connection. Will it anyway affect the qualification.

  66. This blog tremendously helped me pass the exam. Thank you.Does Raterlabs or Lionbridge fire raters for unsatisfactory work quality? Do they give you a warning in advance if they do?

    1. Hello,

      Thank you for your feedback. I recommend you to read this article: passleapforceexam.com/2016/11/20/how-to-stay-with-leapforce-for-a-long-time-and-not-get-fired/

    2. Hello,

      During your participation in the project your service will be evaluated on quality by means of quality review tasks.In the beginning of each month, a certain number of tasks are uploaded into the system. These tasks are quality performance tasks up on which your quality is measured each month, the end of the month you will get your quality score feedback.
      If your ratings often falls out of general range of ratings, most likely your account will be flagged by the system and your work will be checked for quality manually.

      Read more about this topic here:

      https://passleapforceexam.com/2016/11/20/how-to-stay-with-leapforce-for-a-long-time-and-not-get-fired/

  67. This is my third month and I’ve not had any feedback from Lionbridge. When I go into feedback it just says Error. There is nothing there. What should I do? I would like to have a score to track my progress because sometimes the work SxS is so subjective it’s hard to know if I’m doing them to their standard.

  68. Hi, I am new at the Yukon project. Do you know where I can check the average time for each task once I already finished them? They returned me an e-mail saying that I was spending too much time on my tasks but for this month I know I have been taking my time in some tasks. Do you know where I can find this information so I can fix in the current invoice? Thanks!

  69. I’m receiving a connection error whenever I try to use the tools on LB. It was working at first until I updated the Facebook app itself. Is this a sign of termination?

Leave a Reply