Appen Nile Project for Facebook

Nile project – Ads Evaluation for Facebook

Appen offers more than just rating projects for Google. Currently there is a project called Nile where, as a rater, you can review ads based on your likes, your interests, or your web viewing habits.

You can change these settings in Facebook to adjust what ads you get ‘served’ when doing the ad ratings. The ads are not based on companies that you have already manually liked, but ads that are similar. When starting the project, you get 20 ads to rate. These can be anything from video ads, to just plain text ads or ads with a photo. 

Before you are accepted to the Nile project, you are asked for your Facebook profile URL. You must have at least 50 friends on this Facebook profile. Appen simply checks this and nothing else about your profile. You will hear back from Appen within a week if you are accepted into the program. In order to stay in the Nile program, you must work no less than 5 hours per week.

When rating you are asked ‘How much do you feel that this ad is ‘relevant, useful, entertaining, if the ad is offensive, or misleading. You can rate each one of these on a scale from 1-3 using radio buttons.

You are then asked ‘How much do you want to see this in your news feed’ and are shown a scale from 1-5 from ‘I definitely do not want to see this in my feed’ to ‘I definitely want to see this in my feed. Once you have done this, there is an explanation that asks you ‘In your own words, why do you feel this way about the ad.

It is not known if the comments are actually looked at in the ads or not. You don’t need to create a huge explanation. A simple reason why you do or do not like the ad is good enough. When you are finished rating the 20 different ads, you are then asked to wait for one hour to complete what is called a ‘Bakeoff’ task. The Bakeoff task determines which ads you liked and which ads you didn’t. It asks you to choose out of 6 ads in a side-by-side comparison, which one you would like to see in your feed over the other. This task should be completed exactly one hour after you’ve rated the ads. Currently you are allowed to only work one hour per day on Nile. The hour that you wait for the Bakeoff tasks is not paid. So you charge 1 hour for the Nile ratings and the Bakeoff task which takes you less than a minute to do since all you are doing is clicking which ad over the other you want to see.

You must work at least 1 hour per day to Nile is an interesting project and will probably go full time, but currently there is just one hour allowed per day. That’s an extra 30 plus hours per month and totally worth the time. It also pays the same hourly wage as the Google rating program.

Appen Nile Project Qualification

Appen has introduced qualification exam for Nile project. The Nile project exam consists of 30 questions designed in a way to assess your understanding of basic concepts of how to evaluate ads and search results. Again before taking this exam you will be given an access to specific guidelines which you need to study carefully before proceeding with the exam itself. Do not underestimate the complexity of the Nile qualification exam; some of the questions are tricky and confusing in its wording, so without preparation and thoughtful approach you have a very low chance to pass this exam. One attempt of taking this exam is allowed. Once the exam is passed (you will get result immediately after completing the test), you will be offered to sign a contract.

Payoneer As a Payment Method for Appen, Raterlabs, Lionbridge and Utest

Advertisements

Taxation for Independent Contractor’s Pros and Cons

contracting-with-an-independent-contractorIf you are working as a Search Engine Rater or Social Media evaluator for any company that doesn’t hire you directly, then you are known as an independent contractor. Regardless of whether you are an independent contractor, a freelancer, or consultant, you will be considered as ‘self-employed’. What this also means is that you are responsible for doing your own taxes. There can be some advantages to this and also some drawbacks.

Independent Contractor Tax Payer status

If you’ve been working for companies like Appen  or Lionbridge, you know that you are basically your own boss. It’s very rare that you have to work with other people in these jobs or have much interaction at all. This can be a good thing or a bad thing. Keep in mind that the people you are working for are not your supervisors. You’re a contract worker which simply means that you provide your services in exchange for a set wage or price. You are largely in control of when, how, and where the work is done. And you can do the work when you want to as long as it gets done.

Another advantage of being an independent contractor is that you will make more money than if you were simply an employee. The reason for this is because companies are willing to pay more for an independent contractor because there aren’t any expensive long term commitments and the company doesn’t have to pay extra money for employment benefits.

The other great thing about being an independent contractor and working on your own is that you get to deduct more business expenses than a typical employee can claim. Think about everything you need to do your job, your computer, your desk, your chair, even the internet connection you are paying for can all be deducted as an expense at the end of the year. This basically means free office equipment.

One of the first things that you will want to do is come up with a plan to save enough money to pay your taxes at the end of the year. Working as a freelancer means that no one is doing your taxes. Your pay is given to you all in one lump sum with no taxes taken out. It is important to understand the basic tax laws. If you are not sure what to do, it is advised to talk to a tax specialist in order to help you save enough tax out of your paycheck.

cons of working as an independent contractor

One of the big things is that contractors aren’t eligible for any type of health or unemployment benefits because you are basically self-employed. So if you need health insurance, you would have to find something on your own that you could pay per month. Now you see why being an employee has its benefits when it comes to taking care of taxes and health insurance. You can still do all this stuff on your own, and it’s not impossible to get your own health insurance, but all that stuff takes time to keep track of.

It should be noted that if you are a US Yukon project rater then you’re a part time employee and your taxes are done for you. There still are other projects that are done on contract basis.

Knowing your taxes and how much you need to deduct is the most important part. As long as you keep enough money to cover taxes then you won’t have to pay anything. The biggest problem here is not withholding the right amount or not enough taxes. A single person in the USA will pay more taxes than a married person will. So it’s important to know exactly what you should be deducting from your pay.

For the USA you must take out self-employment taxes which are Social Security and Medicare contributions.

things that can help you with tax issue

There are some tax calculators online that can be used to accurately deduct the correct amount of money in taxes, including the self-employment taxes. That money should be kept in a separate bank account always so that if anything happens with the main bank account, that money is safe. So create a savings account and put that money into the account and don’t touch it until the end of the year when it’s time to do taxes. It is important to remember that it’s better to save too much than not enough.

When it comes time to do your taxes, it might be good to hire someone that can put together everything for you including your business deductions such as your office equipment or computer that you use to do your work on. There are some limits of course on what you can deduct. Find out exactly what you should have paid and make out a check and send it to the tax government in which you live. In the USA it’s the Internal Revenue Service.

As an independent contractor you won’t pay less or more taxes than if you were an employee. The only difference is that you have to do all the paperwork yourself. However, you are able to take more physical deductions than an employee would because you provide yourself with all the tools you need to do your job on your own.

In closing, it shouldn’t scare you to do your own taxes. It’s not any more difficult than doing your taxes as if you were an employee, and you might actually get the tools you need to do your job for free.

Appen Falcon Typeahead Project

Appen Typeahead Project 

This article goes over the guidelines of the project at Appen called Typeahead e2e. This project is somewhat the same as being a search engine rater and rating queries and results, but you are rating queries for Facebook and their website search engine. They may be trying to get this search engine as tuned as Google, except it’s based on their platform. Facebook is considered a family website, and they are trying to make sure that none of the bad stuff gets through. The main purpose of the job you perform is to detect low quality suggestions, and the ratings tasks are mostly based on your own point of view, which is unusual for a project of this type.  

Appen Typeahead e2e – requirements and payment rates 

E2E stands for ‘end to end’ but that seems irrelevant at this point. In order to work on this project, you must have a Facebook account. The project has a work volume from 1 to 4 hours per day. This is the usual amount of time on Appen projects. The pay range for this project depends on where you live, but it can range from $6 an hour to $14 an hour. This project is exclusive of Appen and runs in many markets. 

Typeahead e2e Qualification  

Qualification process is straight-forward, before proceeding with actual exam you will be given a chance to do a practice test which consists of 20 tasks and covers all possible rating scenarios. Once you complete the practice set you will receive feedback and recommendations on your ratings. The next step will be actual exam which also consists of 20 tasks. If you pass this exam successfully you will be moved to production. 

Typeahead e2e working process

Typeahead are queries that are given with suggestions when you type something in the search box on Facebook.  

The search Typeahead provides suggestions, and it’s your job to see if the suggestions are relevant, or if suggestions are bad. There are a lot of different things that can make them bad. You might recall that Google at one point had a big problem many years back when Google ads were coming up with some violent and hateful content that caused them to lose some advertising with big names. It wasn’t until this happened that Google wanted a real human to look at what ads were being displayed, and what websites were providing as far as search content. The same thing is happening at Facebook and they want to make sure that people are not getting bad results with violent, offensive, hateful, or pornographic content. That is where the human rater comes in, and it’s your job to determine if the results are good or bad, or if they should be flagged.  

As mentioned previously, the workflow of this project is to determine the quality of suggestions in the search bar drop down. There are some things that the guidelines go over. 

You are presented with a list of categories when doing the search. You make a decision based on what the results are. You would follow these labels and determine what is acceptable and what is offensive/porny (cute new word that Appen or Facebook apparently made up), junky, or acceptable.  

It is important to remember that you are rating the quality of the suggestion, and not the quality of the query. Quality doesn’t have anything to do with the query. The query should be looked at to determine if it’s in a foreign language other than the language you are contracted to work in.  

Furthermore, a suggestion should be rated 1 if it is offensive, violent or porny, such as “hot girls”, “sexy videos”, etc. The suggestion, at first glance, needs to be obviously offensive or seeking offensive material.  

You need to remember that you are not rating the results generated by the Facebook search engine but the suggestion itself. Many common names may generate pornographic results (ex.“mary ann”) but should not be rated as offensive. If it’s junky, then it is because the suggestion is unrecognizable and, most importantly, you think the suggestion is junky/gibberish. Junky entails the suggestion is difficult to understand or is entirely nonsense. If you rate the suggestion as junky, you would then choose a category to support your decision.  

A suggestion gets a 3 – Acceptable if it is not junky. This is considered a good suggestion which doesn’t contain foreign language or anything offensive. It is spelled correctly and free of grammatical errors. If a suggestion is rated acceptable, then it must receive an additional rating to indicate whether it is personally recognizable to you. This is a weird task, because you wonder how it can be acceptable if it’s not recognizable. They clear that up by saying ‘The suggestion is UNRECOGNIZABLE based on your own point of view but still makes sense’. They say that you can use Google/Bing to determine if the suggestion is acceptable or junky. But once again, the rating is based on your own personal view.  

The job itself doesn’t look very hard, and the work flow should go pretty fast since you only have to choose from 4 different categories, and then choose a label from one of those 4 categories. There are a lot of examples in the guidelines that show you what to do in certain cases in case you are unsure of what to select.  

It is interesting to know what this will end up doing to the Facebook pages that rely on certain words that are brought up. Some searches may end up disappearing from the suggestions at all.  

As always, if you have any questions about this project, or you are working on this project, leave us a comment and tell us how it’s going.

Payoneer As a Payment Method for Appen, Raterlabs, Lionbridge and Utest

Appen Acquires Leapforce in Multimillion Dollar Deal: What Are Potential Risks for Current Leapforce/Raterlabs Contractors?

About the Deal

In what might not come as a surprise to many, Appen, the language and search data service provider has made a move to acquire its US-based competitor ‘Leapforce’ for an estimated $105.3 million dollars. Leapforce was founded in 2008, headquartered in Pleasanton, California, and specializes in search relevance through a highly automated and proprietary end-to-end technology platform, which of course is Raterhub; the tool used by search engine raters to rate search engine results. It is a move that will make the company a leading provider in search data services. Mark Brayan, Appen company CEO said that it gives Appen the capability to serve their customers better. This deal comes after Mr. Brayan and Leapforce CEO, Daren Jackson, met a couple of years ago and remained in touch and formed a friendship. About six months ago, Mr. Jackson reached out to discuss a potential deal as both acknowledged at some point that the businesses would be better working together instead of against each other.

The Acquisition is subject to customary conditions precedent and is expected to complete on or around 7 December 2017. Appen’s existing customer base consists of, amongst others, a number of large global multi-national technology companies. The projects awarded by these companies, or the ongoing services which Appen may provide to these companies, can generate large amounts of revenue from that one client. The same is true for existing customers of Leapforce. However, and not surprisingly enough, Leapforce generates 99% of its revenue from only two customers, in the approximate proportion of 71% revenue from one customer and 28% revenue from the other customer. We’re guessing that these are both Google, and Facebook.

This brings up questions such as the acquisition of those contracts, or how Google feels about this merger of the two companies. The existing CEO and CTO of Leapforce, Daren Jackson, will join the Appen management team and will continue to manage the Leapforce business going forward. Leapforce is heavily dependent on the CEO who has the key relationship with its major customer and is key to the operations and service delivery of the Leapforce business. This of course means Google. Leapforce has only about 21 full-time staff, all of whom will be joining Appen.

What Are Potential Risks for Current Leapforce/Raterlabs Contractors?

The biggest question about this merger is finding out what exactly what will happen with Leapforce independent contractors. One of the risks that was mentioned in the acquisition merger was as follows:

“Some of the Appen Group’s search relevance and data analytics services are crowdsourced to, and often performed by, independent contractors. This is also the case for the Leapforce business. The independent contractors performing these services are retained pursuant to written agreements with a member of the Appen Group that commonly specify the individual’s status as an independent contractor, confirm the individuals are not employees of the employing company, and require the individuals to indemnify the employing company in the event the individual incorrectly represented their status to the employing company.

So if you are a Leapforce independent contractor, then you might have to sign new agreements with Appen after a certain time. And for the time being it looks like your job is secure, but its only as secure as it was before. Leapforce can at any time choose not to renew your contract for whatever reasons they see fit.

Or there could be a good chance that Leapforce independent contractors could have their contracts not renewed because Appen has a huge crowdsource pool from which to draw people from. Why do we think this? It was also mentioned in the merger agreement the following as seen as a risk factor for the merger:

“Notwithstanding the foregoing express contractual language, from time to time in the United States individuals retained by a member of the Appen Group as independent contractors may file claims for unemployment with the applicable state unemployment agencies claiming employee status with a member of the Appen Group and seeking unemployment benefits. Leapforce, being a US-based business, enhances this risk. Unemployment benefits are, from time to time, awarded by the US state unemployment agencies, which may result in nominal charges or increases to the employer’s unemployment tax accounts with the various states in which these individuals perform services and in which the member of the Appen Group does not have existing employees. The Appen Group is also subject to the usual risks posed to businesses that employ crowdsourcing, including claims relating to employee classification, claims to benefits, wage and hour claims and other employment claims.”

Of course this is true for any company when they acquire another business. But to be honest, in some markets Appen is known for paying miserable wages as compared to Leapforce and Lionbridge for the same search engine evaluation job. They have even lowered wages in some countries and pay far less than Leapforce did. There really isn’t any regard for the independent contractor in this situation.

And while its certain that all the internal employees were taken care of, as they will also go to Appen with their CEO, it is uncertain what the discussion was about the current raters. In our experience, independent contractors with both companies are simply a number or statistic. As an independent contractor for either of these companies, you are nameless, and you are expendable. This is the sad truth about being a contractor and working for these companies, along with the fact that you’re not really an employee for any company, and you have no benefits at all unless you are an employee.

And outside of this merger, it’s easy to see the behavior that this company takes against the people that help make them money. In some markets, Appen Global reduced their hourly rate for a project known as Aztec. In fact, some raters were hired with a higher starting hourly wage than others. And as mentioned before, in some countries Appen only pays HALF of what a Leapforce rater is paid.

It will be interesting to see what happens with the current independent contractors who work for Leapforce and whether they retain their contracts. One thing that is uncertain is if Appen will be calling the shots on the current Leapforce raters, or if Appen will take over and get rid of the ones that are paid more so they can take from their talent pool those who are paid far less for the same job. Regardless of the outcome, we feel that there might be a lot of raters who will end up losing their jobs in the mid or long term. After all, Appen Global doesn’t really care about the little guys who actually do the work. They seem simply set on cornering the market by acquiring their competitor, and then paying people lower wages for the same job.

If you are currently a Leapforce search engine rater or Raterlabs rater, leave us a comment and let us know what you think about the merger, what has been shared with you. We’d like to hear from you.


What Should You Do If You Fail Appen Yukon or Lionbridge Internet Assessor/Internet Safety Evalutor Exam Twice and How to Re-Apply?

If you fail the exam the second time, Appen and Lionbridge will not allow you to retake it a third time (in some cases vendors may give the third attempt). In this case I would advise that you apply to another vendor like Lionbridge (or vice versa). 

Option 1: re-apply from your own PC 

Before proceeding with application you will need to clean your devices from the data left from unsuccessful exams.

      1. Sign out all Gmails associated with your unsuccessful attempts (make a complete sign out on a laptop, PC and your smartphone) and to be on the safe side, re-install your chrome browser on your PC;
      2. A new IP address will be required. You may use a residential VPN to change your IP address. Do not use normal VPN if you are going to apply for Lionbridge, use only a residential VPN. It is VERY easy to know if you are using a regular VPN. As an option you may change your Internet provider or if you have a dynamic IP address then no action is required at this stage;
      3. Create new gmail;
      4. Proceed with application as normal.Once you have started the application and qualification process, I recommend you keep the same IP address during the whole process. If you need to, later on you may change your IP as many times you want.

Note: I would like to point out that Lionbridge is very strict in terms of IP address. The vendor prefers to deal with applicants who have a residential IP address, but it depends on your country. 

Option 2: re-application on behalf of another person the same vendor is possible

Use someone else’s PC to apply and move the account to your PC once you complete the qualification process. 

Note: Before proceeding with registration, make sure that you use a new Gmail account which previously was not used for application process.

Note: It is very important that when you filling out the application and answering the application questions, you must indicate that you have never applied/worked the search engine evaluator position before with another company. Answering yes to this question will automatically disqualify you.  

Lionbridge Unsuccessful Application

There might be many reasons for the rejection of your application. These are some of the reasons: 

It might be possible that your CV does not meet Lionbridge standards. Lionbridge is very selective in terms of quality of CVs of applicants in India and other developing countries.Make sure that you CV looks professional and accurate and there are no gaps in your experience.  

Your IP address might be suspicious, or does not meet Lionbridge requirement. If you have a dynamic IP address (an IP which changes each time you connect to the Internet) – you will be rejected for sure. Make sure that you have static IP address. One way to check is to ask your internet service provider.  

Someone is using the same IP address for a rating project (in the case of sharing an Internet network connection), make sure that your IP address is unique. 

And finally, try to arrange new IP addresses, update your CV, create new Gmails, and apply one more time. If possible you might need to find a person you can trust, like a friend or family member, and apply on behalf of them. It could be a possibility that your name is blacklisted in the vendor database.  

Unable to enter IP address into the Lionbridge exam. What are the reasons?

Some candidates receive from Lionbridge email saying that “we were unable to enter you into our Online exam. According to our checks it appears that you have the same IP Address as another person in our system”.

It can be possible that the vendor was unable to enter your IP into exam because you have dynamic IP address. It might be very risky to have this type of IP address because it means that many people have the same shared IP address. Some internet service providers put a group of customers on the same IP address behind a NAT. This could be a problem and may lead to getting flagged for multiple accounts being used on the same platform such as raterhub.  

Violating terms of contract regarding multiple accounts including IP/Network sharing and using public networks for work

It is prohibited to have multiple accounts with Leapforce and Lionbridge. These companies can find duplicate accounts very fast, and as a result, you will lose both accounts. The good news is that you can combine work at Leapforce or Lionbridge and Appen Butler Hill.

While working as a search engine evaluator, make sure that you have your personal unique IP address and no one uses the same IP to go online and work on for these companies. If you have two or more people in your household, it is advised to get two unique IP addresses, and you can do this for an extra charge with most internet service providers.

How to Pass Appen Raterlabs (Yukon) and Lionbridge (Internet Assessor & Internet Safety Evaluator) Exams?

How To Apply for Search Engine Rater and Social Media Evaluation Jobs at Appen and Lionbridge

Seacrh Engine evaluation jobs Application process – Where to start?

Sometimes finding these types of jobs online takes a bit of research. Most of the big companies that offer these types of jobs don’t usually advertise in common places or online job boards. You usually have to go directly to the company and apply on their website. I have seen that Appen Global advertises their jobs on Flexjobs.com, but that website charges a monthly fee. I never quite understood how a company can charge you to find a job, but they are the exception.

Finding these jobs and applying for them are different for each company. Going to each individual website is the best way, as long as you know where to go, and how to apply. With that being said, this article, and the videos we have provided, will show you how to find the work from home jobs.

One of the other important things to consider when looking for these types of jobs is your location. Some of the contracts that are offered through companies like Appen and Lionbridge require you to live in the demographic area that the project requires itself. The reason for this is because the data from different regions will be different depending on location and the language.

Before you begin to apply for these jobs, or really any job for that matter, it’s probably a good idea to go over your resume and make sure it’s up to date, and that it includes only the important information that is necessary. It might also be to your benefit to have your resume checked by a professional. The resume experts at Resumewriters.com is an awesome service that I have used in the past, and having your resume edited or corrected by a professional is a sure fire way to get noticed and get you the job you want. Many of our readers have had very good results with them.

To visit their website Click Here: Resumewriters.com

Another important note is that if you have worked previously on other social media projects with different companies, don’t mention this on your CV/resume. The two most important factors about this are that you do not need previous experience for these jobs. And second, if you have worked on these types of projects before you will most certainly be looked over and turned down for similar projects. The reason for this is uncertain, but we have seen other people turned down because of this.

You can work on two different projects for more than one company. However, you need to use a different IP address for one or the other. So if you work for Appen and want to work on another project with Lionbridge, you will likely need a different IP address. Appen seems to be the only company that records an IP address and this is shown in the backend or the portal of the work dashboard. This is why it’s a good idea to use a separate IP address for another project. It might also be a good idea to use a different email between companies when applying for and working on these jobs.

Projects and Vendors Compatibility: How to Work on Several Projects and Do Not Violate Vendors Conditions? How Much Can You Earn With Lionbridge and Appen When Combining Several Projects?

Some advice when working on different projects so that you don’t overwhelm yourself is to get some experience working on one project with a company before trying to get another contract with a separate company. Most of these contracts are part time. So its beneficial to have more than one project at a time if you can handle it.

A really important thing to note here is that you can only have one contract per IP address when it comes to these companies. So if more than one person is working for any of these companies, it is important to have a separate IP address. You can usually order another IP address from your internet service provider for about $4-5 per month extra. Check with your ISP to find out if you require more than 1 IP address per household. You can read more about this in FAQ

Application process at Lionbridge – Ads Assessor, Internet Safety Evaluator, Ads Assessor 

Lionbridge search rater project is called the Google rating project (ads assessor, internet safety evaluator, ads assessor) which is the same as Yukon at Appen (Raterlabs). They also have the positions of Personalized Social Media Assessor, Personalized Internet Assessor, and Personalized Web Assessor.

Application process at Appen – Search Engine Evalutor, Rater, Internet Analyst 

At Appen/Raterlabs you would apply for search engine evaluator position first, and then based on project availability, you would get invites for Yukon, Nile, (Facebook social media evaluator) Truckee or Shasta projects. You can work on more than one project at a time.

Appen Global

Many of my readers will be interested in how to get invited to other projects at Appen Global. Appen Global offers a lot of different types of projects that you are able to work on. Unfortunately, is not likely that you would be contracted to start on projects such as the Thunderbird music project from the beginning. You would be more likely to start on a larger project first such FalconInstaAds or the Arrow project. Once you have started working at Appen, and you are on a Falcon project, like any of the social media projects that they offer, you will likely get an invitation to start on other projects as well. The more you work, and the better your performance is, the more offers you will get from Appen.

Those projects include:

Arrow (ads assessor);

Yukon (search engine evaluator);

Nile/Truckee Facebook/Instagram ads assessor projects (social media evaluator).

application process video instructions -Lionbridge, Appen, Appen Global

We thought it would be a good idea to create some quick walk-through videos to show you how to apply for these jobs and the different companies. Some of these:

Lionbridge, go to http://www.thesmartcrowd.com/workers/job-opportunities/country/russia/#jobs-list

Appen, go  to https://connect.appen.com/qrp/public/jobs/list

Appen Global go here: https://talent-appen.icims.com/jobs/intro

How long does take to hear back from Lionbridge and Appen?

It depends on many factors, sometimes immediately, and sometimes it can take 3-4 months.

It might be that at the moment of your application submission, quota of raters for your country was reached and therefore Appen or Lionbridge does not hire new rater at the moment. As soon as they fire unsuccessful raters, they continue hiring new people to maintain the required number of raters in your country.

Hermes – Netflix subtitles project

So what is Hermes? Hermes is a system devised by Netflix to test the capabilities of prospective freelance translators wanting to work remotely for them. Netflix is hoping to solve the problem of generating high-quality subtitles and translations by creating Hermes. Hermes was also likely created because other vendors weren’t paying their translators well enough for high quality. The Hermes project is all about high quality. Netflix doesn’t want to waste their time for incorrect or bad subtitles or translation.

Anyone with multi-language capability can become a translator for subtitling, but your quality has to be nearly perfect in order to be considered. So the first thing you will need to do is pass the test. It can be difficult depending on your language ability and how good your typing skills are. Translating can be a tough job unless you are absolutely fluent in the language you are translating for. It might be a good time to mention here that you don’t need to be bilingual to get a subtitle job with Netflix. There will always be a need to have subtitles in your own language, such as English, for those who are deaf and rely on subtitles to understand a movie. But, those types of subtitle jobs will be harder to get because many people can transcribe, which is simply writing down what you hear in that language using the same language. Timing becomes a huge factor as well. You don’t want to input subtitles too early or too late when the dialog is spoken. Can it be a tough job? Yes, but again it depends on your abilities.

So what is the process to get started? The first thing you need to do is register with the site here: https://tests.hermes.nflx.io/

Once you have completed the application forms, you will be sent a text message with what is called your unique H-number and a unique URL. Make sure you don’t lose this number because you are going to need it to log into Hermes platform. You will perform the test on your computer. You want to be sure you have a good broadband connection because you’re going to be streaming video content, and when you are writing subtitles, this is important. They recommend no less than a 20Mbit speed. Start by opening the link on your computer and login with the phone number, and your H number. You will then be taken to the Hermes admission test. This is what you will see:

^A99AFA515DD6AB6A60A25F1D96081925E8ADF981EC1206D385^pimgpsh_fullsize_distr

There are 5 different tests or phases as they are called. It will take you about 90 minutes to complete all 5 phases.

Phase 1 gives you a time limit of 10 minutes and this test starts out by testing your understanding of English phrases. It has 15 multiple choice questions, and you need to select the correct word to complete a sentence, select the correct meaning of a word or a phrase, or choose the sentence with the correct grammatical structure.

Phase 2 has a 10-minute time limit and also has 15 multiple choice questions as in the first phase. The only difference in this phase is that you are asked to select the correct answer from a list of options. This is done in the target testing language.

Phase 3 has a 15-minute time limit. You will be asked 10 different questions based on 10 short video clips. Choices for answers will be in the target language you applied for. Each clip can be replayed as many times as you need but keep in mind your time limit.

Phase 4 is a technical phase moving away from the translation part of the job and focuses on technical aspects of subtitling. It also has 10 video clips as the previous phase. This part of the phase tests your working knowledge of timing, punctuation, and line breaks.

Phase 5 The last phase has a 40-minute time limit per clip in which there are two clips provided. You are asked to watch the clips and translate the dialogue into your target language. So if the clip is in English, and your target language is German, you will translate English into German. The original language subtitles will be provided on the left side of the dashboard. This will help with your translation that you will enter on the right hand side.

Once the 5 phases are completed, the phases will disappear, and a banner will show the status as completed. This is the same place the results will show up and you may have to wait 10 business days to get the results. The phases are graded by an actual administrator, so it can take some time to get the results.

There are some things to take into consideration before doing this test. There are some languages that are more in demand that others. For example, as I previously mentioned, English subtitling from English source will be more difficult to get than if you speak two languages. If you are not proficient in the target language you choose, you will not likely pass some of the phases. The languages that are more in demand than others are Korean, Arabic, Japanese, Swedish, and Danish languages. Keep in mind that there is likely higher score thresholds for languages such as English, Spanish, or Portuguese. The type of pay can range anywhere from $1 per minute to in some cases $6 per minute if you are proficient and the language you are targeting is a more desired language.

Having a bad internet connection is going to work against you. So make sure you check your speed and make sure you can get at least 20Mbit download speed. You may also need to invest in subtitling software as I have read its required for this job. So you are going to have some other out of pocket expenses.

In closing, doing subtitling or translation can be profitable through Netflix. But if you are applying for this type of job, you should probably already have some experience, and the correct software needed for this type of job. If you already have experience and everything that is required, then you will likely find that Hermes is a good fit for you.

As always, we welcome comments and questions, and don’t forget to hit the forum for discussion on other projects.

Useful links:https://media.netflix.com/en/company-blog/netflix-is-looking-for-the-best-translators-around-the-globe

Maps Analyst Projects at Lionbridge and Shasta Project at Appen

Apple-Maps-IconWe’ve got some new information to share about a position called the “Maps Analyst” at Lionbridge (Codenamed: Shasta project at Appen. It should be mentioned that the recruitment process for this project normally lasts a very limited period of time (at Lionbridge), and usually 1-2 months during different months depending on the country. However, the Shasta project could be available at any time. 

 The project involves evaluating online mapping, and routing related tasks in order to improve content and accuracy of map service: Apple maps.

Raters are required to conduct research, and use online tools to investigate the geographic accuracy of tasks. Work is provided to you as a list of tasks through an online work platform, which is somewhat like raterhub. Most of tasks will be in the language related to the position that you applied for. For example, if you applied for the French role, then you will be rating in French etc. You will also be required to provide comments/feedback in English. 

Map Analyst & Shasta Project Payment and working hours

This project is paid on a per task basis. You need to keep track of the amount of tasks, as well as the type of tasks completed on a day-to-day basis. This information is used to generate your invoice on the billing dates. The payment rate per tasks depends on your market, including the complexity of each task, and payment may vary from, $0.22 to $1.00 per task. Since you are working in a freelance independent capacity, you can manage your working time as you like and work whatever times you want. But this is a part-time job, and the number of hours you can accrue is set at a maximum of 20 per week. You must not exceed the maximum of 20 hours per week unless authorized. Lionbridge expects new Map Quality Analysts to be active and to participate each week. 

 Project compatibility

This project is fully compatible with any other projects at other vendors. You are not allowed to work on another project at Lionbridge, although you are allowed to qualify on another projects if your vendor is Appen. 

Maps Analyst/Shasta project qualification 

In my opinion the qualification process for this particular project is quite difficult if you compare it with other projects. First, you need to study and understand 200 pages of guidelines and instructions within a limited period of time, and then complete a 2 stage exam, which consists of theoretical and practical parts, within 10 days. As with any project, you should read the Guidelines as many times as you can before you start working. There is a lot of information in the guidelines so you may want to read them multiple times. You should also use them while working, and refer to them to ensure you are applying the correct rating. There is no chance to pass this exam without getting a profound understanding of the rating rules and concepts. 

Exam Preparation Approach (Maps Analyst and Shasta project exam)

Lionbridge has very good exam support so candidates should use this to their advantage as much as possible. It is highly recommended to use the below approach in order to increase your chances of successfully passing the exam: 

  1. Read the Guidelines thoroughly and understand them
  2. Read/watch the content on the Pre-Exam Support Portal
  3. Complete the Sample Exam Questions

Completing sample exam tasks will help you understand what kind of exam tasks to expect. A typical maps analyst task is a query; address, chain/organization, point of interest, and a list of results generated by the map service based on user location, user view port, and type of query you will need to provide:

  •  Relevance rating (taking into account distance/user intent issue) 
  • Keep in mind that distance ratings are variable ratings which depend on query type (type of business), user location, area, etc. So each case should be evaluated individually in terms of proximity and distance, that is why there are no specific criteria for distance
  •  Name accuracy (you always need to check name accuracy on official website of organization) 
  •  Address accuracy (check all components of address on official website/UPS ZIP code look up website) 
  •  Pin accuracy (apply rules as per guidelines) 
  • The pin location, name and address accuracy do not affect the relevance rating. If the result meets the requirements for a navigational rating then you should go for it. Relevance and the pin location, name and address accuracy are independent ratings

Finally, you will provide comments if your relevance rating is below good. This just a general overview of typical task/algorithm however it gives a good understanding what kind of tasks to expect in this project. 

Maps Analyst Exam Task

 It is very important that you thoroughly research the query, and the result in every task you are rating. In order to establish the correct rating, you need to understand the query, and you also need to verify that the information returned in a result is correct and accurate including the name, address, location, existence, popularity etc. In order to determine if the information is true, use official sources wherever possible. Include links in your comments whenever you find out that the task returned incorrect data. To determine popularity, you will need to check reviews on reputable sites to decide on the most accurate rating to apply. You do not need to include a comment for every rating, but comments are mandatory for any rating below Good for relevance or below Correct/Perfect for data accuracy. 

  • Reference Guidelines – If you are demoting because of a guideline intricacy, it is useful to reference the guideline/rule that influenced your decision.
  • Be Concise – Don’t waste time writing elaborate comments, be specific and efficient with your comments.
  • Comment in English Only- Your comments will sometimes be reviewed or used by those who are not very familiar with your locale or its language.

As mentioned before you will be given 7 days to complete the exam. The theoretical part will consist of 20 questions which are entirely based on the guidelines. I think this part won’t create any problem because answers to most of questions can be found in the guidelines, average estimated time for completing this part of the exam is 1 – 2 hours. 

 Part 2 is the most difficult part of the qualification, some of the tasks are really difficult, and will require a high level of attention, the ability to apply rating concepts, and analytical thinking. In total you will be asked to rate 20 tasks, but in fact there more tasks because some of them are complex tasks which have a list of results that have to be rated. You will be given almost all types of results to rate (chain, address, transit, POI etc.) So be careful to research and examine each case step-by-step. Keep in mind that only one attempt to pass this exam is allowed. If you need any tips or further information, do not hesitate to contact me.

Shasta (Maps Analyst) Project Exam TUTORING AND ASSISTANCE

If you are not confident about going through the Shasta (Appen) or Maps Analyst (Lionbridge) qualification exam , you may always get my expert assistance, support and advice. For detailed information please write to allentim87@yahoo.com

 Maps Analyst Exam results 

Once you complete this exam within 2-3 days you should expect exam results and a welcome email containing information about access to the supplier and project portal. You also will be given a login and password to the rating tool where you will do your production. 

Project workflow

When you start working, the process will be more smooth because you have already gained a conceptual understanding of the work during testing, plus most of tasks will be in your local language. It is recommended that 2 minutes be taken to rate each task in order to complete your research accurately. Please note this is an average. Some tasks may require more time, while others may require less time. Tasks can be made available any day of the week, at any time of the day. There is no specific time when tasks are launched. If you don’t see tasks, then you will need to check more frequently to see if new tasks have been added to your queue. 

How Social Media and Search Engines Use Human Raters in Improving Online services?

o-BIG-DATA-facebookThere is a lot of information here about the different kinds of jobs that a rater does for companies such as Appen Global, Lionbridge, and Leapforce. And over the past year or so, there are a lot more jobs than just your average rater job. There are even more types of jobs now than before. Everything from recording your voice for voice recognition applications, to social media evaluation. What isn’t generally talked about it the process and what you are actually providing as a service.

What it mostly comes down to is data. In reality, most of these jobs are simply data collection. Facebook, Instagram, and Google all require some type of data collection in order to create programming for their algorithms. Most of you who work for these companies probably don’t realize what it is that you are providing. In fact, your job is a lot more important than you think.

Google was always at the forefront of providing the best user experience for its searchers or users. And many people think that it is just their algorithm that does all the work. But no one really knew until recently when the Google Guidelines were leaked online that humans actually had something to do with it directly. As a rater, you are not actually rating the website, or giving the website you are looking at, a grade. Instead, you are using the guidelines written by Google engineers, to give the algorithm its data.

The data that you return for doing rating is actually fed to the algorithm where it judges and grades websites based on the real world interactions through raters. It is often thought that the job you are doing is actually affecting those pages and ads that you see. In a way, you are affecting them, but not directly. It is only by the data you collect that will affect websites, ads, and services in the long run once the algorithms are programmed using your data.

The same can be said for Facebook and what some of the social media evaluation jobs do. For instance, the Falcon Video Recommendations program had guidelines that were written so that when raters were looking at videos, the algorithm would know what to do concerning video’s and the content of those videos, whether they were helpful, if they should be flagged, and why they didn’t meet any quality expectation. Facebook ads also have an algorithm which is programmed by the engineers from the resulting data collected from raters. Instagram is no different. This company needs real people to rate and check ads so that its algorithm can be programmed. The videos were judged on how relevant and interesting they were, and why the videos were interesting or not. It is the information that was given on what made a good video good, or a bad video bad that was the most important data needed.

This becomes valuable real world data in which future guidelines and algorithms can be programmed. But once again, when the guidelines will change, the data needed will also change.

This is the main reason why you see some projects come and go, and why some are continual projects. Once one project has enough data, the algorithm is programmed and data collection stops until more data is needed or they make some changes in any general guidelines. Anytime changes are made in guidelines, raters or data collectors are once again needed to evaluate the current content being put online by advertisers, website builders, or even people who run Facebook pages and ads.

Some other types of projects that include the collection of data are voice recognition applications where you get a project that asks you to record your voice saying certain commands. Once enough voice data is collected, the product is programmed and tested. Some of these projects can be very interesting and I’ve seen a lot of them being offered by Appen Global as part of the talent pool network.

All these companies have one thing in common. They seek to improve their user experience. They can only improve the experience by having real world testers or raters look at the actual content, and rate the content based on the carefully crafted guidelines. This data definitely improves services and ads for the best user experience possible. Google, Facebook, and Instagram know that it would be impossible to create this experience without its social media and website raters.

How does Google use human raters in web search?