Rater Labs operates in the same space as Appen and Telus International — providing human evaluation services to major tech companies — but is less well-known. That relative obscurity means less worker competition and, sometimes, more available tasks for those who get in.
What Is Rater Labs?
Rater Labs is a data annotation and evaluation company that serves as a vendor for large tech companies requiring human judgment on AI and search systems. The company runs projects across several categories:
- Search Quality Evaluation: rating the relevance of search engine results
- UHRS Tasks: Microsoft's Human Relevance System tasks (similar to what Clickworker offers)
- Content Moderation: reviewing content for policy compliance
- AI Response Evaluation: rating the quality, accuracy, and safety of AI-generated outputs
Much of this work runs through UHRS, which means the task interface and guidelines will be familiar to anyone who has worked UHRS tasks through Clickworker.
Application Process
Step 1: Check for open positions
Go to raterlabs.com and check the careers or "Work with Us" section. Positions are listed by region and language. If nothing is listed for your area, register your interest through the contact form.
Step 2: Complete the qualification questionnaire
A short form collecting your background, language proficiency, and work availability. This determines whether you advance to the assessment stage.
Step 3: Take the assessment exam
Depending on the project type, you'll be asked to evaluate sample tasks against a guidelines document. For UHRS-based projects, the guidelines are detailed — read them fully before taking the exam.
Step 4: Wait for onboarding
Approval typically takes 1–3 weeks. Once approved, you'll receive access to the task portal.
What the Work Involves
For the most common project type (search evaluation):
You're shown a search query and a set of results. Your job is to rate how well each result satisfies the query, using a defined scale (usually Excellent / Good / Fair / Poor or equivalent). The guidelines specify exactly what earns each rating.
Tasks take 2–5 minutes each. Experienced raters complete 12–20 tasks per hour.
At $14–$16/hour effective rate, a 2-hour daily session generates $28–$32.
Pros and Cons
Pros:
- Higher pay rates than Clickworker standard tasks
- UHRS task access (Microsoft projects)
- Less saturated with applicants than Appen
- Work from anywhere, flexible hours
Cons:
- Availability outside the US/UK/EU is limited
- Task volume fluctuates (project-based)
- Application takes 1–3 weeks
- Not all regions currently accepting applicants
How Rater Labs Compares
| Platform | Hourly rate | Approval time | Availability |
|---|---|---|---|
| Rater Labs | $12–$17 | 1–3 weeks | Variable |
| Appen | $9–$15 | 1–4 weeks | Variable |
| Telus Int'l | $12–$18 | 2–4 weeks | Moderate |
| Clickworker UHRS | $8–$15 | 3–7 days | Variable |
Rater Labs sits comfortably in the top tier of micro-task pay rates. If you're eligible and can pass the qualification, it's worth applying alongside Appen and Telus.
Is It Worth Applying?
Yes, if:
- You're in the US, UK, Canada, Australia, or Western Europe
- You have strong English reading and reasoning skills
- You can read long guidelines documents carefully
- You're already applying to similar platforms (Appen, Telus) — add this to the list
Less compelling if:
- You're in South or Southeast Asia (availability is inconsistent)
- You need immediate income — the application and approval take time
💡 Earn while your Rater Labs application is being reviewed Evaluation platform applications take 1–3 weeks. NexGuild tasks are available the same day you sign up. 👉 Start Earning on NexGuild Today
