You are viewing a preview of this job. Log in or register to view more details about this job.

Freelance Generalist AI Reviewer

Uber
Email

Freelance Generalist AI Reviewer

Uber AI Solutions is Uber’s marketplace connecting skilled freelancers with Generative AI researchers and product teams working on cutting-edge AI systems. We partner with independent contractors to support large-scale model evaluation, alignment, and quality initiatives.

We are seeking analytical, detail-oriented reviewers to evaluate AI-generated responses across a broad range of general knowledge and Generative AI (GenAI) topics. In this role, you will assess model outputs across multiple quality dimensions, including truthfulness, completeness, and insightfulness, helping ensure AI systems meet high standards of accuracy and reliability.

This is a remote, contract-based position offering flexible hours and the opportunity to work on cutting-edge AI alignment and evaluation initiatives.

 

What you’ll work on

  • Evaluate AI Outputs: Review and rate AI-generated responses across general knowledge and GenAI domains.
     
  • Assess Quality Dimensions: Score responses for factual accuracy, truthfulness, completeness, and depth of insight.
     
  • Apply Structured Rubrics: Follow detailed evaluation guidelines to ensure consistent and objective assessments.
     
  • Identify Model Gaps: Flag hallucinations, missing context, or misleading or low-quality responses.
     
  • Maintain Evaluation Quality: Deliver reliable, high-quality reviews that meet project standards and throughput expectations.

     

Project details

  • Schedule: Fully flexible. Work asynchronously from any time zone, provided agreed availability is met (5–40 hours per week).
     
  • Engagement: Long-term engagement with approximately 10,000 tasks available.
     
  • Task Duration: Each task is estimated to take ~25 minutes.
     
  • Location: Remote (United States-based).
     
  • Compensation Model: Task-based pay structure.
     
  • Pay Rate: Up to $30 per successful submission.
     
  • Payment Type: 1099 Independent Contractor, paid through the Uber AI Solutions platform (also known as Scaled Solutions).
     
  • Work Style: Individual contributor with minimal supervision.
     
  • Technology Requirements: Personal laptop required. Platform access, training, and documentation will be provided.
     

 

Who we’re looking for

We’re looking for reviewers who bring rigor, consistency, and strong analytical judgment to AI evaluation work.

  • Native English proficiency.
     
  • Prior experience in GenAI / LLM response evaluation is required.
     
  • Highly analytical with a strong focus on factuality and accuracy.
     
  • Comfortable working independently in high-volume, task-based environments.
     
  • Detail-oriented with the ability to follow structured guidelines.
     
  • Tech-savvy with solid computer literacy.

     

Why this work matters

Your contributions directly impact the quality, trustworthiness, and reliability of Generative AI systems used at scale. By improving how AI models evaluate and present information, your work helps advance responsible AI development and real-world AI performance.