Rubric Grading Expert

Rubric Graders – Generalist Evaluators for AI Projects

Role Overview  Seeking highly analytical generalists to contribute as rubric graders for a leading AI research initiative. This project supports the evaluation of AI-generated content across multiple domains, ensuring accuracy, coherence, and alignment with task-specific criteria. Contractors will apply structured rubrics to assess outputs in fields such as humanities, STEM, business, and general knowledge. This is a flexible, short-term engagement ideal for intellectually curious professionals with a strong academic background.

Key Responsibilities

Apply detailed evaluation rubrics to assess AI-generated responses

Analyze outputs for factual correctness, clarity, and domain relevance

Work across diverse subject areas and adapt to evolving task requirements

Maintain high accuracy while completing a high volume of evaluations

Follow written instructions precisely and provide concise feedback when needed

Ideal Qualifications

Strong analytical and critical thinking skills

Exceptional attention to detail and reading comprehension

Proven ability to follow structured guidelines without deviation

Comfortable working independently and across unfamiliar subject areas

Master’s degree or higher, or undergraduate degree from a top global university

More About the Opportunity

Remote and asynchronous — set your own schedule

Expected commitment: ~40 hours/week

Short-term project with potential for extension or future engagements

Contractors must have access to a reliable internet connection

Compensation & Contract Terms

$40/hour, depending on experience and location

Independent contractor status

Weekly payments via Stripe Connect

Application Process

Submit your resume to get started

Complete an AI interview and complete a Google Form

 Will follow up with next steps within the next 24 hours