Arabic Annotation Specialist

About this role

You will review AI-generated Arabic and English responses and/or generate high-quality bilingual training content, evaluating reasoning quality and step-by-step problem-solving while providing expert feedback that helps models produce answers that are accurate, logical, and clearly explained. You will assess solutions for accuracy, clarity, and adherence to the prompt; identify errors in methodology or conceptual understanding; fact-check information; write high-quality explanations and model solutions that demonstrate correct methods; and rate and compare multiple AI responses based on correctness and reasoning quality. This is an hourly paid, fully remote contractor role with flexible work-from-anywhere hours. This job is with SME Careers (a subsidiary of SuperAnnotate), a fast-growing AI Data Services company providing training data for many of the world’s largest AI companies and foundation model labs—your work directly helps improve the world’s premier AI models.
 

Your Profile

• Bachelor’s degree (or higher) in Linguistics, Translation, Arabic Language, Communications, Journalism, or a related field.
• Native or near-native Arabic proficiency with strong writing and editing skills across Modern Standard Arabic and at least one major dialect (Egyptian Arabic preferred).
• Minimum C1 English proficiency (reading and writing) for bilingual evaluation and instruction adherence.
• 3+ years of professional experience in translation, localization, editorial QA, content quality, or linguistic review (or equivalent).
• Excellent attention to detail and ability to apply detailed rubrics consistently in high-volume, hourly contractor work.
• Strong fact-checking habits and comfort validating claims using reputable sources when required by task guidelines.
• Ability to identify reasoning gaps, methodological errors, and unclear explanations—even when language is fluent.
• Comfort working independently in a remote, asynchronous environment with reliable availability and communication.
• Prior experience with AI data training, annotation, or evaluation workflows is strongly preferred.
• Familiarity with Arabic localization conventions for MENA (terminology, formatting, cultural nuance) is preferred.

Key Responsibilities

• Develop AI Training Content: Create detailed prompts in various topics and responses to guide AI learning, ensuring the models reflect a comprehensive understanding of diverse subjects. (English proficiency required: Minimum C1)
• Optimize AI Performance: Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance. (English proficiency required: Minimum C1)
• Ensure Model Integrity: Test AI models for potential inaccuracies or biases, validating their reliability across use cases. (English proficiency required: Minimum C1)

Skills & Technologies

Arabic, English, Modern Standard Arabic, Egyptian Arabic, Localization Linguistic quality assurance, Terminology management, Fact-checking, Style guide adherence, Research, Writing