Data Annotator - Video Evaluation (Remote, India / Brazil) at Careerflow.ai

Brazil

ABOUT THE ROLE A US based AI company that is at the forefront of AI research is looking for a detail-oriented and analytically consistent Annotator to evaluate visual and creative content using structured rating frameworks and detailed guidelines. In this role, you will assess AI-generated and real-world media (images and videos) for quality, realism, composition, and adherence to defined evaluation standards. Your work will directly contribute to improving cutting-edge AI systems. This position requires strong visual judgment, structured reasoning, and consistency across high-volume evaluation tasks. ---------------------------------------- WHAT YOU WILL DO * Evaluate visual and media content using structured guidelines and predefined rating frameworks. * Provide clear, well-structured written justifications to support evaluation decisions. * Ensure consistency, accuracy, and attention to detail across high-volume annotation tasks. * Identify quality gaps related to realism, composition, motion, lighting, and overall production standards. ---------------------------------------- JOB REQUIREMENTS * 3+ years of professional work experience * Media/agency experience is mandatory * Hands-on experience working directly with designers, photographers, or videographers (mandatory) * Experience with AI image or video generation tools is a strong plus * Strong understanding of motion realism, lighting, camera movement, composition, and production quality * Strong analytical, logical reasoning, and research skills and excellent communication and collaboration abilities, with proficiency in English. * Incorporate feedback from LLM performance metrics into training data creation. * Ability to commit to 40 hours per week and candidates who can join immediately preferred. ---------------------------------------- REQUIRED QUALIFICATIONS Bachelor’s degree or higher in: * Design, Visual Communication, or Fine Arts * Film, Media, Animation, or VFX * Photography or Cinematography * Architecture or Industrial Design * Creative Writing or equivalent professional experience in content creation, media production, or content review. ---------------------------------------- APPLICATION PROCESS 1. Submit your resume, profile, and questionnaire here on this job description 2. If you are selected, you will receive an Interest Confirmation Form (ICF) 3. An Assessment will be shared after 2-3 days of application. 4. If you pass the assessment, you can start immediately ---------------------------------------- PAY, COMPENSATION, AND FURTHER DETAILS * Pay: $2.5 / hour (Approximately Rs. 40,000 per month for 40 hours per week) * Assignment Type: Independent Contract * Total Number of Positions: 350 * Start Date: May 28th, 2026 * Commitment Required: 40 hours per week (6 hours overlap with PST) * Years of Experience: 3 Years of Experience required * Engagement Length: 4 weeks