Image Evaluator Expert
- Mercor is collaborating with a leading AI lab to identify detail-oriented image evaluation specialists for a project focused on assessing AI-powered image editing systems
- In this project, you will evaluate how accurately and effectively AI models modify images based on user instructions
- Your work will directly contribute to improving the quality, safety, and reliability of frontier multimodal models
- This is a project-based opportunity suited for professionals with strong visual judgment and structured evaluation skills
2. Key Responsibilities
Review original images, user edit instructions, and AI-generated edited images
Conduct a pre-evaluation feasibility check to confirm the instruction is valid and achievable
Flag unsafe, harmful, or policy-violating content in edited outputs
Assess instruction adherence, structural integrity, and preservation of unedited areas
Evaluate visual quality, style alignment, and character consistency
Provide structured ratings across defined grading dimensions
Deliver clear, consistent evaluations following detailed rubric guidelines
3. Ideal Qualifications
Experience in image review, visual quality assurance, content moderation, or related fields
Strong attention to detail and ability to identify subtle visual inconsistencies
Familiarity with image editing concepts, digital art, or generative AI systems
Ability to apply structured evaluation rubrics consistently and objectively
Clear written communication skills for documenting assessments
Comfort reviewing a wide range of visual content, including potentially sensitive material
4. Application Process
Submit your resume or professional background to express interest
Complete a short screening assessment to demonstrate evaluation skills
Selected candidates will receive detailed project guidelines and next steps
Communication regarding status and next steps typically occurs within a few business days
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment TermsYou will be engaged as an independent contractor.This is a fully remote role that can be completed on your own schedule.Projects can be extended, shortened, or concluded early depending on needs and performance.Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.Payments are weekly on Stripe or Wise based on services rendered.Please note: We are unable to support H1-B or STEM OPT candidates at this time.
Mercor partners with leading AI labs and enterprises to train frontier models using human expertise. You will work on projects that focus on training and enhancing AI systems. You will be paid competitively, collaborate with leading researchers, and help shape the next generation of AI systems in your area of expertise. *we work with referrals