AI Response Evaluator

About the role

iMerit is seeking detail-oriented analysts to evaluate and rank AI-generated responses to image-based prompts. You will assess model outputs based on accuracy, relevance, clarity, and safety, while providing written explanations for your reasoning. The role requires interpreting user intent and verifying factual claims against research sources.

Responsibilities

• Interpret conversational context and identify user intent
• Rate and rank responses against defined quality criteria
• Compare multiple answers and provide written justifications for rankings
• Verify factual claims using approved research sources
• Flag tasks that cannot be reliably assessed

Required skills

• Critical thinking
• Research skills
• Attention to detail
• Reading comprehension

Benefits

• Flexible hours

About the Company

iMerit Technology is a company focused on AI data solutions.