About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco.
Position
AI Model Evaluation Contractor (Contract)
Compensation: $25–$35/hour
Commitment: 20 hours/week
Role Responsibilities
* Write realistic prompts reflecting professional and consumer domain-specific guidance.
* Evaluate AI-generated responses for factual accuracy and practical usefulness.
* Identify fabricated claims and misleading reasoning in model outputs.
* Score and rank model responses using structured rubrics.
* Provide written justifications with specific evidence for each evaluation.
Qualifications
* Professional experience applying domain expertise in a practitioner or advisory capacity.
* Familiarity with industry-specific standards, regulations, or clinical guidelines.
* Strong written communication and critical reasoning skills.
#J-18808-Ljbffr