Mercor is partnering with a leading legal AI company on a blinded human-preference study. We are hiring Mexico-based disputes and international arbitration lawyers to serve as expert reviewers — reading a realistic legal matter, reviewing six AI-generated work products for it, and recording which they prefer with written reasoning.
What you'll do
- Read a synthetic legal matter and its underlying documents
- Review six blinded AI deliverables (labelled A–F) for that matter
- Make five head-to-head comparisons against a common comparator output
- Write a short, specific rationale for every preference
Practice scope
International arbitration and award enforcement, cross-border disputes and emergency interim relief.
Requirements
- Qualified lawyer with substantive practice experience in the areas above
- Able to judge work product holistically — correctness, completeness, judgment, usefulness
- Precise written English
- Able to work independently to written instructions and a deadline
Logistics
- Commitment: ~24 hours across the engagement.
- Confidentiality: all work is synthetically generated. External AI tools must not be used on any project material.