About Grayde

Grayde.ai is a specialised healthcare and life science AI data and evaluation company. We work with the best clinicians and life science researchers to make medical AI models better.

Overview

Rank pairs of AI-generated drug information responses as RLHF preference data, judging clinical accuracy, completeness, and appropriate sourcing against a scoring rubric.

About this job

We're seeking medical information/drug information specialists to produce preference-ranking data for RLHF by comparing AI-generated responses to HCP and patient drug queries, covering dosing, interactions, contraindications, and off-label use questions. You will judge which responses are most accurate, complete, and appropriately sourced, ranking them according to a defined rubric.

You will use authoritative drug information resources and clinical databases such as DrugBank, Micromedex, Lexicomp, FDA drug labeling, and PubMed to validate AI-generated responses and support evidence-based ranking decisions.

Your rankings will train the model's reward signal,



so consistency and clear rationale matter as much as the final ranking.

What you'll do

1. Rank multiple AI-generated drug information responses by quality to produce RLHF preference pairs.

2. Verify dosing, interaction, and contraindication accuracy.

3. Assess whether responses appropriately cite evidence or labelling.

4. Use drug information databases such as DrugBank, Micromedex, Lexicomp, and FDA labelling to validate medication information.

5. Check handling of off-label and unapproved-use questions.

6. Flag responses that could mislead a prescriber or patient.

7. Apply a structured rubric consistently across ranking batches.

8. Write comparative rationale explaining each preference judgment.

Who can apply

Degree
: MBBS / MBChB (Primary medical), MD (Doctor of Medicine), BPharm / MPharm, PharmD, MN / MSN (Nursing)

Field of study
: Pharmacology, Toxicology, Pharmacy (General), Pharmaceutical Sciences, Clinic

📌 AI Evaluator (México)
🏢 Grayde.ai
📍 México