Primary Care Physician - AI Evaluator

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Primary Care Physician (MD) - Outpatient Clinical Documentation & AI Evaluation Type: Contract Compensation: $170–$190/hour Location: Remote Commitment: 10+ hours/week

Role Responsibilities

• Review outpatient clinical notes, encounter summaries, and EHR documentation for accuracy, completeness, and clinical soundness.
• Evaluate AI-generated notes and summaries against what a practicing PCP would document.
• Annotate outpatient encounter data against detailed guidelines and flag omissions, hallucinations, and clinical inaccuracies.
• Provide structured, written feedback that engineering and product teams can act on to improve AI systems .
• Contribute expert input on annotation guidelines, documentation standards, and edge-case definitions.
• Raise clarifying questions where guidance is ambiguous and help refine the guidelines.

Qualifications

Must-Have

• MD , with 2+ years post-residency , currently practicing primary care / family medicine / general internal medicine.
• US-based .
• Direct experience writing clinical notes in an outpatient setting .
• Minimum availability of 10 hours/week for the next 3 months .

Preferred

• 5+ years of experience post-residency.
• Familiarity with Epic .
• Experience with clinical documentation quality review, note auditing, or CDI exposure.
• Prior AI/ML annotation or model evaluation work experience, with strong performance reviews.

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check:
• For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Originally posted on Himalayas