Senior Psychiatrist (AI Clinical Evaluation)

Role Overview

We are looking for an experienced Senior Psychiatrist to contribute to an AI training and evaluation project focused on psychiatric reasoning, behavioral-health assessment, longitudinal chart review, treatment planning, and patient safety.

The role involves creating and reviewing complex psychiatry cases, long-chart scenarios, gold-standard answers, and evaluation rubrics. You will assess whether outputs reflect appropriate diagnostic reasoning, risk assessment, medication and treatment decisions, documentation quality, and clinically defensible conclusions.

CONTRACT: Contractor assignment, 12 weeks

COMMITMENT: Part-time or Full-time (20-40h/week)

LOCATIONS: Remote - Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Nigeria, Turkey

PROCESS: The selection will be made based on an online questionnaire, 60min MCQ test, and resume/education/certification

Key Responsibilities

• Develop high-difficulty psychiatry and behavioral-health cases and benchmark tasks.
• Review longitudinal records, psychiatric history, medications, psychosocial factors, and prior treatment.
• Identify clinically important trends, contradictions, omissions, and safety risks.
• Evaluate AI-generated outputs for diagnostic accuracy, appropriateness, safety, and quality of clinical reasoning.
• Create gold-standard answers and clinically defensible reference solutions.
• Assess differential diagnosis, treatment planning, medication decisions, and follow-up recommendations.
• Review suicide risk, self-harm risk, behavioral risk, capacity, and escalation needs where clinically relevant.
• Evaluate documentation quality and identify incomplete or unsafe psychiatric recommendations.
• Apply structured rubrics to assess clinical reasoning, terminology, documentation, and patient-safety implications.
• Participate in peer review, calibration, and resolution of complex or ambiguous cases.

Requirements

• Medical degree with completed specialist training in Psychiatry.
• Active or recently held professional license, registration, board certification, or recognized psychiatry credential in the candidate’s country.
• Approximately 8+ years of professional psychiatry experience.
• Current or recent clinical practice within the last 3 years.
• Strong experience with psychiatric assessment, diagnosis, treatment planning, and medication management.
• Strong clinical reasoning and ability to interpret complex or fragmented medical and behavioral-health records.
• Experience assessing clinical risk and identifying unsafe or incomplete treatment recommendations.
• Strong written English and ability to provide precise, clinically defensible reasoning.