Clinical Pharmacist

Company Description

An enterprise client is seeking experienced Clinical Pharmacists to support an AI evaluation project focused on assessing AI performance in complex clinical pharmacy tasks. The role involves creating realistic clinical assignments, reviewing work developed by other pharmacy professionals, and evaluating AI-generated deliverables for clinical accuracy, medication safety, and compliance with institutional protocols.

Job Description

•  
• Create realistic clinical pharmacy assignments based on fully synthetic patient records, including medication reconciliation, renal and hepatic dose adjustments, therapeutic interchange, anticoagulation reviews, high-alert medication checks, pharmacist intervention notes, and prescriber queries.
• Develop realistic hospital medication-use protocols containing institution-specific policies, including formulary guidelines, therapeutic interchange requirements, dosing tables, independent double-check procedures, and clinical situations requiring pharmacist escalation.
• Design assignments that require AI models to apply specific institutional medication-use protocols rather than relying solely on standard drug references, product labeling, or general clinical guidelines.
• Prepare realistic clinical reference materials, including medication lists, medication orders, laboratory results, clinical notes, and discharge summaries.
• Produce gold-standard reference deliverables demonstrating clinical accuracy, patient-safety awareness, professional judgment, and appropriate clinical documentation.
• Develop detailed grading rubrics with clear evaluation criteria, point values, and pass/fail requirements to distinguish acceptable and unacceptable clinical deliverables.
• Ensure all assignments, patient records, protocols, and supporting materials use fully synthetic information and comply with applicable US healthcare and pharmacy regulations.
• Peer-review clinical pharmacy task packages created by other subject-matter experts, including assignment instructions, synthetic patient records, medication-use protocols, reference deliverables, and grading rubrics.
• Verify the internal consistency and clinical plausibility of patient records, including medication doses, administration schedules, laboratory results, diagnoses, and clinical notes.
• Assess whether institutional protocols are realistic, internally consistent, and sufficiently specific to require correct application by AI models.
• Evaluate whether grading rubrics appropriately prioritize patient safety, medication-related risks, protocol compliance, and the need to escalate clinical concerns.
• Review assignments for compliance with applicable US federal, state, and local regulations, including FDA labeling requirements, DEA controlled-substance rules, state pharmacy practice acts, and Joint Commission medication management standards.
• Identify duplicate or substantially similar assignments within the existing benchmark pool.
• Provide clear Reject, Revise, or Approve recommendations for peer-reviewed assignments, supported by concise clinical rationale.
• Independently evaluate completed AI-generated deliverables against assignments developed by other subject-matter experts.
• Compare two candidate deliverables and determine whether one is Better, About as Good As (a tie), or Worse than the other.
• Assess deliverables based on clinical accuracy, completeness, instruction-following, medication safety, protocol adherence, and professional documentation quality.
• Apply independent clinical judgment rather than relying exclusively on point-based scoring systems or checklists.
• Identify medication-related risks, incorrect dosing, drug interactions, clinical inconsistencies, and failures to escalate concerns appropriately.
• Provide concise, evidence-based explanations supporting evaluation decisions and highlighting important clinical differences between candidate deliverables.
• Maintain professional independence and objectivity throughout task authoring, peer review, and grading activities.
• Meet project deadlines while maintaining consistent clinical quality and accuracy throughout the engagement.
•  

Qualifications

•  
• At least 5 years of professional clinical pharmacy experience, including hospital or inpatient pharmacy practice.
• PharmD degree or Bachelor of Science in Pharmacy with equivalent clinical experience.
• Active, unrestricted pharmacist license in a US state.
• Hands-on experience with clinical pharmacy responsibilities, including medication reconciliation, medication order verification, dose adjustments, and medication safety reviews.
• Demonstrated experience developing, writing, reviewing, or maintaining medication-use policies, clinical protocols, or formulary guidance.
• Experience contributing to Pharmacy and Therapeutics (P&T) Committee activities or similar medication-policy development processes.
• Strong understanding of how institution-specific medication-use policies differ from standard drug references, product labeling, and general clinical guidelines.
• Working knowledge of applicable US federal, state, and local healthcare regulations, including FDA labeling requirements, DEA controlled-substance rules, state pharmacy practice acts, and Joint Commission medication management standards.
• Strong clinical judgment and the ability to independently assess complex medication-related scenarios.
• Excellent analytical, critical-thinking, and problem-solving skills, particularly when identifying medication-related risks, clinical inconsistencies, and patient-safety concerns.
• Demonstrated ability to evaluate clinical documentation objectively and provide clear, concise, evidence-based recommendations.
• Strong written English communication skills and the ability to prepare detailed clinical assignments, protocols, evaluation criteria, and professional documentation.
• Ability to work independently, follow detailed instructions, maintain professional standards, and meet agreed project deadlines.
• Availability of at least 20 hours per week on a sustained basis throughout the engagement.

Preferred Qualifications

• Board certification in a relevant pharmacy specialty, such as Board Certified Pharmacotherapy Specialist (BCPS).
• Previous experience serving on a Pharmacy and Therapeutics Committee or medication-safety committee.
• Experience developing, reviewing, or maintaining hospital medication-use policies, formulary guidelines, and clinical decision-support protocols.
• Experience with clinical pharmacy task development, professional assessment design, peer review, or quality assurance.
• Familiarity with AI evaluation, AI training data, prompt creation, annotation, or other AI-related projects.
• Experience evaluating complex clinical deliverables against established protocols, institutional policies, and professional standards.
• Strong understanding of medication safety procedures, high-alert medications, therapeutic interchange, and clinical escalation requirements.
•