The role involves leading the end-to-end technical migration of template workflows into high-performance LLM autoraters, utilizing advanced tools for generation and optimization to surpass human accuracy baselines.
Are you an expert at navigating the complex architecture of Large Language Models? Welo Data is seeking a highly technical Senior Prompt Engineer based in Spain to lead the end-to-end migration of template workflows into high-performance LLM autoraters.
This is a specialized role for a technical architect who understands that "perfecting a prompt" is a rigorous engineering discipline. You will leverage advanced APG/APO tools and manual refinement to ensure our automated systems meet—and exceed—human accuracy baselines in both German and English contexts.
The Mission: Automated Quality at Scale
Architectural Migration: Take full ownership of the end-to-end technical migration of templates to LLM autoraters.
Optimization Leadership: Utilize Automatic Prompt Generation (APG) and supervise Automated Prompt Optimization (APO) tools to push model performance past plateaus and logic deadlocks.
Metrics-Driven Excellence: Continuously measure quality against "gold data" baselines, tracking precision, recall, and F1 scores to justify launch readiness.
Edge-Case Engineering: Manually draft and refine complex prompts to overcome anti-patterns and architecture gaps that automated tools cannot solve.
Project Details
Schedule: Part-Time (Set your own hours within project milestones).
Location: 100% Remote (Must be currently based in Spain).
Language: Native fluency in Spanish and professional fluency in English.
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”