Match your resume skills with our AI powered skill match!
You will build and ship product features for an AI agent evaluation platform while actively engaging with the developer community to gather feedback. The role requires wearing multiple hats, including feature development, marketing, and customer demos to ensure a tight loop between community needs and product releases.
This is a product engineering role at the intersection of building and distribution, focused on an AI agent evaluation product that transforms traces into reliable regression tests. You will ship features directly used by AI agent builders while creating in public to surface community signal that feeds back into the product. If you believe invisible shipping is shipping that doesn't matter, this role was written for you.
Build and ship product features, including evals, replay, cohorts, and developer experience improvements, with strong taste and judgment about what is genuinely useful versus surface-level theater.
Create in public on X and GitHub, posting, demoing, and engaging with the AI engineering community to pull signal directly into product decisions.
Wear whatever hat the week demands, whether that is feature work, a marketing motion, customer demos, or community engagement, focusing on whatever moves the needle.
Stay close to the target user, including AI agent builders, eval practitioners, and developers working with agent frameworks and custom runtimes.
Close the loop between community feedback and what ships, ensuring no wall exists between build and distribution.
3+ years of experience building or shipping production software, with demonstrated work building or evaluating agents in real systems.
Strong Python proficiency for production code.
Hands-on experience with agent frameworks such as LangGraph, Claude Code, or equivalent tools.
Experience with evaluation systems for LLM or agent outputs, and with trace data, observability, or debugging agent execution.
Experience shipping developer tools, SDKs, or APIs with attention to documentation, ergonomics, and demos.
Open-source contributions with measurable adoption or usage by other developers.
Active presence in AI engineering communities on GitHub, X, or similar platforms.
Comfort operating in early-stage, high-uncertainty environments where wearing multiple hats is a necessity, not an exception.
Strong design and developer experience instincts across docs, APIs, and demos.
Salary range: $120,000 to $190,000 USD annually.
Fully remote. Primary location is Munich, Bavaria, Germany, though candidates in other remote-friendly locations are also considered.
Stop the endless job search. Our AI finds and applies to the best jobs for you.
Discover remote opportunities in Software Development
Answer easy questions
200,000+ jobs across 15+ categories
Get your best job matches
Only hand-screened, legit jobs
Find a remote job faster
No ads, scams, or junk
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”