Software Engineer, Remote - Contract

Role Title: Software Engineer

Role Type: Contract

Location: Remote

Required Skills:

• Software engineering

• Technical documentation

• Code review

• Content evaluation

• Written communication

• Attention to detail

• Critical analysis

• Editing

• Independent work

In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Scope of Work:

• Evaluate and compare multiple AI-generated responses to technical prompts for clarity, correctness, tone, and usefulness.

• Assign analytical quality scores and compose detailed rationales justifying each assessment.

• Spot responses that are technically accurate but poorly communicated, or fluent but factually incorrect.

• Thoroughly document observations and findings with precision and consistency.

• Identify and articulate small errors, inconsistencies, or ambiguities in technical communication.

• Collaborate asynchronously with project managers and reviewers to ensure alignment on evaluation standards.

• Work independently to meet agreed-upon project requirements and deliverables within defined timeframes.

Preferred Qualifications:

• Native-level English fluency and exceptional written communication skills.

• Professional experience as a software engineer in any modern technology stack.

• Proven track record authoring or reviewing technical documentation, design docs, API references, or specs.

• Experience conducting code review, design review, or providing feedback on technical writing.

• Demonstrated ability to judge technical communication for audience appropriateness and instructional value.

• Strong analytical skills and meticulous attention to detail.

• Familiarity with AI model evaluation, annotation, or RLHF projects is a plus but not required.