Careerflow.ai

LLM - AI Quality Analyst (Personalization) - Portuguese Portugal

Careerflow.ai · Full Time · 4 days ago

Careerflow.ai

🌎 Angola, France, Italy, Mozambique, United Kingdom, United States 💵 $11 - $14 per hour ⭐ 0-2 yrs exp 💼 Software Development

Evaluate Gemini's personalization features by designing multi-turn prompts based on personal experiences. Analyze model responses for grounding, integration, and helpfulness while providing detailed rationales for rankings.

APPLY

LLM - AI Quality Analyst (Personalization) - Dutch

Careerflow.ai · Full Time · 4 days ago

Careerflow.ai

🌎 Angola, France, Italy, Mozambique, United Kingdom, United States 💵 $11 - $14 per hour ⭐ 0-2 yrs exp 💼 Software Development

Evaluate Gemini's personalization features by designing multi-turn prompts based on personal experiences. Analyze model responses for grounding, integration, and helpfulness while providing detailed rationales for rankings.

APPLY

Audio Quality Rater (Freelance / Remote)

Careerflow.ai · Full Time · a month ago

Careerflow.ai

🌎 United States 💵 $7 - $8 per hour ⭐ 0-2 yrs exp 💼 Others

Review audio files using an online tool to rate their technical quality. Consistently apply guidelines to ensure accurate data submission across large batches.

APPLY

Native English (American/US Accent) Speaker Needed

Careerflow.ai · Part Time · a month ago

Careerflow.ai

🌎 United States ⭐ 0-2 yrs exp 💼 Others

Participate in simulated conversational AI training sessions via Zoom. Engage in various scripted scenarios such as office discussions and customer service roles.

APPLY

Dutch AI Quality Analyst (Personalization)

Careerflow.ai · Part Time · a month ago

Careerflow.ai

🌎 Netherlands 💵 $15 - $17 per hour ⭐ 0-2 yrs exp 💼 Software Development

Evaluate Gemini AI personalization features by designing multi-turn prompts and assessing responses for quality, relevance, and grounding. Identify hallucinations and provide clear rationales for scoring decisions to improve AI output.

APPLY

Data Operations Analyst (AI-Assisted Data Transformation & Structuring)

Careerflow.ai · Full Time · a month ago

Careerflow.ai

🌎 India ⭐ 0-2 yrs exp 💼 Software Development

The analyst is responsible for extracting and transforming raw data from CSV and PDF sources into highly structured JSON formats. They must ensure 100% accuracy through manual validation and the responsible use of AI tools.

APPLY

Data Annotator - Video Evaluation (Remote, India / Brazil)

Careerflow.ai · Part Time · a month ago

Careerflow.ai

🌎 Brazil, India ⭐ 2-5 yrs exp 💼 Others

Evaluate AI-generated and real-world images and videos for quality, realism, and composition using structured rating frameworks. Provide detailed written justifications for evaluation decisions to help improve cutting-edge AI systems.

APPLY

LLM - AI Quality Analyst (Personalization) - Portuguese

Careerflow.ai · Full Time · a month ago

Careerflow.ai

🌎 United States ⭐ 0-2 yrs exp 💼 Software Development

Design and execute multi-turn conversational prompts to evaluate an AI assistant's personalization capabilities using personal data. Assess model responses for grounding, integration, and overall quality through side-by-side comparisons and structured rationales.

APPLY

LLM - AI Quality Analyst (Personalization) - Spanish

Careerflow.ai · Part Time · a month ago

Careerflow.ai

🌎 Spain ⭐ 2-5 yrs exp 💼 Software Development

The role involves designing multi-turn prompts to stress-test Gemini's personalization features and evaluating AI responses for accuracy, grounding, and natural integration. The analyst will perform side-by-side rankings of model outputs and provide detailed rationales for their quality assessments.

APPLY

Indonesian Data Annotator

Careerflow.ai · Full Time · a month ago

Careerflow.ai

🌎 United States ⭐ 0-2 yrs exp 💼 Others

Review and annotate Indonesian language content, including articles and advertisements, to train AI systems. Tasks include drawing bounding boxes, answering structured questions, and writing short summaries.

APPLY

Vietnamese Data Annotator

Careerflow.ai · Full Time · a month ago

Careerflow.ai

🌎 United States ⭐ 0-2 yrs exp 💼 Others

Review and annotate Vietnamese text and image content to help train AI systems. Tasks include drawing bounding boxes, answering structured questions, and writing short summaries.

APPLY

Finance Expert

Careerflow.ai · Part Time · a month ago

Careerflow.ai

🌎 United States 💵 $30 - $150 per hour ⭐ 0-2 yrs exp 💼 Finance

Train and improve AI systems by reviewing AI-generated financial analyses and providing structured feedback. Work on real-world finance use cases including investment memos, valuation, and accounting workflows.

APPLY

Biology Expert (Task Based)

Careerflow.ai · Part Time · a month ago

Careerflow.ai

🌎 United States ⭐ 2-5 yrs exp 💼 Others

Design and solve complex biology problems to evaluate and improve AI model performance. Create detailed step-by-step scientific solutions and contribute to the development of evaluation benchmarks.

APPLY

Maths Expert

Careerflow.ai · Part Time · a month ago

Careerflow.ai

🌎 United States ⭐ 2-5 yrs exp 💼 Others

Design and solve complex mathematical problems to test and fine-tune large language models. Create high-quality, step-by-step solutions and collaborate with researchers to define new evaluation benchmarks.

APPLY

Physics Expert

Careerflow.ai · Part Time · a month ago

Careerflow.ai

🌎 United States ⭐ 2-5 yrs exp 💼 Others

Create and evaluate advanced Physics problems to enhance AI reasoning and evaluation systems. Collaborate with LLM researchers to develop benchmarks and analyze model struggles in symbolic reasoning.

APPLY

Chemistry Expert

Careerflow.ai · Full Time · a month ago

Careerflow.ai

🌎 United States ⭐ 5-10 yrs exp 💼 Others

Solve advanced postgraduate-level chemistry problems and create detailed textual and visual explanations to fine-tune large language models. Analyze complex reaction mechanisms and chemical equilibrium using a variety of diagrams and simulations.

APPLY

Korean Data Annotator

Careerflow.ai · Full Time · 2 months ago

Careerflow.ai

🌎 United States ⭐ 0-2 yrs exp 💼 Others

Review and annotate Korean language content by drawing bounding boxes and answering structured questions. Write short summaries of content to help train AI systems.

APPLY

Driving Scene Quality Analyst (USA)

Careerflow.ai · Part Time · 2 months ago

Careerflow.ai

🌎 United States ⭐ 2-5 yrs exp 💼 Others

Review autonomous vehicle sensor feeds to interpret driving scenes and refine LLM-generated reasoning for accuracy and clarity. Validate driving plans and remove AI hallucinations to ensure safety-critical judgments align with U.S. traffic laws.

APPLY

Dutch Data Annotator

Careerflow.ai · Full Time · 2 months ago

Careerflow.ai

🌎 United States ⭐ 0-2 yrs exp 💼 Others

Review and annotate Dutch language content, including articles and advertisements, to train AI systems. Tasks include drawing bounding boxes, answering structured questions, and writing short summaries.

APPLY

Danish Data Annotator

Careerflow.ai · Full Time · 2 months ago

Careerflow.ai

🌎 United States ⭐ 0-2 yrs exp 💼 Others

Review and annotate Danish language content, including articles and advertisements, to train AI systems. Tasks include drawing bounding boxes, answering structured questions, and writing short summaries.

APPLY

Italian Data Annotator

Careerflow.ai · Full Time · 2 months ago

Careerflow.ai

🌎 United States ⭐ 0-2 yrs exp 💼 Others

Review and annotate Italian language content, including articles and advertisements, to train AI systems. Tasks include drawing bounding boxes, answering structured questions, and writing short summaries.

APPLY

Norwegian Data Annotator

Careerflow.ai · Full Time · 2 months ago

Careerflow.ai

🌎 United States ⭐ 0-2 yrs exp 💼 Others

Review and annotate Norwegian text and image content to help train AI systems. Tasks include drawing bounding boxes, answering structured questions, and writing short summaries.

APPLY

Turkish Data Annotator

Careerflow.ai · Full Time · 2 months ago

Careerflow.ai

🌎 United States ⭐ 0-2 yrs exp 💼 Others

Review and annotate Turkish language content, including articles and advertisements, to train AI systems. Tasks include drawing bounding boxes, answering structured questions, and writing short summaries.

APPLY

AI Software Engineer (MCP Development / AI R&D)

Careerflow.ai · Part Time · 2 months ago

Careerflow.ai

🌎 Argentina, Brazil, Canada, Chile, Ecuador, Jamaica, Mexico, United States 💵 $50 - $70 per hour ⭐ 5-10 yrs exp 💼 Software Development

You will develop and maintain Model Context Protocol (MCP) tools to connect AI models with complex database environments. Additionally, you will refactor legacy code, expand test coverage for agentic coding assistants, and create technical documentation to support community adoption.

APPLY

Thai AI Data Annotator / Quality Analyst

Careerflow.ai · Part Time · 2 months ago

Careerflow.ai

🌎 Thailand 💵 $7 - $10 per hour ⭐ 0-2 yrs exp 💼 Software Development

You will design and execute multi-turn conversational prompts to evaluate the personalization quality of AI models. Additionally, you will perform side-by-side comparisons of model responses and provide detailed rationales for your rankings.

APPLY

Data Collection Specialist (Household Task Video Contributor)

Careerflow.ai · Part Time · 2 months ago

Careerflow.ai

🌎 Canada, United States ⭐ 0-2 yrs exp 💼 Others

Record first-person household task videos using a head-mounted device to generate training data for robotics. Ensure consistent weekly output by following strict capture protocols and managing file uploads.

APPLY

Cloud Data Migration & AI Systems Engineer (India or Brazil)

Careerflow.ai · Part Time · 2 months ago

Careerflow.ai

🌎 Brazil, India 💵 $100K - $120K per year ⭐ 5-10 yrs exp 💼 Software Development

You will manage data migration workflows across cloud platforms and integrate Generative AI components into storage management systems. Additionally, you will perform system testing, validate data integrity, and document findings for cross-functional stakeholders.

APPLY

Image Quality Rater (Freelance / Remote)

Careerflow.ai · Part Time · 2 months ago

Careerflow.ai

🌎 United States 💵 $7 - $8 per hour ⭐ 0-2 yrs exp 💼 Others

Review images in an online tool to rate their technical quality based on specific guidelines. Identify and document image defects such as blur, noise, poor exposure, and compression artifacts.

APPLY

Student Image Quality Rater (Freelance / Remote)

Careerflow.ai · Part Time · 2 months ago

Careerflow.ai

🌎 United States 💵 $7 - $8 per hour ⭐ 0-2 yrs exp 💼 Others

Review images in an online tool to rate their technical quality based on specific guidelines. Identify and document image defects such as blur, noise, poor exposure, and compression artifacts.

APPLY

Contract Photographer

Careerflow.ai · Full Time · 2 months ago

Careerflow.ai

🌎 United States ⭐ 2-5 yrs exp 💼 Others

Capture and document a 741-image dataset of diverse subjects using professional DSLR or mirrorless cameras. Ensure all images meet strict consistency standards for framing, metadata, and technical settings.

APPLY

German Language Data Annotator

Careerflow.ai · Full Time · 2 months ago

Careerflow.ai

🌎 United States 💵 $5 - $8 per hour ⭐ 0-2 yrs exp 💼 Others

The role involves accurately annotating and categorizing German audio clips and texts to improve AI models. You will also collaborate with the Project Manager to meet productivity targets and maintain high-quality standards.

APPLY

Chinese Data Annotator

Careerflow.ai · Full Time · 2 months ago

Careerflow.ai

🌎 United States 💵 $2 - $3 per hour ⭐ 0-2 yrs exp 💼 Others

Review and annotate content such as articles and advertisements in Chinese by drawing bounding boxes and answering structured questions. You will also be required to write short summaries and follow specific annotation guidelines to ensure quality.

APPLY

Content Creator

Careerflow.ai · Full Time · 2 months ago

Careerflow.ai

🌎 United States ⭐ 0-2 yrs exp 💼 Writing

Create short, engaging 'walk-and-talk' videos of public locations to help train AI systems. Ensure high-quality audio and video while following specific creative guidelines and providing accurate location data.

APPLY

CAD Design Engineer (SolidWorks) – Pilot Dataset Project

Careerflow.ai · Part Time · 3 months ago

Careerflow.ai

🌎 United States ⭐ 5-10 yrs exp 💼 Software Development

Design and build high-quality SolidWorks parts across various engineering domains while ensuring reproducibility and consistency. Document engineering reasoning, create 2D drawings, and apply GD&T standards to support a structured dataset project.

APPLY

Japanese Data Annotator

Careerflow.ai · Full Time · 3 months ago

Careerflow.ai

🌎 Denmark, Germany, Italy, Netherlands, Norway, Turkey 💵 $3 - $10 per hour ⭐ 0-2 yrs exp 💼 Others

The role involves reviewing and annotating content in the native language, such as articles and advertisements, by drawing bounding boxes around specific elements as instructed. Additionally, annotators will answer structured questions about the content and write short summaries when required.

APPLY

Multilingual Data Annotator (Text/Video) - Danish, German, Italian, Norwegian, Dutch, and Turkish

Careerflow.ai · Part Time · 3 months ago

Careerflow.ai

🌎 Denmark, Germany, Italy, Netherlands, Norway, Turkey 💵 $3 - $12 per hour ⭐ 0-2 yrs exp 💼 Others

The role involves reviewing and annotating content such as articles and screenshots in the applicant's native language, which includes drawing bounding boxes around specific elements and answering structured questions about the content. Annotators must also follow clear guidelines to ensure quality and consistency in their work.

APPLY

Data Annotation Specialist - Computer Use Agents (CUA) Trajectory Evaluator

Careerflow.ai · Full Time · 3 months ago

Careerflow.ai

🌎 Bangladesh, Brazil, Egypt, Ghana, India, Kenya, Mexico, Niger, Nigeria, Pakistan, Turkey ⭐ 2-5 yrs exp 💼 Others

The specialist will produce and validate high-quality Computer-Use Agent (CUA) trajectories for technical workflows, including file operations, scripting, and API interactions. This involves breaking down natural language instructions into precise, verifiable, step-by-step executable actions for training AI systems.

APPLY

LLM S3 Annotator (OpenClaw Trajectory Specialist)

Careerflow.ai · Part Time · 3 months ago

Careerflow.ai

🌎 Bangladesh, Brazil, Egypt, Ghana, India, Kenya, Mexico, Niger, Nigeria, Pakistan, Turkey ⭐ 5-10 yrs exp 💼 Others

The role involves creating and validating advanced OpenClaw trajectories for complex, research-oriented tasks that require multi-step reasoning and handling ambiguous goals. Professionals will use Python and operate across multiple tools while clearly documenting their actions and justifications.

APPLY

Senior Software Engineer – LLM Evaluation

Careerflow.ai · Part Time · 3 months ago

Careerflow.ai

🌎 Austria, Denmark, Finland, France, Germany, Iceland, Ireland, Italy, Netherlands, Norway, Sweden, Switzerland, United States ⭐ 5-10 yrs exp 💼 Software Development

The role involves creating cutting-edge datasets for training and benchmarking Large Language Models by curating code examples, providing solutions, and making corrections across various programming languages. Responsibilities also include evaluating and refining AI-generated code for quality and collaborating on enterprise-level AI-driven coding solutions.

APPLY