Evaluate personalized AI responses for accuracy, helpfulness, and appropriate personalization. Create multi-turn prompts and provide detailed feedback on AI performance.
Hiring: LLM – AI Quality Analyst (Personalization) – Chinese
We are looking for Chinese-speaking AI Quality Analysts to support a short-term AI evaluation project with a leading AI technology company.
Locations: USA USA sourcing: Please do not source from Texas or Illinois Duration: 4 months Schedule: 30 or 40 hours/week | Minimum 4 hours/day Time-zone requirement: 4 hours overlap with PST Remote | Immediate Start
What You'll Do
Evaluate personalized AI responses and determine their quality
Create multi-turn prompts based on personal experiences and context
Review AI responses for accuracy, helpfulness, and appropriate personalization
Identify incorrect personalization, unsupported assumptions, and hallucinations
Compare AI responses side-by-side and provide detailed feedback
Write clear rationales explaining your evaluations
Requirements
Strong Chinese reading and writing skills
Excellent analytical and critical-thinking skills
Strong written communication
Experience in AI evaluation, data annotation, content moderation, linguistics, research, or a related area is preferred
Bachelor's degree or equivalent experience
Comfortable working independently in a remote environment
Laptop/desktop with reliable internet
Willingness to use a primary personal Google account and enable relevant personal data sources for the evaluation
🎓 Student-friendly opportunity: This may be a good fit for students or recent graduates who have strong Chinese language skills and are interested in AI, language, data annotation, content evaluation, or technology and can meet the required weekly schedule.
Selection Process
Job Interest Form
Profile review
Online assessment — must be completed within 24 hours
Pre-onboarding discussion
📩 Interested candidates: Please send your updated resume and confirm:
Chinese proficiency
Current location
Availability (30 or 40 hrs/week)
Earliest start date
Confirmation that you can provide 4 hours of PST overlap
“I was the first applicant for a remote marketing position that got listed on the company website the same day I applied. Had an interview within 48 hours!”
— Sarah J.
·
Marketing Manager
★★★★★
Verified
