<div class="show-more-less-html__markup show-more-less-html__markup--clamp-after-5 relative overflow-hidden"> <p><strong>Position:</strong> LLM – AI Quality Analyst (Personalization) – Vietnamese</p><p><strong>Type:</strong> Short-Term Contract</p><p><strong>Location:</strong> Remote</p><p><strong>Commitment:</strong> Full-time (30–40 hours/week, 4-hour overlap with PST)</p><p><strong>Engagement Length:</strong> 2 months</p><p><strong>Start Date:</strong> Immediate</p><p><br/></p><p><strong>Role Responsibilities</strong></p><ul><li>Design multi-turn conversational prompts (1–5 turns) using personal context</li><li>Evaluate personalized AI responses for grounding, integration, and helpfulness</li><li>Assess correct usage of personal data and identify flawed inferences or hallucinations</li><li>Review integration quality to ensure personalization feels natural and not over-narrated</li><li>Conduct side-by-side (SxS) evaluation and ranking of model responses</li><li>Identify personalization errors, reasoning gaps, and grounding issues</li><li>Write clear, structured rationales referencing specific conversation turns</li><li>Extract and verify “Debug Info” to confirm correct data source utilization</li><li>Maintain strict data hygiene by deleting evaluation conversations</li></ul><p><br/></p><p><strong>Requirements</strong></p><ul><li>Vietnamese proficiency (reading and writing)</li><li>Strong experience in data annotation, AI quality evaluation, content moderation, or related roles</li><li>Strong analytical skills for evaluating nuanced and ambiguous AI outputs</li><li>Experience with creative prompt engineering and multi-turn conversations</li><li>Understanding of personalization concepts and AI response evaluation</li><li>High attention to detail for SxS comparisons</li><li>Excellent written communication and feedback documentation skills</li><li>BS/BA degree or equivalent experience in a relevant field</li><li>Willingness to use a primary personal Google account with enabled personal data sources</li><li>Self-motivated and able to work independently in a remote setup</li><li>Desktop/laptop with reliable internet connection</li></ul><p><br/></p><p><strong>Application Process</strong></p><ul><li>Fill out the application form</li><li>Complete the ICF</li><li>Complete the assessment</li></ul> </div>