<div class="show-more-less-html__markup show-more-less-html__markup--clamp-after-5 relative overflow-hidden"> <strong>Position:</strong> LLM - AI Quality Analyst Personalization - Italian<br/><br/><strong>Type:</strong> Hourly contract<br/><br/><strong>Compensation:</strong> $11 - $15/hour<br/><br/><strong>Location:</strong> Remote<br/><br/><strong>Commitment:</strong> 30 40 hours/week<br/><br/><strong>Role Responsibilities<br/><br/></strong><ul><li>Evaluate AI model responses for personalization quality including grounding, integration, and helpfulness</li><li>Design and execute multi-turn prompts based on personal context to test AI capabilities</li><li>Analyze responses for hallucinations, incorrect personalization, and flawed inferences</li><li>Perform side-by-side (SxS) comparison of model outputs to determine quality and effectiveness</li><li>Write clear and structured rationales for response evaluations and rankings</li><li>Provide detailed feedback and annotations to improve AI model performance</li><li>Maintain strict data hygiene and ensure accurate documentation of evaluations<br/><br/></li></ul><strong>Requirements:<br/><br/></strong><ul><li>Strong proficiency in Italian with excellent reading and writing skills</li><li>Experience in data annotation, AI evaluation, content moderation, or similar roles</li><li>Strong analytical thinking with the ability to evaluate nuanced AI responses</li><li>Ability to design creative multi-turn prompts based on personal context</li><li>Excellent written communication and attention to detail</li><li>Full-time availability with flexibility and ability to overlap with PST time zone</li><li>Bachelor s degree or equivalent experience in a relevant analytical field<br/><br/></li></ul><strong>Application Process:<br/><br/></strong><ul><li>Apply/Easy Apply and check email for application form</li><li>Fill Google form</li><li>Assessment Link (After shortlisting)</li><li>Screener</li><li>1/3 assessments mandatory</li><li>Language vetting<br/><br/></li></ul> </div>