<div class="show-more-less-html__markup show-more-less-html__markup--clamp-after-5 relative overflow-hidden"> <strong>Job Title:</strong> AI Evaluation Specialist<br/><br/><strong>Job Type:</strong> Contractor<br/><br/><strong>Location:</strong> Remote<br/><br/><strong>Job Summary<br/><br/></strong>As a AI Evaluation Specialist, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.<br/><br/><strong>Key Responsibilities<br/><br/></strong><ul><li>Review and critically assess AI-generated outputs for quality, clarity, usability, and overall user experience.</li><li>Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences.</li><li>Apply structured evaluation guidelines and provide insightful, nuanced feedback to inform model improvements.</li><li>Collaborate with cross-functional teams to define and refine quality standards, scoring criteria, and review processes.</li><li>Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results.</li><li>Contribute to the continuous enhancement of evaluation workflows and best practices.</li><li>Support the development of training data that enhances AI system performance and reliability.<br/><br/></li></ul><strong>Required Skills And Qualifications<br/><br/></strong><ul><li>Exceptional reading comprehension and acute attention to detail.</li><li>Strong observational skills with excellent aesthetic or editorial judgment.</li><li>Ability to think critically and deliver consistent, high-quality evaluations in ambiguous scenarios.</li><li>Excellent written and verbal communication skills.</li><li>Comfort working across various content types and evaluation guidelines.</li><li>Strong sense of ownership, reliability, and commitment to delivering high-quality work for the customer's team.</li><li>Open-minded approach to learning and quickly adapting to new workflows.<br/><br/></li></ul><strong>Preferred Qualifications<br/><br/></strong><ul><li>Background in design, UX/UI, creative direction, editing, or content strategy.</li><li>Experience reviewing creative, visual, or AI-generated content.</li><li>Familiarity with annotation, QA, moderation, or evaluation workflows, as well as working with AI tools or LLMs.<br/><br/></li></ul>We’re seeking highly perceptive and detail-oriented trainers passionate about shaping the future of AI. Bring your refined judgment, critical thinking skills, and commitment to excellence to our customer's team and make a meaningful impact on emerging AI technologies. </div>