<div class="show-more-less-html__markup show-more-less-html__markup--clamp-after-5 relative overflow-hidden"> <strong>Job Title: Data Scientist<br/><br/></strong><strong>Job Type: Contractor<br/><br/></strong><strong>Location: Remote<br/><br/></strong><ul><li> Role Overview<br/><br/></li></ul>Partnering with a leading AI research organization to engage experienced data scientists for a project focused on evaluating how well AI systems perform real-world data science work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring completed work samples with rigorous, well-reasoned written justifications.<br/><br/><ul><li> Key Responsibilities</li><li>Design precise, task-specific grading criteria for real-world data science deliverables (analyses, models, dashboards, experiment readouts, and written recommendations) </li><li>Score AI-generated and human work samples against those criteria, with detailed written justifications for every score </li><li>Apply consistent, evidence-based judgment so that scores are reproducible and defensible </li><li>Incorporate structured feedback from senior reviewers and iterate quickly on your work </li><li> Ideal Qualifications</li><li>5+ years of professional data science experience in industry </li><li>Background in business operations, product, or growth data science at top-tier technology companies </li><li>Deep fluency in experiment design and A/B testing, metric definition, SQL/Python analysis, and communicating findings to executive stakeholders </li><li>Exceptionally strong written communication </li><li>Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers </li><li>Prior experience with AI training, evaluation, or human-data projects is a strong plus </li><li> Application Process</li><li>Submit your resume or relevant technical background to get started </li><li>Qualified applicants may be asked to complete a brief technical assessment or submit additional information <br/><br/></li></ul>We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.<br/><br/>Contract and Payment Terms<br/><br/><ul><li>You will be engaged as an independent contractor.</li><li>This is a fully remote role that can be completed on your own schedule.</li><li>Projects can be extended, shortened, or concluded early depending on needs and performance.</li><li>Payments are weekly on Stripe or Wise based on services rendered.</li></ul> </div>