Position: AI Trainer

Type: Contract

Compensation: $35 - $50/hour

Location: Remote

Commitment: 10-40 hrs/week

Role Responsibilities

Design, develop, and refine comprehensive rubrics tailored to AI training and assessment needs. Analyze task performance and provide structured, actionable feedback to guide improvement and calibration. Establish and document effective scoring methodologies that ensure consistency, fairness, and high-quality outcomes. Lead calibration sessions to align evaluators and maintain rubric integrity across projects. Validate assessment outputs for accuracy, reliability, and alignment with project objectives. Oversee quality control processes, making data-driven recommendations for rubric enhancements.

Requirements

Have proven expertise in rubric design, performance analysis, and feedback structuring for complex assessment environments. Possess a strong background in scoring methodology development and calibration for AI or educational projects. Demonstrate success in assessment validation and quality control processes. Have exceptional written and verbal communication skills, with the ability to convey nuanced judgment and rationale. Have practical, hands-on grocery shopping experience to inform realistic scenario assessments.

Application Process

Easy Apply on Linked InCheck email for next steps Participate in resume evaluation & interview stage

Skills: Performance Analysis & Feedback Structuring, Rubric Design & Development