About the role
Domain Expert – AI Prompt Design & Evaluation Experience: Professional / Domain Expertise RequiredJob Type: ContractorSchedule: Global - FlexibleCompensation: $50 per approved task Role OverviewWe are looking for Domain Experts, Professionals, and Knowledge Workers from diverse fields to participate in a paid AI research study. You will turn a complex real-world workflow from your area of expertise into a challenging AI prompt, test it in ChatGPT, identify where the model fails, and create a structured grading rubric to evaluate AI-generated outputs. Key ResponsibilitiesConvert a familiar, complex workflow into a challenging AI prompt.Test the prompt using ChatGPT and identify incomplete or incorrect outputs.Refine the task to better test the model’s reasoning capabilities.Record your screen, camera, and microphone while completing the task.Create a clear and comprehensive grading rubric.Submit the final prompt, failure notes, rubric, and generated output file. Key RequirementsStrong expertise in a specialized professional or technical workflow.Ability to quickly evaluate the quality and accuracy of outputs in your domain.Strong reasoning, analytical, and problem-solving skills.Access to a laptop or desktop computer.Active ChatGPT account; free tier is acceptable.Comfortable completing a screen-recorded session with audio and video. Selection ProcessStep 1 – Application / Profile SubmissionStep 2 – Paid Trial AssessmentStep 3 – Submission ReviewStep 4 – Payment & Future Opportunities
From the employer's public posting. AI Eval HQ isn't affiliated with Codefeast; you apply on their site.
Apply on Codefeast