AI Evaluation Specialist – Game Development (Freelancer)

About UsDeccan AI Experts is a pioneering AI company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in high-quality human-curated data, AI-first operations, and advanced AI evaluation systems. Our global network of financial crime, compliance, risk, and AI experts helps train and evaluate next-generation AI models through expert AML knowledge, transaction monitoring expertise, and regulatory compliance experience. Role OverviewWe're seeking Game Developers to help evaluate and guide AI models within simulated Google Workspace environments (Gmail, Calendar, Drive). You'll work across task scenarios spanning domains like legal, business, and education — steering AI conversations toward target intents and rating outputs against core rubrics. What You'll DoLog into test environments and analyze context across Gmail, Calendar, and DriveEngage in multi-turn AI conversations, nudging models to complete complex, layered tasksScore model performance across quality, reasoning, and instruction-following rubricsAdapt quickly to varied user personas (student, founder, legal analyst) across different domains What You Bring1+ year of professional game development experience (Godot, Unity, or Unreal Engine)Hands-on experience working within existing game codebases — reading, modifying, debugging, and extending codeFamiliarity with Git/GitHub workflows (branching, commits, PRs, code reviews)Experience with Jira or similar tools for tracking issues and development tasksUnderstanding of game development concepts, engine configuration, and playtest triageAbility to navigate unfamiliar repositories and trace dependencies and implementation pathsBackground in data annotation, RLHF, or AI evaluation is a strong plus Engagement: Freelance / Project-Based Requirement: ImmediateImportant Note: This is an immediate requirement. Only candidates who register through the application form and meet the requirements will be contacted for the next steps.