Embedded / Systems Engineer (C)– AI Code Analysis | Remote, New York

Overview

Position: Software Engineering, Data Science, and Systems Design Experts, C language (5+ YOE) Type: Hourly contract Compensation: $60-$100 per hour Location: Remote Commitment: Full-time or Part-time Contract Work Role Responsibilities

Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness Conduct fact-checking using trusted public sources and authoritative references Conduct accuracy testing by executing code and validating outputs using appropriate toolsAnnotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies Assess code quality, readability, algorithmic soundness, and explanation quality Ensure model responses align with expected conversational behavior and system guidelines Apply consistent evaluation standards by following taxonomies, benchmarks, and detailed evaluation guidelinesRequirements

BS, MS, or PhD in Computer Science or a closely related field Real-world experience in software engineering or related technical roles Expertise in C programming language Ability to solve HackerRank or LeetCode Medium and Hard–level problems independently Experience contributing to open-source projects, including merged pull requestsExperience using LLMs while coding and understanding their strengths and failure modes Strong attention to detail and ability to evaluate complex technical reasoning and identify bugs or logical flaws Prior experience with RLHF, model evaluation, or data annotation work preferred Track record in competitive programming preferredExperience reviewing code in production environments preferred Familiarity with multiple programming paradigms or ecosystems preferred Experience explaining complex technical concepts to non-expert audiences preferred

#J-18808-Ljbffr