Research Engineer, QC Automation

About the role

This is a top‑priority hire on the Engineering team at an early‑stage AI infrastructure company focused on reinforcement learning environments and post‑training data. You will own the automation of quality control for training data produced by companies using the platform, building systems that scale quality to meet growing demand.

Key responsibilities

• Automate QC for training data created by companies using the platform's infrastructure.
• Build QC systems grounded in true understanding and human judgment, rather than heavy reliance on LLMs.
• Define and enforce quality standards for training data across the platform.
• Design experiments and metrics to evaluate and grade agent outputs.
• Partner with data vendors to debug quality issues, diagnose agent failure modes, and improve their data generation processes.
• Translate QC learnings into auditing systems, including sampling strategies and rule‑based or model‑assisted validation pipelines.
• Continuously integrate QC insights into infrastructure tools and vendor‑facing systems to reduce anomalies, inconsistencies, and edge cases.

Required profile

• 2 to 4 years of experience in engineering or research roles, ideally focused on QC automation or data quality.
• Proficiency in Python, Docker, and Linux environments.
• Proven experience building scalable data validation pipelines and automated QA/QC systems end‑to‑end.
• Experience working on benchmarks and evaluations for RL training data, including defining realistic tasks and reliable rubrics.
• Experience creating QC systems based on human judgment rather than LLM‑centric approaches.
• Experience designing experiments and metrics to grade agent outputs and providing actionable feedback to data vendors.
• Solid knowledge of statistics and comfort designing metrics and QA/QC processes.
• Strong written and verbal communication skills for working across time zones.
• Genuine curiosity, comfort in unstructured problem spaces, and ability to work independently in a fast‑paced startup environment.

Required skills

• Python
• Docker
• Linux

What we offer

• Salary range $150,000–$250,000 USD annually.
• Visa sponsorship is available.