Research Engineer I (AI Evaluation, Trust Technologies)

About the role

The National Centre for Research in Digital Trust at Nanyang Technological University is seeking a Research Engineer I to support the evaluation and validation of AI systems. You will work closely with project partners and clients to design robust evaluation frameworks and ensure emerging technologies are trustworthy, fair, and safe.

Key responsibilities

• Design evaluation frameworks, test datasets, and scoring methodologies for AI and ML systems.
• Develop annotation guidelines, monitor labeling quality, and conduct error analysis.
• Run structured experiments with large language models and build supporting prototypes and tooling.
• Communicate results and recommendations clearly to both technical and non‑technical audiences.

Required profile

• Bachelor’s degree in computer science, engineering, data science, or a related field.
• Confidence to engage directly with external partners and clients.
• Ability to explain technical concepts clearly to non‑technical audiences.

Required skills

• Proficiency in Python.
• Practical experience in ML workflows, model evaluation, and error analysis.
• Working knowledge of NLP and hands‑on experience with large language models.
• Experience with evaluation methodology or data annotation (strong advantage).