Research Engineer I – AI Evaluation & Trust Technologies

About the role

The National Centre for Research in Digital Trust at Nanyang Technological University is seeking a Research Engineer I to evaluate and validate AI systems. You will design evaluation methods, build test datasets, and analyse model performance to ensure emerging technologies are trustworthy, fair, and safe.

Key responsibilities

• Engage directly with project partners and clients, participating in requirement discussions and technical meetings.
• Design evaluation frameworks, test datasets, and scoring methodologies for AI/ML systems.
• Develop annotation guidelines and monitor labelling quality.
• Conduct error analysis and translate findings into clear recommendations.
• Run structured experiments with large language models and build supporting prototypes and tooling.
• Communicate results to both technical and non‑technical audiences.

Required profile

• Bachelor’s degree in computer science, engineering, data science, or a related field.
• Confidence to engage with external partners and explain technical concepts to non‑technical audiences.
• Proficiency in Python with practical experience in ML workflows, model evaluation and error analysis.
• Working knowledge of NLP and hands‑on experience with large language models.
• Experience in evaluation methodology or data annotation is a strong advantage.
• Methodical, careful, and able to work independently under tight timelines.

Required skills

• Python programming
• Machine‑learning workflow implementation
• Model evaluation and error analysis
• Natural Language Processing (NLP)
• Large language models
• Data annotation and evaluation methodology