Senior Manager, QA & Analytic Engineer (Contract)

About the role

The Health Promotion Board's Youth Preventive Service Group runs health promotion programmes in schools and out-of-school settings. This Senior Manager, QA & Analytic Engineer is part of the Child & Youth Programme & Partnership team, at the intersection of AI quality assurance and data analytics. The role owns the end-to-end testing lifecycle of a live AI product, evaluates emerging agentic AI tools and turns conversation data into insights. It is a dual function: part QA tester and AI evaluator, part data analyst. The position is on contract until 31 December 2028.

Key responsibilities

• Design and run structured test cases covering accuracy, tone, safety and data privacy, including edge cases, harmful queries and abuse attempts.
• Run full regression testing after every prompt update, model change or deployment, and own the go/no-go sign-off before each release.
• Research and score external agentic AI tools on accuracy, safety, cost and integration feasibility, and write recommendation reports for leadership.
• Check that AI behaviour, formatting and response quality are consistent across channels, and test the embeddable chat widget across browsers and devices.
• Analyse conversation logs, build and maintain live performance dashboards and carry out user behaviour analysis by platform.

Required profile

• At least 5 years of relevant experience in quality assurance, software testing, data analysis, digital product operations or related fields.
• Experience with conversational AI, digital assistants, chatbots or AI-enabled products is advantageous.
• Experience designing test cases, UAT, regression testing or QA for digital products.
• Strong awareness of accuracy, bias, safety and data privacy in AI, especially where misinformation affects families and children.
• Academic background in data analytics, computer science, information systems, engineering, statistics, public health or business analytics is advantageous.

Required skills

• Advanced proficiency in at least one analytical tool such as Python, SQL, Power BI or Tableau.
• Good written and verbal communication, and strong stakeholder management across teams, vendors and internal stakeholders.
• Ability to manage multiple workstreams and meet tight deadlines.