Senior Data Engineer (Big Data Processing)

About the role

CSIT develops products that advance the national security interests of Singapore, used in areas such as counter-terrorism and computer network defence. It is looking for senior data engineers to lead and build mission-critical products that identify, analyse and investigate threats. As a data engineer on a team responsible for mission-critical data analytics systems, you will help develop and maintain high-performance data pipelines and systems, working on complex projects to collect, parse and process large datasets.

Key responsibilities

• Design and build scalable, robust and maintainable data pipelines to ingest crucial data using cutting-edge platforms and technologies
• Work with product managers, engineering managers and key stakeholders to deliver data products that meet business needs
• Optimise large-scale data pipelines for low latency, high throughput and high reliability
• Ensure data integrity, quality and governance through robust design and operational monitoring
• Build and experiment with Agentic AI systems, such as multi-step autonomous agents and tool-using LLM workflows
• Troubleshoot and resolve complex issues in critical data pipelines
• Apply data engineering best practices, including testing, orchestration and monitoring of pipelines
• Take part in technical discussions with the team and stakeholders to shape the future of data products

Required profile

• Degree or professional qualification in Computer Science or equivalent
• Able to communicate technical details clearly
• Good interpersonal, analytical and problem-solving skills in a dynamic environment
• Only Singapore citizens will be considered, as CSIT is an agency under the Ministry of Defence (Singapore)

Required skills

• Strong foundations in programming languages such as Scala or Java
• Familiarity with Spark, Kafka, Hadoop, the Elastic stack and Kudu
• Familiarity with AI-assisted development tools and concepts; exposure to agentic AI systems is a plus

What we offer

• Purposeful and meaningful work with talented, driven colleagues
• Modern technologies and tech stacks
• An excellent engineering culture and work-life balance
• An aspiration for engineering and operational excellence, and empowerment to innovate