Senior Data Engineer - Group Technology & Ops

About the role

UOB is looking for a hands-on Senior Data Engineer to build enterprise-scale ingestion frameworks, lakehouse data platforms, governed data products and analytical data models. The role partners with architecture, governance, analytics and business teams to deliver trusted, reusable and AI-ready data assets.

Key responsibilities

• Design metadata-driven ingestion frameworks supporting batch, CDC, streaming, APIs and files
• Develop reusable Spark/Python components, orchestration, logging, monitoring and error handling
• Build bronze, silver and gold layers using lakehouse principles and design conceptual, logical and physical data models
• Create business-facing data products with metadata, lineage and SLAs, and implement data quality controls and observability
• Tune Spark jobs and distributed workloads, and support DevOps, CI/CD and infrastructure as code
• Build ingestion and transformation frameworks in Java, Spark, Python and shell for multi-model data (images, audio, video, unstructured documents)
• Design data architectures for NLP and AI-driven analytics, including governance of unstructured data in data lakes and warehouses
• Work with ML platforms (CML, Spark MLlib, scikit-learn, XGBoost) and deploy models; collaborate with data scientists to operationalise them
• Build real-time systems with Hadoop ecosystem components (Iceberg, Spark, Ozone, Trino, Hive, Ranger, Kafka, Flink, Nifi) and full-stack internal tools with Python, shell and web frameworks

Required profile

• Master's degree in computer science or a related discipline
• At least 15 years of experience in technology delivery, preferably in banking or financial services
• Experience with cloud platforms and cloud-based app deployments with observability
• Exposure to AI-driven risk scoring, fraud investigation and explainable AI use cases in banking

Required skills

• Mandatory: Apache Spark (PySpark), Java, Python, advanced SQL, data modelling, Delta Lake/lakehouse concepts, ETL/ELT and CDC, API integration
• Preferred: Airflow, Kubernetes, Terraform, data products