AWS Data Engineer (Databricks & Snowflake)

About the role

An AWS Data Engineer position based in Singapore, focused on designing, building and operating end-to-end data pipelines on Databricks and/or Snowflake. The role covers workspace administration, data governance, CI/CD and observability, and supports migration and go-live activities.

Key responsibilities

• Design, build and operate ingestion, transformation and serving pipelines using medallion/layered architecture patterns.
• Configure and administer workspaces and accounts (compute policies, resource sizing, access hierarchy) according to the SDP reference architecture.
• Set up data governance: catalogue and schema design, RBAC, row/column-level security, data masking and lineage tracking.
• Set up CI/CD and infrastructure-as-code for pipeline deployment and environment promotion (dev, test, prod).
• Configure monitoring, telemetry and audit logging for observability and security requirements.
• Support UAT, integration testing and parallel-run validation during migration and go-live.
• Produce handover documentation (runbooks, access lists, escalation procedures) for agency operations teams.

Required profile

• At least 5 years of hands-on experience in data engineering, data platform engineering or a related discipline.
• At least 3 years of hands-on experience with Databricks, including pipeline development, platform administration, governance and optimization.
• Hands-on experience on at least one hyperscaler (AWS, Azure or Google Cloud).
• Understanding of data security and compliance frameworks; prior regulated-sector experience is an advantage.

Required skills

• Databricks: Unity Catalog, Lakeflow / Delta Live Tables, Delta Lake, Databricks SQL, clusters and workspace administration, Databricks Asset Bundles and Repos.
• Common: SQL, Python (PySpark), data modelling (star/snowflake schemas), CI/CD (Azure DevOps, GitHub Actions, GitLab CI) and Terraform.
• Preferred: Databricks or SnowPro certifications, AWS certification, and experience in a System Integrator delivery team.