Senior Data Engineer

About the role

minden.ai, a technology venture founded by Temasek in partnership with DFI Retail Group and coalition partners including DBS Bank, Cold Storage, Gojek, Mandai Wildlife Group and Singtel, is looking for a Senior Data Engineer. You will help design and implement a scalable, reliable data platform based on data mesh principles, using a modern data stack.

Key responsibilities

• Develop and maintain efficient data pipelines that ingest, transform and store data from various sources.
• Collaborate with engineers across domains to understand their data needs, build self-service data platform features, improve developer experience, and build data access tools and APIs.
• Contribute to internal data products, data marts, data modelling and data product usability.
• Partner with data science, analytics teams and other customers of the data platform to meet their data needs.
• Improve data quality, observability, lineage, governance and lifecycle management across the platform.
• Contribute to engineering best practices including CI/CD, testing, monitoring, documentation and code reviews.
• Evaluate and introduce new technologies that improve developer productivity and platform scalability.
• Follow and contribute to the continuous improvement of data standards and the full life cycle of the data platform.

Required profile

• Bachelor's degree in Computer Science, Data Science or a related field.
• 5+ years of experience as a Data Engineer with data modelling experience; additional backend software engineering experience is preferred.
• Experience building, productionising and maintaining data lifecycle management tools.
• Understanding of data mesh principles is beneficial; experience in a fast-paced environment is an advantage.

Required skills

• Proficiency in SQL, Python and Java or Scala.
• Big data processing frameworks and data warehouses.
• Dimensional modelling, SCDs, modern data warehouses, data lakes, lakehouses and data mesh.
• Modern data stack such as Snowflake, dbt-core, Airflow is a plus.