Big Data Engineer - Data Platform, Global E-Commerce

About the role

The Data Platform Singapore Business Partnering (DPSG BP) team aims to empower the business with data by building a data warehouse that handles both batch and streaming data, and data products that feed efficient metrics and dashboards for smarter business decisions. This Big Data Engineer role sits within that team.

Key responsibilities

• Translate business requirements and end-to-end designs into technical implementations, building batch and real-time data warehouses.
• Manage data modeling design, write and optimize ETL jobs.
• Collaborate with the business team to build data metrics based on the data warehouse.
• Build and maintain data products.
• Take part in rollouts, upgrades, implementation and release of data system changes needed to streamline internal practices.
• Develop analytics applications that turn raw data into meaningful information using data-oriented programming languages and visualization software.
• Apply data mining, data modeling, natural language processing and machine learning to analyze large structured and unstructured datasets.
• Visualize, interpret and report data findings, including dynamic data reports.

Required profile

• At least 3 years of experience in software engineering and 2 years in data engineering.
• Familiarity with data warehouse concepts and production experience in data modeling design.
• Excellent interpersonal and communication skills, able to engage and manage internal and external stakeholders across all levels of seniority.
• Strong collaboration skills and the ability to build rapport across teams and stakeholders.

Required skills

• Creating and maintaining complex ETL pipelines end-to-end with high reliability and security.
• Familiarity with at least one distributed computing engine such as Hive, Spark or Flink.
• Knowledge of NoSQL databases such as HBase is a plus.