Senior Associate, Databricks Data Engineer (AI Data)

About the role

EY AI & Data, the data and advanced analytics capability within EY Asia-Pacific, is looking for a Data Engineer with strong experience in Databricks. The role covers designing scalable data pipelines, building complex data platforms and deploying them on public clouds, within a flexible, diverse and inclusive environment.

Key responsibilities

• Design data pipelines with built-in scalability, high performance and resilience
• Develop, refine and implement high-quality delivery of complex data platform requirements
• Deploy projects on public clouds and highly secure environments
• Integrate with data governance tools and ecosystem products across the cloud landscape
• Translate business requirements into high-level and low-level designs
• Present findings to non-technical stakeholders and bring in reusable, modular coding best practices
• Stay current with technical developments, including AI integrations

Required profile

• Bachelor's degree in computer science, mathematics, engineering, statistics or a related field
• Databricks and Azure data engineering certifications
• At least 4 years of experience on data platform solutions across the SDLC
• At least 2 years designing data pipelines on Databricks across Azure, AWS or GCP
• Hands-on experience delivering data platform projects on Databricks, Azure, Google Cloud or AWS, including ELT, pipeline and orchestration tools
• Agile delivery experience, estimation and infrastructure sizing for data platforms
• Good communication, prioritisation and problem-solving skills

Required skills

• Programming with Python, Spark and Scala
• Data modelling and data governance tools (an advantage)
• JIRA and Atlassian products (an advantage)

What we offer

• A competitive remuneration package linked to individual and team performance
• Flexible working arrangements considered
• Continuous learning, coaching and leadership development
• An inclusive, diverse culture