Senior Data Architect (ELT, PySpark/Hadoop)

About the role

Infosys Singapore & Australia is looking for a highly experienced Data Architect to join its team. The ideal candidate has 12-15 years of experience architecting data engineering solutions focused on ELT and PySpark/Hadoop workloads, with strong solution and delivery skills, a view on business growth and stakeholder management.

Key responsibilities

• Design and implement high-performance, scalable and secure data architectures.
• Work with business stakeholders to understand their data needs and turn them into technical requirements.
• Design and develop data pipelines and workflows using ELT principles and PySpark/Hadoop.
• Optimize data pipelines and workflows for performance and efficiency.
• Work with data scientists and engineers so that data is accessible and usable for analytics and machine learning.
• Implement data governance and security best practices.
• Manage and mentor data engineers.
• Contribute to the overall data engineering strategy and roadmap.

Required profile

• 12-15 years of experience in data engineering, focused on ELT and PySpark/Hadoop workloads.
• Strong experience designing and implementing high-performance, scalable and secure data architectures.
• Experience with data governance and security best practices.
• Experience managing and mentoring data engineers.
• Excellent communication and interpersonal skills, able to work independently and in a team, with strong problem-solving and analytical skills.

Required skills

• Desired: cloud platforms such as AWS, Azure or GCP.
• Desired: big data technologies such as Spark, Hadoop, Hive and Kafka.
• Desired: data warehousing and data lakes.
• Desired: DevOps and MLOps practices.
• Desired: data science, machine learning, streaming data processing, real-time analytics, data visualization and reporting tools.