Big Data Platform Engineer

About the role

A leading organization investing in a modern enterprise data platform to support analytics, AI and data-driven decision-making is seeking a Big Data Platform Engineer. The role operates, automates and enhances the enterprise big data platform, joining a high-performing technology team focused on the reliability, scalability and operational excellence of mission-critical data infrastructure.

Key responsibilities

• Administer, maintain and continuously improve the enterprise big data platform, ensuring high availability, performance and security in production environments.
• Manage platform operations, monitor system health, troubleshoot complex issues and implement best practices for reliability and resilience.
• Work with data engineers, platform engineers, infrastructure teams and architects to automate provisioning, deployment, configuration and operations using scripting and Infrastructure as Code.
• Contribute to DevOps initiatives by building automated deployment pipelines and reducing manual intervention.
• Support platform upgrades, capacity planning, patch management, disaster recovery and performance tuning.

Required profile

• System Engineer with 5 years of experience supporting enterprise data platforms or big data environments.
• Strong DevOps experience, including automation, scripting, CI/CD and Infrastructure as Code.
• Hands-on experience managing enterprise big data platforms; on-premises Cloudera Data Platform (CDP) experience highly preferred.
• Experience with the Hadoop ecosystem is advantageous but not essential.
• Enjoys solving complex infrastructure challenges in an enterprise platform engineering environment; hands-on technical consultants can be considered.

Required skills

• Infrastructure as Code with Terraform, Ansible or similar tools
• CI/CD and automation scripting
• Cloudera Data Platform (CDP) administration (preferred)

To apply, candidates apply directly through the recruiter or send their resume to the named contact at Kerry Consulting; only shortlisted candidates will be notified.