Data Engineer

About the role

An experienced Data Engineer is sought to design, develop and maintain scalable data pipelines, cloud-based data platforms and enterprise system integrations. The role supports data engineering, solution architecture, cloud integration and geospatial data processing, working with Data Managers, Business Analysts, Software Engineers and Cloud Engineers to turn business requirements into technical solutions.

Key responsibilities

• Design, develop, maintain and optimise data pipelines for structured, unstructured and geospatial datasets, including data models, schemas, transformation logic and quality monitoring.
• Design end-to-end solutions across cloud platforms, data systems and AI services, integrating Azure Databricks, Azure cloud services, AI/ML platforms and geospatial applications.
• Integrate data platforms with AI/ML services for model development, inference and AI-enabled applications, exploring RAG, vector search and AI agents.
• Build geospatial data processing workflows, integrate with mapping services and analytical tools, and use spatial databases, APIs and GIS services.
• Maintain data platforms across development, testing and production, including upgrades, monitoring, logging, CI/CD pipelines, version control and secure access management.
• Perform technical solutioning, proof-of-concepts and assessments, and communicate recommendations and trade-offs to stakeholders.

Required profile

• Degree in Computer Science, Computer Engineering, Information Systems, Software Engineering or a related discipline.
• Experience designing, developing, deploying and maintaining data pipelines and cloud-based data platforms.
• Experience integrating data platforms, cloud services and enterprise applications.
• Strong troubleshooting, analytical and problem-solving skills, and good communication and documentation skills.

Required skills

• Azure Databricks and Azure cloud services
• REST APIs, ETL/ELT processes and database connectivity
• Data governance, security and identity and access management