Data Engineer – Cloud & Big Data Specialist

About the role

We are looking for a skilled Data Engineer to design, develop, and maintain robust data pipelines and storage solutions on AWS and Databricks. The role involves transforming raw data into actionable insights for analytics and machine‑learning initiatives, particularly in the healthcare domain.

Key responsibilities

• Design and implement data repositories such as operational data stores, data marts, and data lakes.
• Build, optimize, and monitor ETL/ELT workflows using AWS native services, Databricks, and Informatica IDMC.
• Develop data models (star and snowflake schemas) and write complex queries in SQL, NoSQL and Spark SQL.
• Integrate machine‑learning and AI frameworks for predictive analytics.
• Apply DevOps practices, including IaC (Terraform, CloudFormation) and CI/CD pipelines for data infrastructure.
• Ensure data security, governance, and compliance, especially for healthcare data.
• Collaborate with cross‑functional teams and communicate technical solutions to non‑technical stakeholders.

Required profile

• Master’s degree or equivalent in Computer Science, IT, or Engineering.
• Minimum 5 years of experience in data warehousing, big data, or advanced analytics.
• Strong knowledge of AWS services (Glue, Redshift, S3, Lambda, Kinesis, Athena, EMR).
• Hands‑on experience with Databricks (Delta Lake, MLflow, Spark) and Informatica Data Management Cloud.
• Proficiency in Python or R for data transformation and analytics.
• Experience with data visualization tools such as Power BI or Tableau.

Required skills

• Oracle, MS SQL, MySQL, Teradata
• Databricks, Delta Lake, MLflow, Spark
• Informatica Data Management Cloud (IDMC)
• AWS Glue, Redshift, S3, Lambda, Kinesis, Athena, EMR
• Python, R
• Power BI, Tableau
• Terraform, CloudFormation
• CI/CD pipelines, IAM, data governance