Jobiglo

No results.

Senior Data Engineer (Databricks)

Sembcorp Industries Ltd · Singapour

New
Senior 🇬🇧 English
Databricks PySpark Python SQL Delta Lake Apache Spark Unity Catalog CI/CD Git Azure AWS GCP Kafka Event Hubs MQTT LLMs Genie MCP

Job description

About the role

Sembcorp, an energy and urban solutions provider headquartered in Singapore, is looking for a hands-on Senior Data Engineer with 5+ years of data engineering experience and strong practical experience with Databricks. You will join the Data & AI Innovation team, building reliable and scalable data solutions and exploring ways to automate recurring engineering and BAU activities using Databricks, AI and agentic capabilities.

Key responsibilities

  • Design, develop and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Python, SQL and Delta Lake.
  • Build and support data solutions following Lakehouse and medallion architecture principles.
  • Integrate data from databases, APIs, files, streaming sources and IoT devices.
  • Implement data quality, reconciliation, incremental processing, schema management and recovery mechanisms.
  • Monitor and troubleshoot production pipelines, data freshness, performance and reliability issues.
  • Identify repetitive BAU activities and develop automation or agentic solutions to reduce manual effort.
  • Explore Databricks and AI capabilities such as Genie, MCP, LLMs and agents to improve workflows.
  • Apply software engineering and DevOps practices, including testing, logging, version control and CI/CD.

Required profile

  • 5+ years of hands-on data engineering experience.
  • 2-4 years of hands-on Databricks experience preferred; candidates with strong practical knowledge of Spark, PySpark, SQL and modern Lakehouse architectures are also encouraged to apply.
  • Experience building and supporting production-grade ETL/ELT pipelines.
  • Experience with cloud data platforms such as Azure, AWS or GCP.
  • Good understanding of data quality, monitoring, troubleshooting and performance optimization.
  • Experience with DevOps practices, including Git, CI/CD, testing and deployment.
  • Relevant Databricks certification.

Required skills

  • Strong hands-on skills in Python, PySpark and SQL.
  • Apache Spark, Delta Lake and Databricks Jobs or Workflows.
  • Lakehouse and medallion architecture.
  • Preferred: Unity Catalog, Auto Loader, Lakeflow, Structured Streaming, Databricks Asset Bundles, streaming technologies (Kafka, Event Hubs, MQTT), LLMs, AI agents, MCP, Databricks Genie, RAG and model serving.

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec Sembcorp Industries Ltd.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 17 hours ago

Expires 1 month from now

7 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

Sembcorp Industries Ltd

Singapour