Senior Data Engineer (Databricks)
Sembcorp Industries Ltd · Singapour
Job description
About the role
Sembcorp, an energy and urban solutions provider headquartered in Singapore, is looking for a hands-on Senior Data Engineer with 5+ years of data engineering experience and strong practical experience with Databricks. You will join the Data & AI Innovation team, building reliable and scalable data solutions and exploring ways to automate recurring engineering and BAU activities using Databricks, AI and agentic capabilities.
Key responsibilities
- Design, develop and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Python, SQL and Delta Lake.
- Build and support data solutions following Lakehouse and medallion architecture principles.
- Integrate data from databases, APIs, files, streaming sources and IoT devices.
- Implement data quality, reconciliation, incremental processing, schema management and recovery mechanisms.
- Monitor and troubleshoot production pipelines, data freshness, performance and reliability issues.
- Identify repetitive BAU activities and develop automation or agentic solutions to reduce manual effort.
- Explore Databricks and AI capabilities such as Genie, MCP, LLMs and agents to improve workflows.
- Apply software engineering and DevOps practices, including testing, logging, version control and CI/CD.
Required profile
- 5+ years of hands-on data engineering experience.
- 2-4 years of hands-on Databricks experience preferred; candidates with strong practical knowledge of Spark, PySpark, SQL and modern Lakehouse architectures are also encouraged to apply.
- Experience building and supporting production-grade ETL/ELT pipelines.
- Experience with cloud data platforms such as Azure, AWS or GCP.
- Good understanding of data quality, monitoring, troubleshooting and performance optimization.
- Experience with DevOps practices, including Git, CI/CD, testing and deployment.
- Relevant Databricks certification.
Required skills
- Strong hands-on skills in Python, PySpark and SQL.
- Apache Spark, Delta Lake and Databricks Jobs or Workflows.
- Lakehouse and medallion architecture.
- Preferred: Unity Catalog, Auto Loader, Lakeflow, Structured Streaming, Databricks Asset Bundles, streaming technologies (Kafka, Event Hubs, MQTT), LLMs, AI agents, MCP, Databricks Genie, RAG and model serving.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Singapore.
Salary: Data Engineer Based on 22 job offers in SingaporeSalaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 17 hours ago
Expires 1 month from now
6 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Sembcorp Industries Ltd
Singapour
Related job offers
-
Workday Integration Consultant
Ambition Singapour -
Senior Consultant / Business Analyst - Alteryx Migration & Rollout (Banking)
ABeam Consulting Singapour -
AI Strategist - Senior Director
Cognizant Singapour -
Data Scientist (Analytics), Financial Services - Lending
Grab Singapore -
Principal (Financial Services & Banking)
Infosys Singapore & Australia Singapore