Data Engineer (Fixed-Term, 1 Year)

About the role

Activate Interactive, a technology consultancy in Singapore, is hiring a Data Engineer for its Co-Development Business Unit. The role is fixed-term for 1 year and involves working with Singapore government agencies. You will build and maintain data pipelines and data models in data warehouses, data lakes and data virtualisation environments.

Key responsibilities

• Design, develop and deploy data tables, views and marts in data warehouses, operational data stores, data lakes and data virtualisation.
• Perform data extraction, cleaning, transformation and flow; web scraping may be part of the scope.
• Build, launch and maintain large-scale batch and real-time data pipelines with data processing frameworks.
• Integrate and collate data silos in a scalable and compliant way.
• Work with Project Managers, Data Architects, Business Analysts, Frontend Developers, Designers and Data Analysts to build scalable data-driven products.
• Develop backend APIs and work on databases supporting the applications.
• Work in an Agile environment with continuous integration and delivery, including pair programming and code review.

Required profile

• Experience in cloud technologies such as GCP, GCC (AWS, Azure, Google Cloud).
• Experience building production-grade data pipelines and ETL/ELT integrations.
• Familiarity with data modelling, data access and storage infrastructure such as data mart, data lake, data warehouse and data virtualisation.
• Familiarity with REST APIs and web request protocols.
• Familiarity with big data frameworks and tools (Hadoop, Spark, Kafka, RabbitMQ).
• Familiarity with W3C DOM and custom web scraping (BeautifulSoup, CasperJS, PhantomJS, Selenium, Node.js).
• Knowledge of data governance, access control and security best practices.
• Comfortable in at least one scripting language (SQL, Python) and in both Windows and Linux environments.

Required skills

• Database design and SQL, PostgreSQL, MySQL, SQLite, MongoDB, VoltDB, Cassandra, AWS S3, Athena.
• ETL/ELT tools such as SSIS, AWS DMS, AWS Lambda, ECS, EventBridge, AWS Glue, Spring.
• Big data frameworks such as Hadoop, Spark, Kafka, RabbitMQ.

What we offer

• Competitive market salary and a variable performance bonus.
• Medical coverage, life and health insurance, and flexible benefits or allowance.
• Wellness support, learning programmes, certification support and a staff development budget.
• Structured career pathways on technical, domain expert or leadership tracks.
• Flexible work arrangements (flexi-place, flexi-time, flexi-load).