Observability Engineer

About the role

BCS, a wholly owned subsidiary of NETS in the NETS Group, manages and operates clearing and payment infrastructure for the Singapore Automated Clearing House, including FAST, IBG, CTS, and services for PayNow and SGQR. The Observability Engineer designs, implements and operates enterprise observability solutions using the ELK Stack (Elasticsearch, Logstash, Kibana) and AWS monitoring services, covering telemetry ingestion, monitoring, alerting, automation and actionable insights. The role also leads observability initiatives from conception to implementation.

Key responsibilities

• Manage and enhance enterprise observability platforms, focusing on ELK Stack and AWS service monitoring.
• Design, implement and maintain end-to-end telemetry pipelines: log ingestion, parsing, enrichment and integration of logs, metrics, traces and events.
• Develop dashboards, visualizations, alerts and monitoring solutions for infrastructure, application and operations teams.
• Partner with stakeholders to define requirements, set best practices and drive observability adoption.
• Provide technical support for observability tools, acting as incident/problem coordinator and troubleshooting issues.
• Liaise with application, infrastructure, security and operations teams, and with vendors on requirements, solutioning and validation.
• Prepare and update documentation, knowledge base, SOPs and best practices.

Required profile

• Bachelor's degree in information technology, computer science or a related field.
• Minimum 3 years of hands-on experience with Elasticsearch, Logstash and Kibana, including cluster management, log ingestion, regex/grok parsing, filtering and enrichment.
• Experience handling audit and risk activities from MAS, group audit, risk and compliance and third-party auditors is an advantage.

Required skills

• Understanding of observability principles: telemetry, Golden Signals, monitoring frameworks and actionable insights.
• Hands-on experience with AWS monitoring and observability services.
• Exposure to Grafana, Dynatrace or SolarWinds.
• Python scripting for automation and integration, REST APIs and OpenTelemetry (OTEL).
• Familiarity with AI/ML concepts such as anomaly detection, LLMs and RAG is highly desirable.
• Strong communication, stakeholder management and problem-solving skills.