Senior AI Observability & Telemetry Engineer

About the role

Bitdeer, a technology company for Bitcoin mining and AI cloud headquartered in Singapore, is hiring a Senior AI Observability & Telemetry Engineer in Singapore. You will build and scale telemetry infrastructure for AI workloads, integrate hardware exporters into the Kubernetes observability stack, and help define observability standards for AI-native workloads.

Key responsibilities

• Architect and scale a high-cardinality telemetry infrastructure using highly available time-series databases (e.g. VictoriaMetrics, Thanos or Mimir) that can handle massive ingestion rates.
• Integrate hardware-level exporters (NVIDIA DCGM, network switch telemetry, IPMI/Redfish) into the Kubernetes observability stack to give a unified cluster view.
• Build eBPF-based diagnostic tools to trace network congestion, kernel-level I/O latency and distributed training bottlenecks.
• Develop automated dashboards and alerting pipelines that proactively cordon degraded hardware before it affects customer training jobs.
• Design metric pipelines for accurate, multi-tenant consumption billing based on real-time GPU and network utilization.
• Work with the GPU Systems and Scheduling teams to set observability standards for AI-native workloads.
• Lead technical design reviews and mentor team members on high-performance telemetry collection and analysis.

Required profile

• Bachelor's or Master's degree in Computer Science, Electrical Engineering or a related field.
• 6+ years of software or site reliability engineering experience.
• Proven track record of operating, debugging and scaling large-scale telemetry stacks in high-performance computing or cloud environments.
• Strong technical leadership and communication skills, and experience in high-velocity, high-growth engineering environments is strongly preferred.

Required skills

• Deep hands-on expertise in the Prometheus/OpenTelemetry ecosystem.
• Advanced Go and custom Kubernetes metric exporters and operators.
• eBPF, BCC and Linux performance tuning.
• Familiarity with AI hardware metrics (GPU power states, SM utilization, memory bandwidth) and high-performance network telemetry.

What we offer

• A culture that values authenticity and diversity, with an inclusive, open-workspace environment.
• Fast-growing company with direct impact on the digital asset industry.
• New projects, process development, personal accountability, autonomy and learning opportunities.
• Welfare benefits and training and mentoring.