AI Backend Engineer (Agent Systems)

About the role

A stealth AI startup, backed by one of Southeast Asia's leading technology companies, is building its global founding team. It is developing an AI-native communication platform that integrates AI directly into conversations so users can plan, organize, compare, research and complete tasks in a single intelligent assistant. The client is looking for an AI Backend Engineer to build and operate the backend infrastructure powering AI-driven experiences, focusing on the inference and orchestration layer between AI models and end users.

Key responsibilities

• Build, maintain and operate backend systems that power AI-enabled features in production.
• Design and implement AI inference pipelines, orchestration layers and service architectures around AI models.
• Develop scalable, high-performance APIs that integrate with frontend applications and machine learning systems.
• Optimize inference latency, throughput, caching, batching and streaming.
• Own production operations, including monitoring, logging, alerting and incident response.
• Troubleshoot issues in distributed systems and continuously improve backend architecture based on operational insights.

Required profile

• Strong backend engineering experience in production environments.
• Proven experience building and operating high-throughput, low-latency services and designing scalable APIs and distributed systems.
• Familiarity with AI inference patterns, including LLMs, embeddings and multimodal AI.
• Strong debugging and troubleshooting skills in distributed production environments.

Required skills

• Preferred: Python, Node.js, PyTorch, OpenAI, Anthropic or open-source LLMs, SQL and NoSQL databases, Kubernetes, Docker.