AI Infrastructure Engineer – Graduate (Recommendation & LLM)

About the role

Join TikTok's Model Infrastructure team to build the next‑generation AI infrastructure that powers the For You recommendation system and large language models. As a graduate engineer you will work on distributed training, high‑performance GPU computing, and scalable inference pipelines that serve billions of users daily.

Key responsibilities

• Design, develop, and optimise infrastructure for large‑scale model training and online inference.
• Implement distributed systems supporting recommendation models and LLMs.
• Improve GPU utilisation and communication efficiency through low‑level optimisation.
• Collaborate with researchers to prototype and deploy LLM training and serving solutions.
• Identify performance bottlenecks and deliver systematic improvements.

Required profile

• Completed or soon‑to‑complete Bachelor’s or Master’s in Computer Science, AI, Computer Engineering or related field.
• Strong programming ability in C++ or Python.
• Solid understanding of data structures, algorithms and computer systems.
• Familiarity with deep‑learning frameworks such as PyTorch or TensorFlow.
• Knowledge of Transformer architectures and large language models.

Required skills

• C++
• Python
• PyTorch
• TensorFlow
• GPU programming (CUDA, Triton)
• Distributed training concepts (Data Parallelism, Tensor Parallelism, Pipeline Parallelism, FSDP, ZeRO)
• Transformer and LLM fundamentals