Controllable Video Generation Researcher

About the role

Lightspeed Studios, part of Tencent, develops games such as PUBG Mobile and aims to bring next-generation experiences to gamers. Its Lightspeed Tech Center is an R&D department that researches and delivers technologies for engines, audio, QA, AI and more. This role is a researcher designing controllable video generation for games.

Key responsibilities

• Design a multimodal controllable generation framework supporting inputs such as keyboard, controller, trajectory and voice.
• Research high-fidelity generation under sparse control signals and extend conditional control paradigms in the video domain.
• Decouple and combine trajectory, camera, motion and posture control, and design control modules tailored to different game genres.
• Develop video generation for multi-player collaborative control with low latency and inter-frame state retention.
• Work with Engine and Agent teams to define standardized interfaces for controllable signals.
• Drive joint optimization of controllable generation and Reinforcement Learning post-training.

Required profile

• Ph.D. in AI-related fields, focusing on Computer Vision or Deep Learning.
• Project experience in camera control, trajectory control or posture control.
• Understanding of game engine input/output logic and frame synchronization.
• Experience in Game AI or game development preferred; real-time/interactive video generation experience preferred.

Required skills

• Familiarity with conditional generation models, multi-player/multi-channel control and diffusion models.
• Proficiency in Python and PyTorch.
• Publishations in controllable video generation or conditional generation.