Senior AI Engineer – LLM Skilling Solutions

About the role

BCG U is building AI-based solutions for professional skilling, performance development and capability building, combining its proprietary knowledge with large language model technology to deliver personalised coaching and skill development at scale. This is a strategically important and growing area, and the successful candidate will work across the full lifecycle of the initiatives, from refining and validating the technical architecture to overseeing delivery. The role is a 12-month contract with meaningful work from day one, and may span one or more initiatives depending on business need.

Key responsibilities

• Refine and validate the technical architecture for AI skilling solutions with product and knowledge leadership, challenging assumptions and identifying gaps.
• Make and document key technical decisions on cloud infrastructure, LLM integration patterns, API design, data architecture, vector store configuration and security.
• Produce technical specifications for external vendor teams and oversee their delivery against them.
• Establish coding standards, review processes and architectural guardrails to protect quality and intellectual property.
• Design and implement LLM integration patterns such as RAG pipelines, model-agnostic abstraction layers and prompt engineering frameworks.
• Ensure security, data governance and privacy requirements are met, including encryption, tenant isolation, RBAC and GDPR compliance.
• Identify and manage technical risks across the delivery lifecycle and contribute to the broader thinking on how these solutions should be architected.

Required profile

• 7-10 years in software engineering, with at least 3 years building and delivering LLM-based products in production.
• Direct experience with RAG architectures, prompt engineering, vector databases and LLM evaluation frameworks.
• Comfortable owning architecture decisions on cloud infrastructure, API design and data architecture.
• Experience producing technical specifications and overseeing external vendors.
• Background in enterprise software delivery, with familiarity with security, data governance and scalability.
• Clear communicator who can explain technical decisions to non-technical stakeholders, comfortable with ambiguity and able to move at pace.

Required skills

• Hands-on LLM APIs: Anthropic Claude, OpenAI GPT-4, Google Gemini or equivalent.
• Vector stores: Azure AI Search, Pinecone, Weaviate or equivalent.
• Cloud platforms: Azure (preferred), AWS or GCP.
• Speech and multimodal: Azure Cognitive Services, ElevenLabs, HeyGen or equivalent.
• Security: encryption standards, GDPR, tenant isolation, SSO and RBAC.
• API design, microservices and containerisation.
• Fluency with Claude Chat and Claude Code is a strong plus.