Senior Software Engineer, GenAI Platform

About the role

The GenAI Platform team builds shared infrastructure to help Deliveroo, DoorDash, and Wolt teams deploy GenAI-powered products and automation. This role involves leading the design and architecture of open-weights model platforms, including real-time GPU serving, high-throughput batch inference, and fine-tuning pipelines. You will own critical platform surfaces such as the LLM Gateway, guardrails, and cost attribution while pushing the performance and cost-efficiency of AI infrastructure.

Responsibilities

• Lead the design of infrastructure to move GenAI ideas from prototype to production.
• Own and evolve the open-weights serving stack, including real-time GPU endpoints and fine-tuning pipelines.
• Architect scalable, high-performance systems for model serving, batch inference, and GPU autoscaling.
• Push the cost and latency frontier of GPU inference while maintaining reliability and observability.
• Build platforms that support rapid experimentation while meeting production standards for latency and scale.
• Partner with ML engineers, product engineers, and data scientists to turn emerging GenAI capabilities into platform primitives.
• Set technical direction for the future of the company's centralised GenAI platform.

Required skills

• Python
• Distributed systems
• LLM inference
• Fine-tuning
• ML infrastructure
• GPU optimization
• API design
• Observability
• Production services

Nice to have

• vLLM
• SGLang
• TensorRT-LLM
• Kubernetes
• AWS
• GCP
• Modal
• AI agents
• RAG
• Vector databases

Qualifications

• BSc, MSc or PhD in Computer Science or equivalent
• 5+ years of industry experience in software engineering

About the Company

Deliveroo is now part of DoorDash, bringing together teams with greater reach, scale, and ambition to unlock new possibilities as one global team.