Software Engineer, Model Deployment

About the role

OpenAI is seeking a software engineer to design and develop systems that support the model lifecycle in production, including deployment orchestration, configuration management, and operational automation. You will transform complex operational processes into scalable platform capabilities to enable teams to deploy and manage models with greater confidence. This role focuses on building software that makes production infrastructure easier to run at scale.

Responsibilities

• Build and evolve the platform used to deploy, configure, and manage models across ChatGPT.
• Develop systems for deployment orchestration, model rollouts, operational visibility, and production readiness.
• Create abstractions and tooling that simplify complex infrastructure and improve the developer experience.
• Automate operational workflows, including incident detection, diagnosis, mitigation, and recovery.
• Improve the reliability, scalability, and efficiency of model deployments and the infrastructure that supports them.
• Build systems that support capacity planning, resource allocation, and infrastructure utilization.
• Partner with research, infrastructure, and product engineering teams to identify common challenges and deliver reusable platform capabilities.
• Shape the technical direction of the model management platform as ChatGPT and its underlying systems continue to evolve.

Required skills

• Distributed systems
• Platform engineering
• Infrastructure automation
• Go
• Python
• C++
• Rust
• Systems design
• Observability
• Incident response

Qualifications

• Five or more years of software engineering experience building production infrastructure
• Experience designing or operating highly available distributed systems
• Experience with platform engineering, infrastructure engineering, production engineering, site reliability engineering, or similar disciplines

About the Company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. They push the boundaries of AI capabilities and seek to safely deploy them to the world through their products.