Staff / Senior Software Engineer (Agentic Search) - Runtime

About the role

Nebius is building an agent-native search platform designed for AI systems to retrieve and reason over real-world data. We are looking for a Senior Software Engineer to develop the runtime systems for this search engine. You will focus on building low-latency, high-throughput services that handle thousands of requests per second while ensuring performance, predictability, and efficiency.

Responsibilities

• Design, implement, and operate core runtime services for serving search queries at scale
• Build and optimise request flows, including query processing, retrieval orchestration, and response assembly under strict latency budgets
• Develop systems that maintain performance and predictability under high load
• Optimise CPU, memory, and data access patterns in performance-critical paths
• Ensure reliability, observability, and predictability across production services
• Build well-tested systems with clear responsibilities and interaction contracts, while remaining flexible as architecture evolves
• Define and implement observability primitives, including structured logs, metrics, traces, and latency breakdowns
• Monitor throughput, latency, and resource usage, and drive improvements in performance and cost efficiency
• Collaborate with indexing and ML teams to integrate retrieval and ranking components, keeping ML logic decoupled from core system internals
• Support experimentation and iteration through controlled rollouts and rigorous benchmarking

Required skills

• C++
• Rust
• Backend systems
• High-load systems
• Low-latency systems
• Performance tuning

Nice to have

• DBMS internals
• Cloud infrastructure
• High-load web applications
• Large-scale APIs
• Trading platforms
• Real-time data pipelines

Benefits

• Competitive compensation
• Career growth and learning opportunities
• Flexibility and ownership
• Collaborative and innovative culture

About the Company

Nebius is a full-stack AI cloud platform supporting developers and enterprises from data and model training through to production deployment. Listed on Nasdaq, the company has a global footprint with R&D hubs across Europe, the UK, North America and Israel.