Hiring? Give your team the premium edgeExplore Grasshire Premium plans for employersGo Premium
Back to results

Together AI

Visit website

Senior Software Engineer — Infra Agent Systems

$170,000 – $210,0005+ yearsRemote

  • India
  • Full time
  • 6d ago

About the role

Together AI is seeking an experienced engineer to build and scale infrastructure agent systems that power a massive GPU fleet. You will design and own production-grade AI agent systems and core platform services from architecture through deployment. The role focuses on distributed systems, automation, and AI to drive reliability and performance across the company's infrastructure.

Responsibilities

  • Design and build production AI agent systems that diagnose, investigate, and remediate infrastructure issues across a large GPU fleet.
  • Build the distributed services, orchestration framework, knowledge graph, and retrieval systems that power infrastructure agents.
  • Develop fleet intelligence systems that combine telemetry, infrastructure state, operational knowledge, and historical incidents to help agents make better decisions.
  • Integrate with observability, incident management, ticketing, fleet inventory, source control, chat, and internal infrastructure systems through well-designed APIs.
  • Own services end to end, including architecture, implementation, testing, deployment, observability, and production operations.
  • Improve agent performance through evaluations, retrieval improvements, better tools, and production feedback loops.
  • Turn what agents learn in production into reliable, reviewed software and automation.

Required skills

  • Backend engineering
  • API design
  • Data modeling
  • Kubernetes
  • Cloud platforms
  • Go
  • TypeScript
  • Python
  • Rust
  • Distributed systems

Nice to have

  • AI agent systems
  • Knowledge graphs
  • Search systems

Qualifications

  • 5+ years of experience building production backend systems
  • Strong systems design and ownership from design to production

About the Company

Together AI is the AI Native Cloud.

Similar roles

Sign in to see roles like this one and search every open job.

Senior Software Engineer — Infra Agent Systems at Together AI · Grasshire