Senior Software Engineer

About the role

H builds computer-use agents and the models behind them. This role involves building and maintaining the evaluation framework that orchestrates, runs, and monitors benchmarks for these agents. You will ensure the framework is reliable, fast, and scalable to support the company's growing research and product needs.

Responsibilities

• Provide integration support for researchers and engineers bringing in new benchmarks.
• Set standards for benchmark entry into the framework and build enforcement checks.
• Manage scheduling and observability to optimize cluster capacity and job throughput.
• Ensure reproducible results across trials to support release decisions.
• Collaborate with customers to identify measurement needs and automate data flows into evaluation harnesses.

Required skills

• Backend development
• Python
• Distributed systems
• Kubernetes
• AWS
• API development
• REST
• GraphQL
• Relational databases
• Non-relational databases
• Message queues
• Metrics
• Tracing
• Monitoring

Nice to have

• LLM quality measurement
• Agent development
• Docker
• Virtual machines
• Temporal
• Dask
• FastAPI
• PostgreSQL
• Grafana
• Datadog

About the Company

H builds computer-use agents and the models behind them. Developers use these agents through a managed API, and forward deployed engineers integrate them into enterprise workflows.