Senior Software Engineer

About the role

H builds computer-use agents and the models behind them. This role involves building and maintaining the evaluation framework that orchestrates, runs, and observes benchmarks for these models. You will ensure the framework is reliable, scalable, and efficient while supporting researchers and forward-deployed engineers in integrating new benchmarks.

Responsibilities

• Provide integration support for researchers and forward-deployed engineers bringing in new benchmarks.
• Set standards for benchmark integration and build enforcement checks.
• Manage scheduling and observability to optimize cluster capacity.
• Ensure reproducible results across trials to support release decisions.
• Perform cluster tuning and develop integrations for browser extensions or desktop environments.
• Engage with customers to identify measurement needs and automate data flow into evaluation harnesses.

Required skills

• Backend development
• Python
• Test tooling
• QA tooling
• Distributed systems
• Kubernetes
• AWS
• API development
• REST
• GraphQL
• Relational databases
• Non-relational databases
• Message queues
• SQS
• RabbitMQ

Nice to have

• LLM quality measurement
• Agent development
• Docker
• Temporal
• Dask
• FastAPI
• PostgreSQL
• Grafana
• Datadog
• Playwright

About the Company

H builds computer-use agents and the models behind them. Developers use their technology through a managed API, and forward-deployed engineers take them into enterprise workflows.