Machine Learning Engineer

About the role

The Applied Machine Learning team owns production systems and pursues new ideas from conception through to deployment and iterative improvement. You will work with clinicians, assessors, and engineers to build reliable ML systems that help bring medical devices to market faster. You will own meaningful problems, define success with domain experts, and take ML systems through deployment and measurable improvement in production.

Responsibilities

• Build agents that search, parse and visually inspect messy technical files such as scanned certificates, tables, and architecture diagrams.
• Develop custom agent harnesses for retrieving information across large document collections in varied formats while minimizing hallucination.
• Define success with assessors and build datasets and benchmarks that capture a complex, nuanced domain.
• Measure retrieval quality, citation correctness, and agreement with expert judgment alongside the impact on assessor effort.
• Build useful agents that respect the impartiality and objectivity required of a certification body.

Required skills

• Applied Machine Learning
• Deep learning
• Information retrieval
• Software deployment
• Systems design
• Data evaluation

Nice to have

• Agent systems
• Tool use
• Document-understanding systems

About the Company

Scarlet is authorised to assess and certify medical devices, combining clinical, technical and regulatory expertise with AI agents and software. They help the world’s most ambitious technology companies shorten certification timelines for new AI-enabled medical devices.