AI Engineer, AI & Applications

About the role

Firmus Technologies is seeking an experienced AI Engineer to design, develop, implement and maintain the MLOps and AIOps foundations for the Firmus AI Factory platform. This role focuses on establishing end-to-end MLOps workflows, turning model development into a disciplined software release process with clear governance and automated evaluation. You will ensure AI platform features are engineered to be trustworthy, scalable, and reliable by partnering with cross-functional teams.

Responsibilities

• Design, develop, implement and maintain end-to-end MLOps workflows including training, evaluation, registry, deployment, monitoring, and retraining.
• Own the model registry and promotion lifecycle using MLflow, including stage/alias strategy, approvals, and integration with software release pipelines.
• Establish reproducibility and lineage across the model lifecycle, including versioned code, configuration, and artifact traceability.
• Design, develop and implement automated model quality gates for production, including accuracy, latency, cost, safety and reliability requirements.
• Define SLOs/SLIs for all AI platform features, including training job success rate, inference latency, and RAG retrieval accuracy.
• Develop and maintain production monitoring dashboards to track model performance, data drift and operational health.
• Create on-call runbooks and triage procedures for AI service incidents and lead postmortem-driven improvements.
• Instrument AI services for debugging, including request traces, GPU metrics, and retrieval performance.
• Integrate evaluation frameworks, including benchmarking, RAGAS and LLM-as-judge, into CI/CD pipelines.

Required skills

• MLOps
• MLflow
• CI/CD
• Software Engineering
• Production Engineering
• Distributed systems
• Model versioning
• Monitoring
• Incident response

Nice to have

• RAGAS
• LLM-as-judge
• SRE

Qualifications

• Bachelor’s degree or higher qualification in Software Engineering, Computer Science, Information Technology or a closely related field.

About the Company

Firmus is a company committed to building a diverse and inclusive workplace, focused on revolutionizing the AI industry through sustainable practices and cutting-edge engineering.