Machine Learning Engineer - LLMs

About the role

Prosus is seeking an experienced Machine Learning Engineer to develop domain-specific language models. You will own the full training pipeline, from continued pre-training on proprietary data to fine-tuning and advanced post-training techniques. The role involves turning research concepts into robust production systems that impact millions of users.

Responsibilities

• Analyze model performance and training data to identify improvement opportunities and formulate hypotheses for enhancement
• Design, execute, and rigorously evaluate experiments to improve model quality, training efficiency, and downstream task performance
• Train large language models for our domain through continued pre-training and full parameter fine-tuning on proprietary datasets
• Design and implement post-training pipelines using RLHF, DPO, GRPO, and other reinforcement learning techniques
• Build and optimize distributed training infrastructure across multi-node GPU clusters using frameworks like DeepSpeed, FSDP, Megatron-LM, or Axolotl
• Own large-scale data preparation including filtering, quality assessment, deduplication, and data mixture strategies
• Generate and curate high-quality synthetic data for instruction fine-tuning and capability enhancement
• Build robust evaluation frameworks to measure model quality and guide training decisions

Required skills

• Machine Learning
• LLM
• Python
• PyTorch
• Distributed systems
• DeepSpeed
• FSDP
• Megatron-LM
• Axolotl
• Transformers
• Accelerate

Nice to have

• RLHF
• DPO
• GRPO
• vLLM
• Quantization
• Model compression
• Distillation

Qualifications

• 3+ years of ML engineering experience
• Proven experience training and deploying language models to production
• Experience preparing large-scale training datasets
• Hands-on experience with distributed training frameworks

Benefits

• H200 GPU fleet
• Top-spec MacBook Pro

About the Company

Prosus is a global technology company powering leading lifestyle ecommerce businesses across India, Latin America, Europe and beyond. With an AI-driven ecosystem spanning 100+ companies, the firm focuses on innovation, results, and entrepreneurship.