Senior Data Engineer - AI

About the role

Anaplan is seeking a Senior Data Engineer to work across the full stack of their AI applications. You will build transformative AI capabilities from the ground up, including model integration, prompt engineering, and the technical direction for data governance and storage for LLM-based systems. This role involves building user-facing AI features that directly impact business planning and decision-making.

Responsibilities

• Contribute to the data architecture, design, and deployment of scalable Generative AI and Machine Learning systems into production environments.
• Develop end-to-end GenAI features, including backend API services, model integration, model monitoring, evaluations, and deployments.
• Integrate and optimise LLMs for specific use cases in business planning, including prompt engineering and RAG implementation.
• Design and build the retrieval and knowledge layer powering RAG and agentic workloads, such as vector databases, graph databases, knowledge graphs, hybrid search, and embedding pipelines.
• Help design the knowledge graph that captures the semantics of customer models, metrics, hierarchies, and relationships.
• Build the data plane for evaluation and continuous improvement, working with cutting-edge conversational and agentic AI technologies.
• Engineer the feature and context pipelines that feed forecasting and anomaly-detection models at customer scale, balancing batch and streaming patterns.
• Implement evaluation frameworks to measure and improve GenAI feature quality, including accuracy, latency, and user satisfaction metrics.

Required skills

• Data engineering
• AI/ML production
• LLM-based systems
• RAG architectures
• Embedding pipelines
• Vector databases
• Graph databases
• Knowledge graphs
• MLOps
• LLMOps
• Python
• CI/CD

Nice to have

• Cloud-native ML infrastructure
• Pinecone
• Weaviate
• Qdrant
• vLLM
• TensorRT
• Ray
• A/B testing
• LangSmith
• MLflow

About the Company

Anaplan is a team of innovators focused on optimizing business decision-making through their leading AI-infused scenario planning and analysis platform. Their customers include global companies such as Coca-Cola, LinkedIn, Adobe, LVMH, and Bayer.