Data Engineer

About the role

The Data Engineer will be responsible for building and maintaining data pipelines and processing systems. This role involves working with large-scale data platforms and cloud-based infrastructure to support data-driven initiatives.

Responsibilities

• Develop and maintain data pipelines using Scala, Python, and Spark
• Manage data workflows using Airflow and Hive
• Implement and optimize data solutions on GCP or AWS platforms
• Integrate and manage data from various sources including Kafka, MongoDB, and MySQL

Required skills

• Scala
• Python
• Hive
• Airflow
• Spark
• GCP
• AWS
• Kafka
• Hadoop

Nice to have

• AdTech domain experience