Senior Data Engineer

About the role

The Senior Data Engineer will design and develop high-performance, scalable data pipelines while ensuring data integrity and security. This role involves optimizing distributed data processing, implementing best practices in data architecture, and providing technical leadership to the engineering team.

Responsibilities

• Design and develop high-performance, scalable data pipelines using PySpark, SQL, and cloud platforms.
• Optimize distributed data processing for improved efficiency and reliability.
• Implement best practices in data modeling, architecture, and governance.
• Ensure data integrity, security, and compliance within cloud environments.
• Automate data workflows, monitor pipeline performance, and troubleshoot issues proactively.
• Provide technical leadership and mentorship to junior engineers.

Required skills

• PySpark
• SQL
• Data modeling
• Data architecture
• Cloud platforms