Job Description
About the Role:
We are seeking experienced data engineers to join our client's newly formed team, responsible for designing, developing, and implementing end-to-end data pipelines. This is an excellent opportunity for individuals who enjoy problem-solving and have a strong background in data engineering.
Key Responsibilities:
* Design and develop complex data pipelines, incorporating business logic in collaboration with stakeholders.
* Migrate existing data pipelines from on-prem Hadoop to the Azure cloud environment.
* Conduct thorough data quality checks and ensure data integrity throughout the pipeline lifecycle.
* Mentor and guide junior team members on data engineering principles and best practices.
Requirements:
* Proven experience with Python, Py Spark, and Databricks.
* Ideal experience with data visualisation tools.
* Experience working within a cloud environment, preferably Azure.
What We Offer:
* A competitive salary package.
* Medical, dental, and vision care.
* Pension plan.
* Annual bonus and performance-based incentives.
* Flexible work-from-home arrangement.