Principal Data Engineer and Azure Cloud Infrastructure
At Optum, we're a global organisation that delivers care, aided by technology to help millions of people live healthier lives.
About the Role
We're one of the world's leading healthcare companies, with no limits on resources or challenges. With a continued record of growth and stability, we're always looking for fresh talent to join our expanding teams.
As a Principal Data Engineer, you'll manage Azure related data architecture and cloud infrastructure supporting complex risk models (statistical/AI/ML).
Main Responsibilities
* Design, configure, manage data engineering infrastructure on the cloud (Databricks/Azure Data Factory/Azure Data Lake)
* Maintain data ingestion and exposure (including via APIs) with high security and availability
* Ensure data quality standards are established and enforced
* Build infrastructure using code and repeatable designs in Terraform
* Maintain Azure cloud infrastructure across prod and non-prod environments
* Identify and resolve security and compliance vulnerabilities
* Troubleshoot production support issues post-deployment and come up with solutions as required
Requirements
* Extensive hands-on experience developing data pipelines that demonstrate a strong understanding of software engineering principles
* Excellent knowledge of Azure Services such as Blobs, Functions, Azure Data Factory, Service Principal, Containers, Key Vault etc.
* Experience working with both real-time and batch data, knowing the strengths and weaknesses of both and when to apply one over another
* Experience developing and deploying APIs
* Expert skills in Python, SQL, Spark
Preferred Qualifications
* Experience using Dev Ops tools, Git workflow and building CI/CD pipelines
* Experience working in projects with agile/scrum methodologies
* Solid understanding of Artificial Intelligence and Machine Learning capabilities
Estimated salary: €80,000 - €110,000 per year.