Senior Data Engineer
As a global leader in healthcare, Optum delivers care aided by technology to help millions of people live healthier lives. Our team works to directly improve health outcomes by connecting people with the care, pharmacy benefits, data, and resources they need to feel their best.
About the Role:
We are a Fortune 5 business with no limits on the resources you'll have or the challenges you'll encounter. We've been supporting global healthcare systems for over 20 years from Ireland and the UK, building a dynamic and diverse team of over 2,100 talented individuals. With continued growth and stability, we're always looking for fresh talent to join our expanding teams.
As a Senior Data Engineer, you will work on and bring your experience as a Data Engineer to the OPEN team's projects, assisting the team with mentoring and the development of more junior team members. You'll also discover career opportunities from an Industry Leader.
Working Schedule:
This is a full-time position with standard working hours of Monday – Friday, standard business hours. You will have the opportunity to split your monthly work hours between our Dublin office and telecommuting from a home-based office in a hybrid work model.
Primary Responsibilities:
* Design and build data pipelines (mostly in Databricks/Spark/DBT) to process terabytes of data.
* Orchestrate in Azure Data Factory/Airflow the data tasks to run on Databricks or Azure Container Instances for the ingestion, processing, and cleaning of data.
* Design, build, and maintain Azure Postgres database.
* Design, build and maintain effective OLTP database optimization tactics to facilitate the processing of large numbers of concurrent updates.
* Create Docker images for various applications and deploy them on Azure.
* Design and build best-in-class processes to clean and standardize data.
* Design and build tests in Great Expectations/DBT Elementary.
* Troubleshoot production issues in our Azure Environment.
* Tuning and optimizing data processes and pipelines.
* Data Modelling for transactional databases.
* Data Modelling of big volume datasets to maximize performance for our customers.
* Sustainment of existing data pipelines.
You will be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role, as well as providing development for other roles you may be interested in.
Required Qualifications of the Senior Data Engineer:
* Bachelor's degree in Electronics Engineering, Computer Science, Information Technology, or a related field or equivalent experience.
* Advanced skills in developing processes in Spark/Databricks/Relational Databases.
* Experience with Airflow in implementation of data pipeline orchestrations, Airflow operators, and hooks.
* Previous experience with Relational Databases (RDBMS) and Non-Relational Database.
* Previous experience in implementation of ETL applications, Data warehousing/data modeling principles, architecture, and its implementation in large environments.
* Working Knowledge on public clouds like Azure, AWS, Google Cloud, and developing applications on Linux environments.
* Writing complex SQL queries.
* Building ETL/data pipelines.
* Exposure to Docker.
* Related/complementary open-source software platforms and languages (e.g., Python, Java, Linux) (Python preferred).
* Agile development methodology.
* Experience of Data Build Tool (DBT).
Preferred Qualifications:
* Problem-solving experience applied to a Big Data environment and Distributed Processing.
* Experience working on projects with agile/scrum methodologies.
* Exposure to DevOps methodology.
* Experience with GitHub Actions.
* Experience of Kimball, Data Vault.
* Experience with Infrastructure as Code, Terraform.
* Data warehousing principles (e.g., Kimball, Inmon, Data Vault), architecture, and its implementation in large environments.
Please note you must currently be eligible to work and remain indefinitely without any restrictions in the country to which you are making an application. Proof will be required to support your application.
All telecommuters will be required to adhere to the UnitedHealth Group's Telecommuter Policy.
Our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone – of every race, gender, sexuality, age, location, and income – deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups, and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes — an enterprise priority reflected in our mission.
Diversity creates a healthier atmosphere: Optum is an Equal Employment Opportunity employer and all qualified applicants will receive consideration for employment without regard to gender, civil status, family status, sexual orientation, disability, religion, age, race, and membership of the Traveller community, or any other characteristic protected by law. Optum is a drug-free workplace. 2023 Optum Services (Ireland) Limited. All rights reserved.