About Your New Company
Our company is a leading Fortune 100 healthcare organisation known for its excellence and commitment to quality care.
Your New Role
1. Data Pipeline Development:
o Design and implement data pipelines that extract, transform, and load (ETL) data from various sources into a centralised data storage system, such as a data warehouse or data lake.
o E nsure the smooth flow of data from source systems to destination systems while adhering to data quality and integrity standards.
2. Data Integration:
o Integrate data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external data providers.
o Handle data ingestion, transformation, and consolidation to create a unified and reliable data foundation for analysis and reporting.
3. Data Transformation and Processing:
o Develop data transformation routines to clean, normalise, and aggregate data.
o Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis, reporting, or machine learning tasks.
4. Collaborate with cross-functional teams to develop best practices in code development, deployment, and automation/orchestration of data pipelines.
5. Implement data governance in line with our company standards.
6. Partner with Data Analytics and Product leaders to design best practices and standards for developing and productionalizing analytic pipelines.
7. Partner with Infrastructure leaders on architecture approaches to advance the data and analytics platform, including exploring new tools and techniques that leverage the cloud environment (Azure, Snowflake, others).
8. Monitoring and Support:
o Monitor data pipelines and data systems to detect and resolve issues promptly.
o Develop monitoring tools, alerts, and automated error handling mechanisms to ensure data integrity and system reliability.
Requirements for Success
1. Proven experience with Data Pipeline Development.
2. Experience with Data Integration.
3. Experience with Data Transformation and Processing.
4. Familiarity with Azure, Snowflake, and other cloud-based technologies.
What You'll Get in Return
1. A competitive daily rate.
2. The opportunity to work with a reputable Fortune 100 organisation.