Job Title: Senior Data Engineer
Location: Dublin, Ireland (Hybrid)
Contract Duration: 6-12 Months (With Potential for Extension)
Rate: (Based on Experience)
Job Description:
We are seeking a highly skilled Senior Data Engineer to join our clients team on a contract basis. The ideal candidate will have strong experience in data pipeline design, database management, and ETL processes, with the ability to manage and optimize complex data ingestion pipelines and storage systems. You will play a key role in ensuring the availability, accessibility, and integrity of data across multiple sources.
Responsibilities:
1. Design and manage data ingestion pipelines, ensuring the seamless flow of data across multiple sources.
2. Develop and optimize storage systems for large-scale datasets (including relational, graph, and object-based stores).
3. Create, maintain, and optimize ETL processes using Python.
4. Collaborate with data scientists, analysts, and other stakeholders to ensure the availability and quality of data.
5. Implement and monitor data quality and integrity checks across various platforms.
6. Ensure scalability, security, and efficiency in data pipeline architectures.
7. Troubleshoot and resolve issues within data ingestion pipelines and storage systems.
8. Maintain comprehensive documentation of processes, data models, and solutions.
Key Skills & Requirements:
1. 7+ years experience in a data engineering role
2. Proven experience in designing and managing data pipelines and ETL processes.
3. Strong expertise in database systems including relational, graph, and object stores (e.g., SQL, NoSQL, and graph databases).
4. Proficiency in Python for ETL process development.
5. Solid understanding of data storage solutions, including cloud-based platforms (AWS, Azure, GCP).
6. Experience working with data warehousing and data lake architectures.
7. Familiarity with Apache Kafka, Airflow, Spark, or similar data tools is a plus.
8. Excellent problem-solving skills and ability to troubleshoot complex data issues.
9. Strong collaboration and communication skills, able to work across multiple teams and stakeholders.
10. Experience working in an Agile environment is advantageous.
Please note that candidates must have either an EU Passport or Stamp 4 visa.
Seniority level: Mid-Senior level
Employment type: Contract
Job function: Consulting and Information Technology
Industries: IT Services and IT Consulting
#J-18808-Ljbffr