Job Description:
Talented Data Engineer
We are seeking a skilled Data Engineer to join our global engineering business with offices in Galway, Ireland. The ideal candidate will have experience in data engineering, particularly within the cloud ecosystem (AWS), and be proficient in Python, SQL, and Linux.
Key Responsibilities:
* Design, develop, and maintain scalable data pipelines and ETL processes using open source and AWS services.
* Implement best practices for data management, governance, and security.
* Optimize and scale our data infrastructure to support growing data needs.
* Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
* Monitor and troubleshoot data pipelines and workflows to ensure reliability and performance.
* Implement and manage CI/CD pipelines to automate the deployment and testing of data engineering solutions.
* Follow and implement industry best practices to ensure our data infrastructure is reliable, scalable, and secure.
* Develop and maintain documentation for data engineering processes and systems.
* Mentor and provide guidance to other team members.
Qualifications:
* Bachelors or Masters degree in Computer Science, Engineering, or a related field.
* 5+ years of experience in data engineering or a related role.
* Strong proficiency in Python and SQL.
* Hands on experience with cloud-based architectures and software stacks.
* Deep understanding of large always-on enterprise system architecture.
* Proficiency in Linux server environments.
* Experience with containerization technologies such as Docker.
* Excellent problem-solving skills and attention to detail.
Benefits:
* Medical Aid / Health Care bonus