Job Summary
A Data Engineer is sought after to design, develop and maintain scalable data pipelines in Cork, Ireland. The ideal candidate will have at least 3 years of experience in data engineering or a related field and strong proficiency in programming languages such as Python, Java or Scala.
Key Responsibilities
* Design, development and maintenance of scalable data pipelines to ingest, process and store large datasets
* Build and maintain ETL processes to ensure timely and accurate data delivery
* Develop expertise in SQL and relational databases, as well as familiarity with No SQL databases
* Familiarity with big data tools (e.g., Hadoop, Spark) and cloud platforms (AWS, Azure, or GCP)
* Knowledge of ETL tools and data workflow orchestration platforms (e.g., Apache Airflow, Prefect)
* Familiarity with containerisation (Docker, Kubernetes) and CI/CD pipelines
Requirements
* At least 3 years of experience in data engineering or a related field
* Strong proficiency in programming languages like Python, Java, or Scala
* Experience with big data tools (e.g., Hadoop, Spark) and cloud platforms (AWS, Azure, or GCP)
* Expertise in SQL and relational databases, as well as familiarity with No SQL databases
* Knowledge of ETL tools and data workflow orchestration platforms (e.g., Apache Airflow, Prefect)
* Familiarity with containerisation (Docker, Kubernetes) and CI/CD pipelines
Nice-to-Haves
* Experience with real-time data streaming technologies (Kafka, Flink, etc.)
* Knowledge of machine learning workflows and data science tooling
Benefits
* Pension
* Healthcare
* Excellent career development opportunities
* Work From Home option