1. Location: Dublin, Dublin, Ireland
2. Type: Contract
3. Job #25507
Senior Data Engineer
Location Dublin
Onsite 3 days per week
Daily Rate up to €590
Visa Sponsorship : Not included
Join our client, a global tech powerhouse in the payments industry, are currently looking for a Senior Data Engineer to join their dynamic team. This role offers the chance to work with a leading financial services company, tackling crypto fraud, preventing money laundering, and utilizing cutting-edge AI & Machine Learning tools.
Role Description
You will:
4. Expand and optimize data pipeline architecture.
5. Improve data flow and collection for various teams.
6. Support Software Engineers, Data Scientists, and other stakeholders.
7. Ensure consistent, high-quality data delivery.
8. Work with Data Science teams, ensuring data integrity.
9. Thrive in an Agile environment with SAFe/Scrum methodologies.
10. Take ownership of engineering solutions with a focus on efficiency and timely delivery.
11. Be a self-starter who can manage multiple teams and projects.
12. Innovate and re-architect data systems for next-gen products.
Must-Have Skills
13. Advanced SQL and database experience.
14. Expertise in building and optimizing data pipelines.
15. Strong root cause analysis skills.
16. Experience with unstructured datasets.
17. Proficient in data transformation and metadata management.
18. Skilled in handling large, disconnected datasets.
19. Knowledge of message queuing, stream processing, and big data stores.
20. Solid project management and organizational skills.
21. Experience with big data tools (Hadoop, Spark, Databricks, Kafka).
22. Familiarity with relational SQL and NoSQL databases (Postgres, Oracle, CosmosDB).
23. Experience with data pipeline and workflow tools.
24. Proficiency in cloud services.
25. Experience with stream-processing systems (Storm, Spark-Streaming).
26. Skilled in Java, Python, and web services (REST/XML).
27. Advanced Spring framework knowledge.
28. Cloud development experience (PCF, AWS, Azure).
Nice-to-Have Skills
29. Blockchain systems experience.
30. Cryptocurrency knowledge.