An esteemed company located in Tralee is looking for a Platform Data Engineer to join the Innovation and FinTech Lab Development Team to take part in designing, implementing, and monitoring data provision solutions. This 12-month contract offers a unique opportunity to contribute to a dynamic team and work on exciting next-generation payment technologies. Apply now to become part of this exceptional team and advance your career in data engineering.
Responsibilities:
* Design and Implementation: Design, build, and maintain batch or real-time data pipelines in production, ensuring accurate extraction, transformation, and loading of data from various sources.
* Data Infrastructure: Maintain and optimize the data infrastructure required for data extraction, transformation, and loading processes.
* ETL Development: Develop ETL processes to extract and manipulate data from multiple sources, automating data workflows for ingestion, aggregation, and ETL processing.
* Data Preparation: Prepare raw data in Data Warehouses into consumable datasets for technical and non-technical stakeholders.
* Collaboration with Data Scientists: Collaborate with data scientists to deploy machine learning models in production.
* Data Product Development: Build, maintain, and deploy data products for analytics and data science teams on cloud platforms (e.g., Azure).
* Data Accuracy and Compliance: Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures.
* Data Systems Monitoring and Optimization: Monitor data systems performance and implement optimization strategies.
* Agile Development: Participate in the Agile software development process and coordinate with other teams within your group.
* Services Differentiation and Collaboration: Identify services specific to your area of interest and collaborate with the platform team to implement and deploy shared services.
* Solution Design and Standards: Provide valuable input to design sessions to ensure that solutions are clean, secure, robust, and consistent, following the lab’s standards.
* Support and Handover: Provide support and documentation for handover to downstream development teams for further development of lab products.
Education & Skills:
* Bachelor’s Degree or higher in a software development-related discipline, information technology, computer science/engineering, etc.
* 10+ years of software development experience.
* Understanding of common patterns of enterprise software development, including Java/Spring Boot, RESTful web services, SOA, and/or Microservices, Message and Queue services (e.g., Kafka, RabbitMQ, AWS SQS, Azure Storage Queues), Swagger, Observability.
* Strong understanding of authentication and authorization concepts, including IdP (Azure AD/Okta), SAML, OAuth/OpenID, JWT, and SSO.
* Experience with containerizing applications using technologies like Docker, Docker Compose/Swarm, Kubernetes, and Helm.
* Advanced SQL skills and experience with relational databases and database design.
* Experience working with cloud Data Warehouse/Lake solutions (e.g., Azure SQL, Azure Blob Storage, Synapse, Hive).
* Experience working with data ingestion tools such as Azure Data Factory, Denodo.
* Working knowledge of Cloud-based solutions (e.g., AWS, Azure, GCP).
* Experience building and deploying machine learning models in production.
* Good understanding of NoSQL databases like Redis, Cassandra, MongoDB, or Neo4j.
* Experience with working on large data sets and distributed computing (e.g., Hive, Hadoop, Spark, Presto, MapReduce).
Duration: 12 Month Contract
#J-18808-Ljbffr