Company Headquarters: Kildare, Ireland
We are seeking a “Data Engineer” for our client, a top service provider renowned for trading and refurbishing used technology, such as cellphones and laptops. This company is dedicated to assisting manufacturers with sustainable practices and plays a significant role in reducing new tech expenses on a global scale.
Qualifications:
Experience on cloud platforms (AWS preferred), including cloud-based data storage solutions
Experience in designing and deploying data pipelines from ingestion to consumption
Strong SQL and Python skills, including API-based data extraction
Hands-on experience with data storage solutions (Redshift, Hive, Parquet, Hadoop ecosystem)
Experience with data modeling, data-mart development, and data cleansing
Experience with data storage technologies such as data lakes, data warehouses, and traditional SQL/NoSQL databases
Knowledge of real-time data processing (Kafka Streams, Apache Spark)
Demonstrable knowledge in writing scripts, extracting data using APIs, and writing SQL queries
Ability to work with large datasets, build KPIs, and analyze trends
Familiarity with Agile methodologies, Scrum/Kanban, and tools like Jira & Confluence
Experience in using GenAI to augment analytics
Demonstrable contribution to open-source projects
Experience of working in an organisation with a DevOps culture
Key Responsibilities:
Build and maintain scalable data pipelines and ETL processes on AWS
Improve data quality and optimize reporting layers
Design, build, and maintain large-scale data solutions using AWS analytics services (EMR, Glue, Redshift, Kinesis, Lambda, DynamoDB)
Automate, monitor, and ensure reliability of data platforms
Work with stakeholders to analyze reporting needs and ensure data availability
Collaborate with backend teams to align data policies and best practices
Preferred Skills:
AWS certifications
Experience with data visualization tools (Tableau, Power BI)
Knowledge of GenAI for analytics enhancement
#J-18808-Ljbffr