Senior Data Engineer
Our client is a global firm that thrives on innovation and creating positive change.
They work with some of the biggest names across a range of thriving industries and offer fantastic growth opportunities.
They are heavily investing in their data team here in Belfast - hiring from Junior right up to Lead positions, working on a hybrid basis from some of city's newest and most modern offices.
About the Role:
You'll be leading teams who are collectively responsible for delivering functioning solutions to their clients.
Junior members of the team will look to you for support, guidance and help with decisions.
What We Offer:
* Great salaries and annual bonus up to 15%
* Flexible hybrid working options
* Private medical insurance, critical illness and life/income protection insurance
* Generous pension scheme
* Cutting-edge projects using AWS and other modern technologies
Requirements:
We're looking for someone with experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL.
This includes experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc.
You should also have the ability to work closely with other engineering teams to integrate data engineering component into production systems.
A knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks, is essential.
The ability to travel to client site, where required, will be a consideration.
Additionally, experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native or custom programming, is desirable.
Knowledge of data mining, machine learning, natural language processing is an advantage.
You should enjoy working within cross-functional Agile teams and be familiar with Scrum ceremonies.
As a Senior Data Engineer, you'll be comfortable designing and building for the AWS cloud and will have designed and worked on architectures that include Platform-as-a-Service components and perhaps even server-less and container technologies.
Lead Team Experience:
We're looking for someone with experience leading teams to design, build, and maintain large scale data solutions and applications using AWS data and analytics services (or open-source equivalent).
AWS is a significant growth area for our client with a diverse and growing capability and they are looking for a data engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement.
There are a variety of different tools, cloud technologies and approaches and while we have a preference for AWS tooling experience, open-source equivalence will be suitable.