Data Engineer
Overview:
VIOTAS is currently looking for a highly skilled and motivated data engineer to work with a team of data scientists, analysts and researchers in a fast-paced, innovative and sustainable work environment.
About VIOTAS:
Established in Limerick, Ireland in 2013, VIOTAS set about designing and delivering new innovations to address the challenges posed by increased renewable generation in electrical grids: How can a grid be balanced when a large amount of electricity is coming from unpredictable renewable sources that are difficult to forecast and that change the fundamental principles of how grids operate?
In response, VIOTAS developed proprietary technologies that place electricity customers at the core of the solution. By managing their electricity consumption and onsite generation in real-time, VIOTAS help balance the wider electricity grid. The company then aggregates participating customers to form Virtual Power Plants which are traded in the electricity market, competing against conventional fossil fuel power stations. This approach not only generates significant revenue for participating customers but also contributes to reducing carbon emissions. With a global expansion strategy, VIOTAS, currently with over 110 staff, operates in Ireland, Poland, USA, Australia and New Zealand.
As a Data Engineer, you will work closely with data scientists, software engineers, and DevOps teams to implement best practices in data engineering, cloud computing, AI and machine learning pipeline automation.
Key Responsibilities
The successful candidate will be responsible for, but not limited to:
Build and maintain scalable data pipelines in the AWS environment, integrating MLOps practices, and working with time series databases (e.g., InfluxDB).
Develop and maintain data warehousing solutions using AWS services like S3, Athena, Glue, etc.
Collaborate with data scientists to implement MLOps data pipelines for automating machine learning model training, testing, and deployment.
Work with Airflow to automate testing, integration, and deployment of data driven solutions.
Integrate time series data management solutions, including databases like InfluxDB 3, to handle real-time data.
Develop and deploy solutions for time series data processing and ensure high availability of critical real-time systems.
Perform data analytics, and ad hoc analysis using Python (NumPy, pandas, polars, Jupyter Notebook), SQL, Power BI, Auto-ML or other business intelligence software.
Implement data security best practices to ensure compliance and protect sensitive data.
Essential Requirements
Can-do attitude with strong creative and conceptual thinking skills.
Bachelor's degree in Computer Science, Information Technology, or related field.
3+ years of experience in a Data Engineering or similar role.
Proficiency in Python for data processing and automation.
Hands-on experience with AWS services (S3, Lambda, Glue, Redshift, Kinesis, Athena, EMR).
Experience with MLOps tools and frameworks (e.g., MLflow, Kubeflow, SageMaker, Airflow).
Familiarity with data warehouse and big data concepts.
Experience with SQL and relational databases.
Knowledge of DevOps practices, including containerization (Docker) and tools such as Airflow, Kubernetes.
Desirable
Master’s degree in computer science, Information Technology, or related field.
Knowledge of energy markets, trading, and regulatory environments.
Knowledge of the Arrow Framework is a plus
Job Type: Full-Time, Permanent.
Location: Limerick, Ireland (Hybrid)
Salary: Competitive based on qualifications, experience, and skills.
Benefits:
Healthcare
Pension
Self-Directed Training Budget of €3,000 per year plus 10 days training leave
Annual performance-based bonus.
25 days annual leave.
Death-In-Service benefit.
Dedicated People & Culture club
Working at VIOTAS:
At VIOTAS, we foster growth, empower with autonomy, and cultivate an inclusive, flexible work culture. Our diverse, skilled team is dedicated to pioneering innovation and excellence, fueled by a passion for a low-carbon future.
VIOTAS prioritise ongoing training and personal development, fostering a culture that values upskilling with dedicated budgetary support. We deeply value the well-being of our employees, reflected in a range of initiatives designed to ensure their success and fulfilment.
VIOTAS ranked top 15 in Ireland’s Best Workplaces, and also Best Workplaces in Tech in 2023.