Infrastructure Engineer - Big Data Services (Databricks & Snowflake)
We are seeking an experienced Infrastructure Engineer to join our team and support the setup of a new Technology Innovation Hub in Galway.
Job Description
As an Infrastructure Engineer, you will be responsible for providing support for Databricks and Snowflake platforms. This includes:
* Managing and optimizing Databricks on AWS & Azure, including account and workspace administration, Cluster Policies, and Unity Catalog.
* Implementing and maintaining Snowflake platform on AWS & Azure.
* Leveraging AWS services like S3, EC2, EKS, Lambda, Route 53, EMR, and more for performance tuning and cost optimization.
* Developing and managing CI/CD pipelines and Infrastructure as Code using tools like Jenkins, Git Hub, and Terraform.
* Troubleshooting technical issues, collaborating with vendor support, and providing IT service management for Incident, Problem, and Change Management.
* Working with languages such as SQL, Python, Py Spark, and Go to optimize processes and solutions.
Requirements
To be successful in this role, you will need:
* Proven experience with Databricks and Snowflake on AWS & Azure.
* A strong understanding of AWS technologies (e.g., S3, EC2, EKS, Cloud Watch, and more).
* Expertise in monitoring, performance tuning, and cost optimization.
* Hands-on experience with CI/CD tools and Terraform for infrastructure automation.
* Excellent problem-solving skills and ability to work collaboratively across teams.
* Solid experience with ITIL and IT Service Management processes.
What We Offer
This is a permanent position that comes with a very competitive and attractive salary and benefits package, including:
* Paid holidays.
* Canteen.
* Parking.
* VHI pension.
* Educational assistance.
* Negotiable benefits.