Job Title: Snowflake Data Engineer
We are seeking an experienced Snowflake Data Engineer to join our team. The ideal candidate will have a strong background in designing and developing data pipelines, with expertise in Snowflake and cloud-based infrastructure.
The successful candidate will be responsible for:
* Designing, building, and testing end-to-end data pipelines, including data ingestion, integration, and curation
* Developing and deploying scalable data pipelines and ETL processes on cloud-based infrastructure using Azure, Snowflake, DBT, Airflow, and Cosmos DB
* Defining and implementing automation of jobs and testing
* Optimizing the data pipeline to support workloads and use cases
* Supporting mission-critical applications and near-real-time data needs from the data platform
* Addressing data issues, environment issues, performing impact analysis, root cause analysis, corrective, adaptive, and perfective maintenance
* Implementing data models, transformations, and schema designs to support analytical and reporting needs
* Optimizing and tuning Snowflake performance, including query optimization, resource management, and scaling strategies
Requirements:
* 7+ years of experience in IT
* Strong experience in design/data modeling/development & performance tuning
* Experience with micro-services architecture and understanding of Cloud Computing is highly desirable
* Experience with MicroServices - API/Event Driven Architecture/Development
* Strong hands-on experience in troubleshooting Devops pipelines and Azure services
* Experience with DBT (Data Build Tool) for data modelling and transformation and Apache Airflow for workflow orchestration and scheduling
* Experience in Snowflake utilities including SnowSQL, Snowpipe, Snowlight for handling Streaming data is a plus
* Expertise in Snowflake advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, Zero copy clone, time travel and understand how to use these features
* Experience in re-clustering Snowflake data with good understanding of Micro-Partition within Snowflake
* Expertise in deploying Snowflake features such as data sharing, events and lake-house patterns
* Experience in handling semi-structured data (JSON, XML) in Snowflake
* Bachelor's Degree level qualification in a computer or IT related subject
* 7+ years of experience in professional database and data warehouse development
* 7+ years of development experience writing SQL queries/Stored Procedures for any another Relational Databases like Oracle, SQL Server
* 6+ years of experience on Snowflake development including Snowpipes, Snowshare, Task, Streams, UDFs and Procedures
* 6+ years of experience on cloud-based development including Azure Services, Azure Devops, Kubernetes, Docker
About Us:
We truly believe in the power that comes from the diverse backgrounds and experiences our employees bring with them. Although each vacancy details what we are looking for, we don't necessarily need you to fulfill all of them when applying. If you like change and innovation, seek to see the bigger picture, make data-driven decisions, and are a good team player, you could be a great fit.
We offer a collaborative environment where technology skills and innovation are valued in a global organization. We're looking for top technical talent to join our team and deliver creative technology solutions that help us become an end-to-end, next-generation financial services company.