This role is responsible for designing, deploying, and maintaining our infrastructure, data processing applications, and CI/CD pipelines with large volumes of data.
The position will be part of the SRE Data team and will primarily work with R&D, SRE, and Data analysts.
The work includes designing, building, and deploying high availability, robust, resilient, and supportable big data solutions while streamlining and automating our software delivery and infrastructure operations in a large-scale SaaS environment.
With a focus on the infrastructure and operational elements of designing and deploying ETL big data solutions, the SRE Data Engineer must ensure the infrastructure is highly available, has sufficient capacity, and is fully resilient across multiple data centers and cloud architectures.
Your role and responsibilitiesDevelop and maintain automation scripts and tools using Python, Groovy.
Create and manage our pipelines, CI/CD infrastructure, and automation jobs in Jenkins.
Manage Terraform Development/QA/Production environments.
Perform data pipelines and ETL process health monitoring and diagnostics.
Integrate monitoring, auditing, and alert systems for databases with existing monitoring infrastructure.
Occasional off-shift availability to resolve Production issues.
Work closely with other members of the SRE and R&D teams.
Responsible for system performance and reliability.
Ensure proactive engagement in the Incident Management process, working with Operational teams to minimize the impact of database outages.
Required educationNone
Preferred educationBachelor's Degree
Required technical and professional expertise3+ years of experience as SRE Data Engineer.3+ years of experience in scripting and automation using Python.
AWS experience, RDS, RedShift, and EMR will be an advantage.
Experience in configuration management and CI/CD systems like Jenkins and Terraform.
Experience working in production environments.
Preferred technical and professional experienceExcellent communication skills, including effectively communicating with technical and non-technical employees and vendors.
Strong problem-solving, testing, and network troubleshooting skills.
A bachelor's degree in computer science, Information Technology, or a related field will be a plus.
#J-18808-Ljbffr