Software Development Engineer, Open Data Analytics Fundamentals Team
AWS Utility Computing (UC) provides product innovations from foundational services like Amazon's Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that set AWS's services apart in the industry. As a member of the UC organization, you'll support the development and management of Compute, Database, Storage, Internet of Things (IoT), Platform, and Productivity Apps services in AWS, including security solutions for cloud services.
Amazon Web Services Open Data Analytics (ODA) organization is looking for exceptional engineers to help provide the world's best cloud Big Data processing platform and services like EMR and Athena.
Amazon Elastic MapReduce (EMR) is the industry-leading cloud big data platform for petabyte-scale data processing, interactive analytics, and machine learning using open-source frameworks like Apache Spark, Trino, Hadoop, Hive, and HBase. Amazon Athena is a serverless query service simplifying analyzing data directly in Amazon S3 using standard SQL.
The ODA Fundamentals team integrates and packages the latest features from the ODA organization, delivering robust, thoroughly tested analytics products to customers. The team plays a pivotal role in shaping the strategic direction of ODA services and executing product release processes.
You will design and build web services and tools managing the entire lifecycle of ODA releases from creation to deployment with high quality and on schedule. You will build and improve benchmarking frameworks underpinning AWS Analytics optimization efforts. Your features will automatically schedule, analyze, and evaluate differences between experimental, regression, and production workloads and respective baselines.
You will collaborate with top minds in the industry, working on industry-leading software and systems. You will be part of a fast-paced, growing team, and one of the most innovative technology companies. Most importantly, you will make products used by millions daily to great effect.
Key Responsibilities:
* Analyze and improve availability, efficiency, capacity, scalability, security, and performance of our services.
* Build, maintain, and continuously improve infrastructure for a multi-site development team.
* Work on complex problems in distributed systems and query engines.
* Translate complex functional and technical requirements into detailed architecture and design.
* Deliver systems and features with top-notch quality, on time.
* Own the end-to-end Software Development Life Cycle (SDLC).
BASIC QUALIFICATIONS
* 3+ years of non-internship professional software development experience.
* 2+ years of non-internship design or architecture (design patterns, reliability, and scaling) of new and existing systems experience.
* Experience programming with at least one software programming language.
PREFERRED QUALIFICATIONS
* 3+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations.
* Experience designing or architecting (design patterns, reliability, and scaling) of new and existing systems.
* Master's degree in computer science or equivalent.
* Experience with Apache Hadoop ecosystem applications: Hadoop, Hive, Presto, Spark, and more.
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate based on race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.