Data Engineer (Level 5), AOP

Amazon is a place where data drives most of our decision-making. The Analytics, Operations & Programs (AOP) team is looking for a dynamic data engineer who can be innovative, a strong problem solver, and can lead the implementation of the analytical data infrastructure that will guide decision-making. As a Data Engineer, you think like an entrepreneur, constantly innovating and driving positive change, but more importantly, you consistently deliver mind-boggling results. You're a leader who uses both quantitative and qualitative methods to get things done. This position offers exceptional opportunities to grow your technical and non-technical skills. You have the opportunity to really make a difference to our business by inventing, enhancing, and building world-class systems, delivering results, and working on exciting and challenging projects.

As a Data Engineer, you are responsible for analyzing large amounts of business data, solving real-world problems, and developing metrics and business cases that will enable us to continually delight our customers worldwide. This is done by leveraging data from various platforms such as Jira, Portal, and Salesforce. You will work with a team of Product Managers, Software Engineers, and Business Intelligence Engineers to automate and scale the analysis and to make the data more actionable to manage business at scale. You will own many large datasets and implement new data pipelines that feed into or from critical data systems at Amazon.

You must be able to prioritize and work well in an environment with competing demands. Successful candidates will bring strong technical abilities combined with a passion for delivering results for customers, both internal and external. This role requires a high degree of ownership and a drive to solve some of the most challenging data and analytic problems in retail. Candidates must have demonstrated ability to manage large-scale data modeling projects, identify requirements and tools, and build data warehousing solutions that are explainable and scalable. In addition to the technical skills, a successful candidate will possess strong written and verbal communication skills and a high intellectual curiosity with the ability to learn new concepts, frameworks, and technology rapidly as changes arise.

Key job responsibilities

1. Design, implement and support an analytical data infrastructure
2. Manage AWS resources including EC2, EMR, S3, Glue, Redshift, etc.
3. Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies
4. Explore and learn the latest AWS technologies to provide new capabilities and increase efficiency
5. Collaborate with Data Scientists and Business Intelligence Engineers (BIEs) to recognize and help adopt best practices in reporting and analysis
6. Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers
7. Maintain internal reporting platforms/tools including troubleshooting and development. Interact with internal users to establish and clarify requirements in order to develop report specifications.
8. Work with Engineering partners to help shape and implement the development of BI infrastructure including Data Warehousing, reporting, and analytics platforms.
9. Contribute to the development of the BI tools, skills, culture, and impact.
10. Write advanced SQL queries and Python code to develop solutions

A day in the life

This role requires you to live at the intersection of data, software, and analytics. We leverage a comprehensive suite of AWS technologies, with key tools including S3, Redshift, DynamoDB, Lambda, APIs, and Glue. You will drive the development process from design to release. Managing data ingestion from heterogeneous data sources, with automated data quality checks. Creating scalable data models for effective data processing, storage, retrieval, and archiving. Using scripting for automation and tool development, which is scalable, reusable, and maintainable. Providing infrastructure for self-serve analytics and science use cases. Using industry best practices in building CI/CD pipelines.

About the team

The AOP (Analytics Operations and Programs) team is missioned to standardize BI and analytics capabilities, and reduce repeat analytics/reporting/BI workload for operations across IN, AU, BR, MX, SG, AE, EG, SA marketplace. AOP is responsible for providing visibility on operations performance and implementing programs to improve network efficiency and defect reduction. The team has a diverse mix of strong engineers, Analysts, and Scientists who champion customer obsession. We enable operations to make data-driven decisions through developing near real-time dashboards, self-serve dive-deep capabilities, and building advanced analytics capabilities. We identify and implement data-driven metric improvement programs in collaboration (co-owning) with Operations teams.

BASIC QUALIFICATIONS

1. 3+ years of data engineering experience
2. 4+ years of SQL experience
3. Experience with data modeling, warehousing, and building ETL pipelines
4. Experience building/operating highly available, distributed systems for data extraction, ingestion, and processing of large data sets
5. Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS

PREFERRED QUALIFICATIONS

1. Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
2. Experience with non-relational databases/data stores (object storage, document or key-value stores, graph databases, column-family databases)

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.

#J-18808-Ljbffr