Data Engineer II, Professional Services Strategy & Operation, Analytics & Insights Center (PAIC)

The Data Engineer II role within AWS Professional Services Strategy & Operation (PAIC) focuses on building and scaling data products and pipelines, owning the data platform to enable analytics and AI/ML capabilities for internal customers.

Key Details

• Location: Irvine, CA (onsite)
• Salary: USD 132,100 - 178,800 per year
• Experience: 3+ years
• Education: Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience

Responsibilities

• Design and maintain ETL pipelines with robust monitoring and alerting
• Create data models optimized and aggregated for business needs
• Develop and optimize data tables with best practices for partitioning, compression, and parallelization
• Build scalable data integration pipelines using SQL, Python, and AWS services such as Glue, Lambda, and Step Functions
• Implement data structures following best practices in data modeling, ETL/ELT processes, and SQL/Redshift
• Interface with business customers to gather requirements and deliver complete reporting solutions
• Continuously improve reporting and analysis processes and automate self-service support for customers
• Explore and learn the latest AWS technologies to provide new capabilities and increase efficiencies
• Collaborate with business owners, analysts, and BI Engineers to explore new data sources and deliver new data products

Requirements

• 3+ years of developing and operating large-scale data structures for business intelligence analytics using ETL/ELT processes
• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience
• Experience with SQL and Python scripting
• Experience in data applications using large-scale distributed systems (e.g., EMR, Spark, Elasticsearch, Hadoop, Pig, and Hive)

Technologies

• SQL
• Python
• AWS Glue
• AWS Lambda
• AWS Step Functions
• Redshift
• S3
• EMR
• Kinesis
• FireHose
• Hive
• Hadoop
• Spark
• Pig
• Elasticsearch

Benefits

• Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• Paid time off
• Parental leave
• Sign-on payments and restricted stock units (RSUs)

A Day in the Life

• Work on an analytics platform spanning a data warehouse and data lake, supporting reporting, advanced analytics, and generative AI for a large global organization
• Build and maintain data pipelines, optimize queries, and ensure platform reliability
• Collaborate with data engineers, BI engineers, and data scientists to deliver accurate, timely data