Lead AWS Data Engineer (PySpark, EMR, S3) - Chase Bank

Join JPMorgan Chase as a Lead Software Engineer in our Consumer and Community Banking - J.P. Morgan Wealth Management organization. You'll be a key part of an agile team, responsible for designing, enhancing, building, and delivering secure, stable, and scalable technology products. This role offers a unique opportunity to push the boundaries of what's possible in your career.

You will execute creative software solutions, design, develop, and troubleshoot technical challenges. This includes writing secure, high-quality production code and reviewing the work of others. You'll identify and automate the remediation of recurring issues to boost operational stability and lead evaluations with vendors, startups, and internal teams to assess architectural designs and technical capabilities.

As a leader, you will contribute to communities of practice across Software Engineering, promoting the adoption of new and cutting-edge technologies. We value a culture of diversity, opportunity, inclusion, and respect.

**Key Responsibilities:**

• Design and implement end-to-end ETL/ELT pipelines on AWS using AWS Glue (PySpark) and/or EMR/EMR Serverless.
• Build and maintain data lakes/lakehouses on Amazon S3 using columnar formats (Parquet/ORC) with effective partitioning, compaction, and schema evolution via Glue Data Catalog.
• Optimize Spark jobs and monitor performance using CloudWatch and Spark UI.
• Implement data quality checks, observability, SLAs/SLOs, and lineage/metadata practices.
• Orchestrate workflows with AWS Step Functions and/or Airflow (MWAA), ensuring error handling, retries, and idempotency.
• Enforce security and compliance through IAM, KMS encryption, VPC endpoints, and Secrets Manager/Parameter Store.
• Collaborate on data modeling and interface contracts for analytics, ML features, and downstream services.
• Participate in architectural reviews, proposing improvements for reliability, scalability, and cost efficiency.
• Drive CI/CD for data code, infrastructure as code (Terraform or AWS CDK), and automated deployments.

**Required Qualifications:**

* Formal training or certification on software engineering concepts and 5+ years of applied experience.