Required Skills
About the Job
Wells Fargo is seeking a Lead Software Engineer to drive complex, company-wide technology initiatives. In this role, you will define engineering standards, design and implement large-scale technology solutions, and review complex systems against business objectives. You will be instrumental in developing best practices, influencing technology teams, and resolving intricate technical challenges by evaluating multiple factors.
Key responsibilities include leading lakehouse engineering efforts using open table formats (Iceberg, Delta, Hudi) and Medallion architectures for data ingestion and transformation. You will establish frameworks for data quality, observability, lineage, and SLAs. Designing secure REST and metadata APIs for governed data access and integration with downstream applications is crucial. Collaboration with product, architecture, and business teams for technical leadership, design reviews, and mentoring is expected. Expertise in designing and implementing metadata-driven ETL/ELT pipelines, robust data ingestion and validation frameworks, and optimizing distributed Spark workloads is required. Proficiency with enterprise orchestration tools (Autosys, Airflow), data modeling, API development, CI/CD, infrastructure automation, and major cloud platforms is essential.
This role offers the opportunity to apply GenAI for metadata extraction, anomaly detection, automated documentation, and pipeline optimization. You will deliver high-quality engineering outcomes, build scalable data solutions using Python, SQL, Spark, and Iceberg, and drive framework modernization. Building and maintaining robust RESTful services and mentoring junior engineers will be integral to your success. Experience with Kubernetes/OpenShift (OCP) environments is a plus.
