SanFranRecruiter Since 2001
the smart solution for San Francisco jobs

Sr. Data Engineering Manager- Platform & Streaming & Cloud

Company: U.S. Bank
Location: San Francisco
Posted on: April 10, 2021

Job Description:

Only Local Bay Area candidates employed as FTE at Large Tech, FAANG, Start up's will be considered.Open for H1b Transfer/ Salary No bar for the right talent.Note: Consulting/Third party candidates will not be considered, please apply to other roles at our Careers page!!At U.S. Bank, we're passionate about helping customers and the communities where we live and work. The fifth-largest bank in the United States, we're one of the country's most respected, innovative and successful financial institutions. U.S. Bank is an equal opportunity employer committed to creating a diverse workforce. We consider all qualified applicants without regard to race, religion, color, sex, national origin, age, sexual orientation, gender identity, disability or veteran status, among other factors.Job DescriptionSenior Big Data Engineer will design, develop and implement data pipelines ,platforms and customer facing products using Big Data technologies in an agile environment. Senior Big Data Engineer will partner with cross functional teams and business stakeholders to drive the SDLC , shape the quality of product and deliver in a timely manner. Senior Big Data Engineer is also responsible for monitoring and troubleshooting of the data products / related systems and help improve the operational/functional efficiency.Role And Responsibilities* Design and build highly available, scalable, resilient and fault tolerant distributed real-time data streaming system to collect, enrich and distribute to multiple Destinations.* Work simultaneously on multiple projects and prioritize them with cross collaboration with stakeholders* Drive larger initiatives in the data space from concept inception ,analysis to on-boarding .* Help mentor and coach junior engineers on the best practice ,work culture etc., by being an example* Collaborate cross-functionally with product owner, data scientists, business users, project managers and other engineers to achieve elegant solutions.* Build real time streaming pipelines that deliver data with measurable quality under the SLA* Drive efforts to improve the data quality across data pipelines and implement system controls for managing data quality* Automate test coverage (90+%) for data pipelines, best practices and frameworks for unit, functional and integration tests.* Champion best practices for high availability, scalability and reliability of data streaming components.* Build AI/ML model based anomaly detection algorithms to detect data quality issues and abnormal behavior across different real time data sets/events.Basic QualificationsBachelor's degree or equivalent work experience.5+ years of relevant experience.Preferred Skills/Experience* 10+ years of overall experience in software development with 5-6 years of relevant experience in designing, developing, deploying and operating data streaming pipelines at scale.* 3-4 years' experience with Apache Kafka and Apache Spark Streaming* Experience in Spark Structured Streaming preferred.* Experience in tuning Spark Data pipelines to achieve high throughput with low latency.* Programming proficiency in Scala or Java.* Open Source Committer (Apache Spark or related Big Data open source technologies) is preferred.* Experience with Containers, Kubernetes and scaling elastically* Strong background in algorithms and data structures and continuously develop and acquire new technical skills* Experience providing technical leadership and mentoring other engineers for best practices on data engineering* Experience in automating Spark pipeline deployment/testing (DevOps, CI/CD)* Knowledge of various databases / database technologies - Cassandra (NoSQL), Postgres, or other columnar databases.* Passion for data engineering and for enabling others by making the product easier to use.* Collaborate cross-functionally with product owner, data scientists, business users, project managers and other engineers to achieve elegant solutions.* Excellent communication in sharing context to effectively collaborate with analytical partners, domain experts and other consumers of your work, preferably in supporting an engineering or product function* Required Skills Summary:--Apache Spark, Apache Kafka, Scala/Java, NoSQL Databases, Elasticsearch & Kibana, Kubernetes, Docker ContainersBenefitsTake care of yourself and your family with U.S. Bank employee benefits. We know that healthy employees are happy employees, and we believe that work/life balance should be easy to achieve. That's why we share the cost of benefits and offer a variety of programs, resources and support you need to bring your full self to work and stay present and committed to the people who matter most - your family.Learn all about U.S. Bank employee benefits, including tuition reimbursement, retirement plans and more, by visiting usbank.com/careers .EEO is the LawApplicants can learn more about the company's status as an equal opportunity employer by viewing the federal EEO is the Law poster.E-VerifyU.S. Bank participates in the U.S. Department of Homeland Security E-Verify program in all facilities located in the United States and certain U.S. territories. The E-Verify program is an Internet-based employment eligibility verification system operated by the U.S. Citizenship and Immigration Services. Learn more about the E-Verify program .

Keywords: U.S. Bank, San Francisco , Sr. Data Engineering Manager- Platform & Streaming & Cloud, Executive , San Francisco, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Executive Jobs


Service Manager
Description: A bit about usTrek is an awesome place to work, with amazing benefits for all employees. We build only products we love, provide incredible hospitality to our customers, and change the world by getting (more...)
Company: Trek Bikes
Location: Danville
Posted on: 04/18/2021

Release Manager
Description: Manage the development and implementation process of a specific company product. Manage the development and implementation process of a specific company product involving departmental or cross-functional (more...)
Company: Oracle
Location: Newark
Posted on: 04/18/2021

Change Management Manager (HR)
Description: Welcome to Ross Stores, Inc., where our differences make us stronger--- At Ross and dd's, inclusion is a way of life. We care about our Associates and the communities we serve and we value their differences. (more...)
Company: Ross Stores, Inc.
Location: Dublin
Posted on: 04/18/2021


Brand Manager- Firaxis
Description: Who We Are2K publishes some of the most popular video game franchises on the planet including Borderlands, BioShock, NBA 2K, WWE 2K, PGA 2K, XCOM, and Sid Meier's Civilization. Our team is comprised of (more...)
Company: 2K
Location: Novato
Posted on: 04/18/2021

Sr. Manager, Payroll
Description: Job DescriptionLeading the future of luxury mobility Lucid's mission is to inspire the adoption of sustainable energy by creating the most captivating luxury electric vehicles, centered around the human (more...)
Company: Lucid Motors
Location: Newark
Posted on: 04/18/2021

Business Development Manager
Description: Business Development Manager-IT SalesStaffing Must have current Business Development Experience in IT Staffing Industry.
Company: Tekforce Corporation
Location: San Ramon
Posted on: 04/18/2021

Plant Manager
Description: We are a leading food and agri-business, supplying food ingredients, feed and fiber to over 19,800 customers who range from multi-national, world famous brands to small family run businesses. Each customer (more...)
Company: Olam Americas Inc
Location: Gilroy
Posted on: 04/18/2021

Clinic Site RN Manager
Description: Registered Nurse needed for a permanent opportunity with Yoh's client located in Oakland, CA Top Skills You Should Possess: CA Registered Nurse License required Five years' related RN experience in a (more...)
Company: Yoh, A Day & Zimmermann Company
Location: San Ramon
Posted on: 04/18/2021

Manager, Internal & Executive Communications
Description: Job Description - Manager, Internal Executive Communications SAN0121 Job Description Manager, Internal Executive Communications - SAN0121 Description CooperVision, a division of CooperCompanies (more...)
Company: CTI Education Group
Location: San Ramon
Posted on: 04/18/2021

Center Manager (In-Center)
Description: The Center Manager role coordinates the care and quality of treatments for patients so they can have life, but also a quality of living. The leader in this role conducts proactive planning and creates (more...)
Company: Satellite Healthcare
Location: Rohnert Park
Posted on: 04/18/2021

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

San Francisco RSS job feeds