SanFranRecruiter Since 2001
the smart solution for San Francisco jobs

Staff Data Engineer

Company: Intuit
Location: Mountain View
Posted on: August 17, 2019

Job Description:

Overview The SBSEG QuickData Platform Engineering team is enabling data-driven decisions at the highest levels of the company, and we are using big data to personalize user experiences in our products. The infrastructure is running on AWS and looking for Staff/Senior Engineer to join our QuickData Platform Team. We are looking for a strong Engineer with a passion for automation, ready for an opportunity to tackle the complex problems of scale, which are unique to Intuit, while using your expertise in AWS, platform automation, data monitoring, incident management for a big data and large-scale systems. We are looking for someone who can design, code and maintain high performance and support data infrastructure. Responsibilities

  • Build and maintain optimal ingestion framework and pipeline to ingest data from transactional data sources on RDBMS/NoSQL to data lake on Redshift/S3
  • With the mindset of open source contribution , Re-design data movement framework to automate incoming data from third party marketing sources ( Google , Facebook , Bing etc. ) to data lake on AWS
  • Optimize and standardize existing pipelines using Big Data Technologies (EMR, Spark etc.)
  • Create data tools and frameworks for analytics and data scientist for faster Time-to-insights and thereby increase the productivity
    • Identify opportunities for automation and platform enhancement - design and build solutions for greater scalability.
    • Respond to monitoring alerts according to defined playbooks and procedures
    • Perform benchmarking & performance of AWS infrastructure via automation.
    • Contributions to Operational Standards and Requirements
    • Develop run books for problem diagnosis, resolution and escalation.
    • Automate various RTB jobs using scripts/tools to speed execution.
    • Be an onshore POC for 24/7 maintenance and support team for AWS Data platform
    • Manage tickets raised by business team Qualifications
      • BS in Computer Science. MS Preferred.
      • Experience managing Big Data infrastructure on AWS.
      • Exposure in managing different flavors of RDBMS/RDS ( Oracle , Aurora , SQL Server ) and NoSQL databases
      • Apt with automating repetitive tasks using Spark, Python
      • Experience designing and deploying systems on AWS
      • Enjoy a fast-paced, rapidly changing work environment
      • Good communication skills and a passion for clean code
      • Experience with AWS products including EC2, S3, RDS, ElastiCache, ElasticSearch, Kinesis, Lambda, DMS etc.
      • Exposure to Big Data on AWS ( Data Pipeline, Kinesis , Firehose , Hive , Glue, S3, EMR/EC2 , Spark) Responsibilities:
      • Extensive Experience in automation, capacity planning & benchmarking/performance testing in AWS
      • Implement and adhere to continuous integration practices
      • Operational mindset with ability to do Problem, SLA and Incident Management.
      • Troubleshoot issues and participate in 24x7 on-call support, ensuring the stability of the production environment.
      • Strong critical thinking ability to assess complex problems, analyze options, navigate diverse perspectives and develop optimal/acceptable solutions
      • Ability to work independently with minimal supervision

Keywords: Intuit, San Francisco , Staff Data Engineer, Engineering , Mountain View, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Other Engineering Jobs

Water Resources Engineer
Description: Are you an independent person who can stay on task while working with team members in multiple geographic locations Are you an expert communicator with excellent customer service, follow-through, and (more...)
Company: Watearth, Inc.
Location: Sacramento
Posted on: 08/21/2019

Body Shop Technician II
Description: br br Position Summary: br A Penske Body Shop Technician II is required to perform diagnostic procedures and truck and trailer repairs such as Cab/Sheet Metal Repair, Composite Bonding/ Repair, (more...)
Company: Penske
Location: Woodland
Posted on: 08/21/2019

Engineering Designer
Description: THE POSITIONThe City of Vacaville is seeking applicants to fill one 1 Engineering Designer vacancy within our Public Works Department. This recruitment will also serve to establish an eligibility list (more...)
Company: City of Vacaville
Location: Vacaville
Posted on: 08/21/2019

Substation Electrical Engineering Supervisor (Relocation Offered)
Description: Job SpecificationsThis important role will supervise engineers and technicians in the planning, design, construction, and maintenance of utility transmission and distribution substation facilities. Create (more...)
Company: Black Hills Energy
Location: Fairfield
Posted on: 08/21/2019

Full Time Satellite TV Technicians/Installers
Description: JOB DUTIES AND RESPONSIBILITIES Do you enjoy physical indoor/outdoor work, talking with people, providing customer service and learning new technologies Are you seeking an opportunity where you have (more...)
Company: DISH
Location: San Anselmo
Posted on: 08/21/2019

Project Engineer
Description: United States of America - California, Sacramento Job Summary The Program Management/Construction Management PM/CM business line specializes in the management of design and construction of community (more...)
Company: Aecom
Location: Sacramento
Posted on: 08/21/2019

Sr. Air Quality Engineer
Description: JOB br El Dorado County is one of the most beautiful counties in the state of California.------You can avoid the valley commute and fog and take in the natural beauty.----Check out our video to learn (more...)
Company: The County of El Dorado
Location: Placerville
Posted on: 08/21/2019

Senior QA Engineering Manager
Description: About Us br br At One Medical we are passionate about revolutionizing the primary care industry by offering a new approach to primary care. We combine people-centered design, technology, and a team (more...)
Company: One Medical
Location: San Francisco
Posted on: 08/21/2019

Infrastructure Engineer
Description: Beam is disrupting a 7.5 billion compliance software market. Beam's scalable technologies incorporate new data sources for our bank and fintech partners, helping make the financial system safer while (more...)
Company: BEAM
Location: San Francisco
Posted on: 08/21/2019

Senior Site Reliability Engineer
Description: Senior Site Reliability Engineer DevOps USA-Missouri-Chesterfield, USA-California-Rancho Cordova, USA-New York-Getzville We are looking for an experienced Site Reliability/DevOps Engineer with strong (more...)
Company: Cenpatico
Location: Rancho Cordova
Posted on: 08/21/2019

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

San Francisco RSS job feeds