SanFranRecruiter Since 2001
the smart solution for San Francisco jobs

Staff Data Engineer

Company: Intuit
Location: Santa Clara
Posted on: July 15, 2019

Job Description:

Staff Data Engineer Overview The SBSEG QuickData Platform Engineering team is enabling data-driven decisions at the highest levels of the company, and we are using big data to personalize user experiences in our products. We have migrated to the AWS Cloud and are looking for a Staff/Sr Engineer to join our QuickData Platform Team. We are looking for a strong Engineer with a passion for automation, ready for an opportunity to tackle the complex problems of scale, which are unique to Intuit, while using your expertise in AWS, platform automation, data monitoring, incident management for a big data and large-scale systems. We are looking for someone who can design, code and maintain high performance and support data infrastructure. Responsibilities Migration to AWS of data pipeline and EMR. Enhancement of a data-monitoring platform to support large-scale pipeline, supporting data Incident, including initial problem analysis, resolution. Be an onshore POC for 24/7 maintenance and support team for AWS Data platform Manage tickets raised by business team Identify opportunities for automation and platform enhancement - design and build solutions Configuration of monitoring agents at the software layer, and the development of meaningful alerts and the escalation procedures Responses to monitoring alerts according to defined playbooks and procedures Creating Tools & Framework to determine Source Discovery, Data Availability and Data Change Tracking. Real Time Application Dashboards showing overall health of the system involved in data pipeline. AWS Capacity Planning to onboard new services like EMR. Perform benchmarking & performance of AWS infrastructure via automation. Contributions to Operational Standards and Requirements Develop run books for problem diagnosis, resolution and escalation. Automate various RTB jobs using scripts/tools to speed execution Qualifications BS in Computer Science. MS Preferred. S. or higher in Computer Science or equivalent knowledge and experience Experience managing infrastructure in AWS. Apt with automating repetitive tasks using Python, Ruby, JavaScript or Bash Experience with CI/CD tools; i.e.. Jenkins Experience designing and deploying systems on AWS Enjoy a fast-paced, rapidly changing work environment Good communication skills and a passion for clean code Experience with SQL and Python(Boto3 Library) Experience with AWS products including EC2, S3, RDS, ElastiCache, ElasticSearch, Kinesis, Lambda, etc Exposure to Big Data on AWS (DataPipeline, Batch, AWS Glue, S3, EMR/EC2) Responsibilities: Be an onshore POC for 24/7 maintenance and support team for AWS Data platform Manage tickets raised by business team Identify opportunities for automation and platform enhancement - design and build solutions Strong Linux/unix background and advanced scripting knowledge in Python/Perl/Go. Extensive Experience in automation, capacity planning & benchmarking/performance testing in AWS Installing, configuring, administering some of the following: Hive,EMR etc. Implement and adhere to continuous integration practices Designing cloud infrastructure that is secure, scalable, and available on AWS Operational mindset with ability to do Problem, SLA and Incident Management. Troubleshoot issues and participate in 24x7 on-call support, ensuring the stability of the production environment. Strong critical thinking ability to assess complex problems, analyze options, navigate diverse perspectives and develop optimal/acceptable solutions Ability to work independently with minimal supervision

Keywords: Intuit, San Francisco , Staff Data Engineer, Engineering , Santa Clara, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Civil Engineer Project Manager ( PE Licensed ) Sacramento CA
Description: Position: Civil Engineering Project Manager PE Licensed - Civil Land Development Industry Experienced Office Locations: Sacramento California 95833 Term: Full Time Permanent Employment Compensation: (more...)
Company: TJG Civil Engineers and Land Planners
Location: Rancho Cordova
Posted on: 07/17/2019

Backend Engineer
Description: Let companies apply to you, not the other
Company: Hired
Location: Sacramento
Posted on: 07/17/2019

Site Reliability Engineer
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring site reliability engineers. Want to work for a company you love Are you (more...)
Company: Hired
Location: Woodbridge
Posted on: 07/17/2019


Backend Engineer
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring backend developers.Want to work for a company you love Are you a Backend (more...)
Company: HIRED
Location: Lodi
Posted on: 07/17/2019

Machine Learning Engineer
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring machine learning engineers. Want to work
Company: Hired
Location: Galt
Posted on: 07/17/2019

DevOps Engineer - Winters
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring devops engineers. Want to work for a company you love Are you a DevOps (more...)
Company: Hired
Location: Winters
Posted on: 07/17/2019

DevOps Engineer
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring devops engineers. Want to work for a company you love Are you a DevOps (more...)
Company: Hired
Location: Zamora
Posted on: 07/17/2019

Backend Engineer
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring backend developers. Want to work for a company you love Are you a Backend (more...)
Company: Hired
Location: Wilton
Posted on: 07/17/2019

DevOps Engineer
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring devops engineers.Want to work for a company you love Are you a DevOps (more...)
Company: Hired
Location: Woodland
Posted on: 07/17/2019

Machine Learning Engineer
Description: Let companies apply to you, not the other way around. Sign up with Hired to get access to thousands of companies currently hiring machine learning engineers. Want to work
Company: Hired
Location: Lockeford
Posted on: 07/17/2019

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

San Francisco RSS job feeds