SanFranRecruiter Since 2001
the smart solution for San Francisco jobs

Python Data Engineer (Python, AWS, Docker, Kubernetes)

Company: Pacific Data Integrators
Location: San Francisco
Posted on: November 20, 2019

Job Description:

PDI provides services across all verticals and continues to grow as a leader across every sector of data management, from Big Data to Data Science. Our team's talent is what sets us apart from our competitors and we continuously seek out the foremost talent of the technology community to give you the best result possible. At this moment we are hiring a Python Data Engineer (Python, AWS, Docker, Kubernetes) for our client located in San Francisco, CA Responsibilites: - You will work closely with data architects, data scientists and data product managers on the team to ensure that we are building an integrated, performant solutions. - Ideally you will have a Software Engineering mindset, be able to leverage CI/CD and apply critical thinking to the work you undertake. - The role would suit candidates looking to make the move from working with traditional big data stacks such as Spark and Hadoop to using cloud native technologies (DataFlow, Big Query, Docker/Kubernetes, Pub/Sub, Redshift, Cloud Functions). - Candidates who also have strong software development skills and wishing to make the leap to working with Data at scale will also be considered. Skills Required: - Strong programming skills in languages such as Python/Java/Scala including building, testing and releasing code into production. - Strong SQL skills and experience working with relational/columnar databases (e.g. SQLServer, PostgreSQL, Oracle, Presto, Hive, BigQuery etc.) - Knowledge of data modelling techniques and integration patterns. - Experience migrating from on-premise data stores to cloud solutions - Building API's and apps using Python/JavaScript or an alternative language. - Practical experience with traditional Big Data stacks (e.g. Spark, Flink, HBase, Flume, Impala, Hive etc.) - Experience with AWS data pipeline, Azure data factory or Google Cloud Dataflow

Keywords: Pacific Data Integrators, San Francisco , Python Data Engineer (Python, AWS, Docker, Kubernetes), Engineering , San Francisco, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Detection Engineer
Description: Position Purpose: Contribute in the technical support of the IT Security environment and associated applicationsCoordinate and provide assistance with end-user support, trouble ticket resolution, security (more...)
Company: Centene Corporation
Location: Rancho Cordova
Posted on: 12/15/2019

Threat and Vulnerability Management Engineer
Description: Description br br At First Republic, we care about our people. We offer extraordinary client service in private banking, private business banking and private wealth management. Founded in 1985, we (more...)
Company: First Republic
Location: San Francisco
Posted on: 12/15/2019

Civil Engineer I New
Description: Employer Golder Location ROSEVILLE,CA Ref Starts Dec 3, 2019 Closes Jan 2, 2020 Job Category Banking Financial Services Job Type Permanent Golder is not just a place to work, it is a promise (more...)
Company: Golder
Location: Roseville
Posted on: 12/15/2019


Automotive Technician
Description: We are currently looking for an experienced Automotive Technician to join our team. Smog license and ASE's are prefered. We are open Monday through
Company: Asap Automotive, Inc.
Location: Fremont
Posted on: 12/15/2019

Senior Site Reliability Engineer
Description: JOB DESCRIPTION: br br Cloudera is looking for an accomplished Site Reliability Engineer SRE to play a key role in advancing Cloudera s product offerings in the cloud. In this role, you will be (more...)
Company: Cloudera, Inc.
Location: Palo Alto
Posted on: 12/15/2019

Senior Backend Engineer, Identity
Description: Location: San Francisco, CACoinbase has built the world's leading compliant cryptocurrency platform serving over 30 million accounts in more than 100 countries. With multiple successful products, and (more...)
Company: Coinbase
Location: San Francisco
Posted on: 12/15/2019

Trane Sr. HVAC Technician Rocklin CA
Description: At Ingersoll Rand we're passionate about inspiring progress around the world. We advance the quality of life by creating comfortable, sustainable and efficient environments. Our people and our family (more...)
Company: Ingersoll Rand
Location: Rocklin
Posted on: 12/15/2019

Senior Network Engineer
Description: Description: Position Purpose: Responsible for design, development, implementation, and analysis of voice and data communications networks. Uses knowledge of LAN/WAN
Company: Centene Coproration
Location: Rancho Cordova
Posted on: 12/15/2019

Senior Network Engineer (Network
Description: Senior Network Engineer Network USA-California-Rancho Cordova, USA-Missouri-Chesterfield, USA-New York-Getzville Position Purpose: Responsible for design, development, implementation, and analysis of (more...)
Company: Cenpatico
Location: Rancho Cordova
Posted on: 12/15/2019

Senior Detection Engineer
Description: Position Purpose: Provide technical support for the IT Security environment and associated applicationsPerform daily tasks to ensure the stability and optimization of the IT Security environment, which (more...)
Company: Centene Corporation
Location: El Dorado Hills
Posted on: 12/15/2019

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

San Francisco RSS job feeds