SanFranRecruiter Since 2001
the smart solution for San Francisco jobs

Big Data Engineer

Company: Palo Alto Networks
Location: Santa Clara
Posted on: November 11, 2019

Job Description:

Description Our Mission At Palo Alto Networks everything starts and ends with our mission: protecting our way of life in the digital age by preventing successful cyberattacks. It's not a small goal. It isn't simple either, but we aren't in this for the easy answer. As a company with a foundation in challenging the way things are done, we're looking for innovators with a dedication to best. In return, your career will have a tangible impact - one that's working toward technology that affects every level of society. Our mission doesn't happen by treading softly - no, it happens by defining an industry. It means building products that haven't been thought of. It means selling products with a solutions mindset. It means supporting the infrastructure of a company that moves at an incredible speed - intentionally - to stay ahead of the world's next cyberthreat. Your Career Our daily fight with cyber bad guys requires us to collect and analyze a lot of data. A LOT of data. And, as our customer base continues its rapid growth, we need to look at faster and more robust tools to help us and our customers make the best decisions possible. With your knowledge of Hadoop and Big Data technologies, you will add your tools-building superpowers to a small team tasked with building out a DevOps automation environment, one that will step up our Business Analytics game and help us protect our customers from cyber intruders. We offer the chance to be part of an important mission: ending breaches and protecting our way of digital life. If you are a motivated, intelligent, creative, and hardworking individual, then this job is for you! Overview You will be responsible for leading technical projects to build custom applications and enhance business systems. We are looking for someone with solid project management and organization skills complemented by a strong technical background. You will work with a team of senior level managers and highly technical engineers to lead complex IT projects. The role will collaborate with multiple engineering and business organizations, understand and align with their needs, and take independent end-to-end responsibility for release of new business capabilities to production. Your Impact - As a Big Data Engineer, you will be an integral member of our Big Data and Analytics team responsible for design and development - Partner with data analyst, product owners and data scientists, to better understand requirements, finding bottlenecks, resolutions, etc. - Design and develop Big Data solutions both in Cloud & OnPrem - Design and develop different architectural models for our scalable data processing as well as scalable data storage - Build data pipelines and ETL using heterogeneous sources using Dataflow or DataProc - Build data ingestion from various source systems to Hadoop or GCP using Kafka, Flume, Sqoop, Spark Streaming etc. - Transform data, using data mapping and data processing in Apache Beam or Spark - Responsible to ensure that the platform goes through Continuous Integration (CI) and Continuous Deployment (CD) with DevOps automation - Expands and grows data platform capabilities to tackle new data problems and challenges - Supports Big Data and batch/real time analytical solutions using groundbreaking technologies like Apache Beam - Have the ability to research and assess open source technologies and components to recommend and integrate into the design and implementation - Work with development and QA teams to design Ingestion Pipelines, Integration APIs, and provide Hadoop ecosystem services Your Experience - Degree in Bachelor of Science in Computer Science or equivalent - 5+ years of experience with the Hadoop ecosystem and Big Data technologies - 2+ year of experience in Cloud computing - Competent in writing Scala, Python or Java code. - Development experience in Dataflow or DataProc is a Plus - Ability to dynamically adapt to conventional big data frameworks and tools with the use-cases required by the project - Experience with building stream-processing systems using solutions such as spark-streaming, Storm or Flink etc. - Experience in other open-sources like Druid, Elastic Search, Logstash etc. is a plus - Knowledge of design strategies for developing scalable, resilient, always-on data lake - Some knowledge of agile(scrum) development methodology is a plus - Strong development/automation skills - Excellent inter-personal and teamwork skills - Can-do attitude on problem solving, quality and ability to execute The Team Working at a high-tech cybersecurity company within Information Technology is a once in a lifetime opportunity. You'll be joined with the brightest minds in technology, creating, building, and supporting tools and that enable our global teams on the front line of defense against cyberattacks. We're joined by one mission - but driven by the impact of that mission and what it means to protect our way of life in the digital age. Join a dynamic and fast-paced team that feels excitement at the prospect of a challenge and feels a thrill at resolving technical gaps that inhibit productivity. Our Commitment We're trailblazers that dream big, take risks, and challenge cybersecurity's status quo. It's simple: we can't accomplish our mission without diverse teams innovating, together. To learn more about our dedication to inclusion and innovation, visit our Life at Palo Alto Networks page and our diversity website. Palo Alto Networks is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics. Additionally, we are committed to providing reasonable accommodations for all qualified individuals with a disability. If you require assistance or an accommodation due to a disability or special need, please contact us at ***********************************. #LI-AH1

Keywords: Palo Alto Networks, San Francisco , Big Data Engineer, Engineering , Santa Clara, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


Front-End Engineer
Description: Join Hired and find your dream job as a Front-End Engineer at one of 10,000 companies looking for candidates just like you.Companies on Hired apply to you, not the other way around. You'll receive salary (more...)
Company: Hired
Location: West Sacramento
Posted on: 11/15/2019

Front-End Engineer
Description: Join Hired and find your dream job as a Front-End Engineer at one of 10,000 companies looking for candidates just like you.Companies on Hired apply to you, not the other way around. You'll receive salary (more...)
Company: Hired
Location: Woodbridge
Posted on: 11/15/2019

Sr. Data Engineer
Description: br br br br Sr. Data Engineer br br br Job DetailsLevel ExperiencedJob Location CA - Roseville, CADescription Parchment is growing, and we want our top talent to grow with us. That's why (more...)
Company: Parchment
Location: Roseville
Posted on: 11/15/2019


Senior Backend Engineer
Description: Join Hired and find your dream job as a Senior Backend Engineer at one of 10,000 companies looking for candidates just like you. Companies on Hired apply to you, not the other way around. You'll receive (more...)
Company: HIRED
Location: Rio Vista
Posted on: 11/15/2019

Principal Mechanical Engineer - Warheads with Security Clearance
Description: Do you have a passion for Warhead Technology Would you enjoy working on advanced warhead technologies using scientific principles, theories and concepts to the weapon warhead system for implementation (more...)
Company: Raytheon
Location: Sacramento
Posted on: 11/15/2019

Engineer IV
Description: Frontier Energy is a new company with a long history. Five companies came together to leverage strengths, relationships, and data to help reduce energy use, increase alternative transportation, and bring (more...)
Company: Frontier Energy, Inc.
Location: Davis
Posted on: 11/15/2019

Front-End Engineer
Description: Join Hired and find your dream job as a Front-End Engineer at one of 10,000 companies looking for candidates just like you.Companies on Hired apply to you, not the other way around. You'll receive salary (more...)
Company: Hired
Location: Travis Afb
Posted on: 11/15/2019

Senior Validation Engineer - IV (9590351)
Description: Job Responsibilities Provide Automation Validation Engineering Support to Vacaville Manufacturing Operations for CCP1 Automation, focused on the Control Layer Replacement project. Good knowledge of validation (more...)
Company: OMI
Location: Vacaville
Posted on: 11/15/2019

Artificial Intelligence Engineer - Sacramento
Description: Shape the future of Machine Learning. NOW is your chance --At Revature, we hire emerging technology talent to innovate the future of tomorrow. In the next 2 weeks, we will hire over 20 new Artificial (more...)
Company: Revature
Location: Sacramento
Posted on: 11/15/2019

Process Engineer
Description: Process Engineer North America-North America-United States-CA-Lodi JOB SUMMARY: The Injection Molding Process Engineer is a hands on position that plans, directs, and coordinates manufacturing equipment (more...)
Company: Leica Biosystems
Location: Lodi
Posted on: 11/15/2019

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

San Francisco RSS job feeds