SanFranRecruiter Since 2001
the smart solution for San Francisco jobs

Staff Software Engineer, Scale Transport

Company: Quantcast
Location: San Francisco
Posted on: July 16, 2019

Job Description:

At Quantcast, data is king, and the Scale & Transport team knows how to process it. The unique features of our custom map-reduce implementation include a revolutionary petabyte sort mechanism, an efficient and flexible petabyte join and lookup, based on innovative data indexing and partitioning mechanisms, dynamic task size adjustment in running jobs, and a self-tuning system that learns and improves job performance without developer intervention. In the last 5 years it has allowed Quantcast to scale from processing 400 to 40,000 terabytes of data per day. For a workload consisting primarily of ETL, analytics, and data mining, our big data processing platform is on average 4 to 5 times more efficient than the most popular open source map-reduce system. Now Quantcast is looking to marry the ergonomics of Spark with the adaptability and performance of our home-grown stack. Are you the Staff Engineer who can bring us into the next generation of distributed computing? You would integrate and improve new open source technologies and invent your own.Quantcast owns and operates the world s largest audience insights and measurement platform on the open internet. Fueled by live data drawn from more than 100 million web and mobile destinations, Quantcast applies machine learning technology to help marketers, publishers, and agencies grow their brands by better understanding and predicting consumer interactions in real-time. Founded in 2006, Quantcast is headquartered in San Francisco and employs more than 700 employees in over 20 offices across 10 countries. We are committed to building an inclusive and diverse environment where everyone can be their authentic self.Responsibilities * Co-own the vision for peta-scale computation at Quantcast, from strategy to implementation * Work with engineers using Quantcast s distributed computing infrastructure to anticipate and meet their needs, with an eye to business value * Design and develop high performance distributed computing systems * Diagnose and solve big data problems with system engineering solutions * Perform design, architecture, and code reviews * Mentor and grow junior team members * Innovate in the big data space: lead, not follow Requirements* BS in Computer Science or equivalent experience * 8 years of industry experience in software development * Experience working & optimizing the performance of large-scale distributed systems * Proficient in C++ and/or Java * Strong software development skills (version control, code review, testing, release, monitoring, debugging) * Proficiency and high level of insight into Linux OS and running software systems on Linux

Keywords: Quantcast, San Francisco , Staff Software Engineer, Scale Transport, IT / Software / Systems , San Francisco, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other IT / Software / Systems Jobs


Senior Software Engineer
Description: Senior Software Engineer br If you are a Senior Software Developer - Solutions with experience, please read on We have changed the way coders are building, managing and distributing software. Giving (more...)
Company: CyberCoders
Location: Sunnyvale
Posted on: 07/17/2019

Java Developer
Description: Tech Firefly is partnering with an American e-commerce giant in Sunnyvale, CA. We are
Company: Tech Firefly
Location: Sunnyvale
Posted on: 07/17/2019

Product Tester at Home. $25hr-$45hr. No Experience Required. Part-time
Description: In-Home Usage Tester Product Tester--from--home Part-timePresently we're recruiting Product Testers from home in several US cities--to expand our private network of In-Home Usage Testers IHUT to (more...)
Company: American Consumer Panels
Location: San Rafael
Posted on: 07/17/2019


WEBMETHODS DEVELOPER
Description: WEBMETHODS DEVELOPER Sunnyvale, CA 12 months contract Must Have: -- Total 8-12 Years Experience. -- Experience in software systems
Company: Focus America Inc
Location: Sunnyvale
Posted on: 07/17/2019

15090 : Power Programmer - UI-Middleware
Description: Description: Power Programmer
Company: Platotechinc Inc
Location: Sunnyvale
Posted on: 07/17/2019

Software Engineer
Description: Description:The coolest jobs on this planet--- or any other--- are with Lockheed Martin Space.At the dawn of a new space age, Lockheed Martin is a pioneer, partner, innovator and builder. Our amazing (more...)
Company: Lockheed Martin
Location: Sunnyvale
Posted on: 07/17/2019

Infrastructure Devops with Linux
Description: Job Title: Infrastructure Devops with Linux Job Location: Sunnyvale, CA Duration: 6 months Experience: 6 years a. Excellent knowledge in
Company: Insigma Inc
Location: Sunnyvale
Posted on: 07/17/2019

Clinical Programmer III
Description: Pharmacyclics is committed to the development and commercialization of novel therapies intended to improve the quality and duration of life and to resolve serious unmet medical needs for cancer patients. (more...)
Company: Pharmacyclics, LLC
Location: Sunnyvale
Posted on: 07/17/2019

Principal Technical Mktg Eng
Description: Job Title br br Principal Technical Marketing Engineer br br Job Description br br We have an exciting and fast-paced role to help us drive and shape the products, technologies and solutions (more...)
Company: Juniper Networks
Location: Sunnyvale
Posted on: 07/17/2019

Senior Member of Technical Staff: Developer
Description: Are you looking to join one of the fastest growing software companies in the Bay Area ThoughtSpot's AI-Driven analytics platform is disrupting the BI industry by making analytics 1000x faster and easier (more...)
Company: ThoughtSpot
Location: Sunnyvale
Posted on: 07/17/2019

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

San Francisco RSS job feeds