SanFranRecruiter Since 2001
the smart solution for San Francisco jobs

Senior Data Engineer - Twitter Developer Platform

Company: Twitter
Location: San Francisco
Posted on: November 22, 2021

Job Description:

The Position The purpose of Twitter is to serve the public conversation. Third-party developers can do far more to accomplish our purpose than we ever could on our own.Twitter Developer Platform ( is home to the Twitter API. We enable third-party developers to understand, learn, enhance, and engage with the public conversation. Nearly half a million developers are active on our platform, ranging from everyday hobbyists to enterprise businesses. They use Twitter API through a wide variety of APIs, generating hundreds of billions of requests daily.As Data Engineering in Developer Platform, we scale data-driven decisions by building real-time and offline data products for our internal data consumers. We leverage large-scale data processing technologies to make developer data accessible, and then use them to answer the most critical and fundamental business questions.What You'll DoAs a member of the data engineering team you will work to lay the foundation for how Developer Platform uses modern data technologies to tackle data challenges at scale for hundreds of billions of API requests daily. You will work closely with product teams to build mission-critical data pipelines and products that are 'source of truth', as well as state-of-the-art data warehouse solutions. You will collaborate closely with data scientists, analysts, engineers, product managers, and many other data consumers across the company.You will be a part of an early-stage team. You will educate stakeholders, mentor team members and have a significant stake in defining the future of the Data Engineering function under the Developer Platform team.Your efforts will reveal invaluable business and user insights, leveraging vast amounts of developer data to shape the future of the Twitter API.Qualifications Who You AreYou are passionate about data. You have a deep understanding of the role Data Engineering plays in building a data-driven culture. You are up for the challenge of defining the Data Engineering function for an early-stage team.QualificationStrong programming and algorithmic skillsExperience with data processing (such as Hadoop, Spark, Pig, Hive, MapReduce, etc).Proficiency with SQL (Relational, Redshift, Hive, Presto, Vertica)Data Modeling and ER modelsAbility in managing and communicating data project plans and requirements to internal clientsNice to haveExperience writing Big Data pipelines, as well as custom or structured ETL, implementation, and maintenanceExperience with large-scale data warehousing architecture and data modelingProficiency with Java, Scala, or PythonExperience with GCP (BigQuery, BigTable, DataFlow)Experience with real-time streaming (Apache Kafka, Apache Beam, Heron, Spark Streaming) Company Description Twitter is one of the largest and most popular platforms in the world. Our code operates at massive scale and speed, serving billions of requests per day, connecting hundreds of millions of active Twitter users to real-time information about their lives and the world we live in.Additional Information We are committed to an inclusive and diverse Twitter. Twitter is an equal opportunity employer. We do not discriminate based on race, ethnicity, color, ancestry, national origin, religion, sex, sexual orientation, gender identity, age, disability, veteran, genetic information, marital status or any other legally protected status.San Francisco applicants: Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Keywords: Twitter, San Francisco , Senior Data Engineer - Twitter Developer Platform, IT / Software / Systems , San Francisco, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

San Francisco RSS job feeds