SanFranRecruiter Since 2001
the smart solution for San Francisco jobs

Data Engineering Tech Lead (San Francisco

Company: Lever
Location: San Francisco
Posted on: February 25, 2021

Job Description:

Data Engineering Tech Lead (San Francisco) About BrightTALK - discover your journey with BrightTALK here ! The Data team builds and maintains the infrastructure responsible for consuming, exposing and creating product and product-derived (augmented) datasets. This team owns the pipelines that transport and process database data from all of BrightTALK's product surfaces. The team is responsible for building and operating the infrastructure and services that ensure data accuracy and data availability for stakeholders in Data Science, Business and other Engineering feature teams. The Data Engineering Lead will provide technical leadership and strategic direction for our data platform. You will be responsible for the delivery and technical quality of our programs, taking on complex multi-year projects, and lead the work of several ICs. You'll also partner with cross-functional stakeholders to drive initiatives forward, and mentor team members in technical design, project leadership, and running team processes. The Data Engineering Lead will collaborate with experienced data scientists, engineers, product managers and vendors to build and maintain scalable data infrastructure. You will be deeply involved in the technical details of building highly available infrastructure and ultimately work to build a safer financial system for billions of people Responsibilities

  • Building highly reliable data services to integrate with dozens of consumers
  • Creating ETL or ELT pipelines that transform and process petabytes of structured and unstructured data in real-time
  • Designing data models for optimal storage and retrieval to support sub-second latency
  • Deploying and monitoring large database clusters that are performant and highly-available
  • Working cross-functionally with data scientists, backend engineers, and product managers to design and implement, and new data models to support the product
  • Developing your skills through exceptional training as well as frequent coaching and mentoring from colleagues
  • Some upcoming technical challenges include scaling our data ingestion pipelines across a growing number of AWS and data center based data sources, reducing the latency of our product data ingestion pipelines through moving batch jobs into a streaming architecture, and extending our data lake architecture for the growing ecosystem of data ingestion and creation tools Qualifications
    • Bachelor's degree (or equivalent) in Computer Science or related field
    • 5+ years of experience building real-time and distributed system architecture, from whiteboard to production
    • Strong programming skills in Python, Java or Scala and SQL.
    • Versatility. Experience across the entire spectrum of data engineering, including:
    • Data stores (e.g., AWS RDS, AWS Athena, AWS Aurora, AWS Redshift)
    • Data pipeline and workflow orchestration tools (e.g., Azkaban, Airflow)
    • Deployment and monitoring large database clusters in public cloud platforms (e.g., Docker, Terraform, Datadog)
    • Adaptable. Goals can change fast. You anticipate and react quickly.
    • Autonomous. You own what you work on. You move fast and get things done.
    • Excellent communication. You will need communicate complex ideas effectively to both technical and non-technical audiences, and both verbally and in writing
    • Collaborative. You must work collaboratively in a cross-functional team and with people at all levels in an organization
    • Industry experience building and productionizing innovative end-to-end Machine Learning systems is a plus. We are dedicated to learning and growing, going after big dreams, taking ownership, remaining open and honest while recognizing we are in it together. We are committed to hiring individuals with a diversity of perspectives, backgrounds, and beliefs who can use their passion to help us build a world changing audience and thrive along the way. Join BrightTALK and experience a collaborative and engaged team who works together to provide learning and growth opportunities for businesses and professionals.-- BrightTALK is an Equal Opportunity Employer and does not discriminate on the basis of ethnicity, gender, sexual orientation, gender identity or expression, religion, disability, national origin, protected veteran status, age, or any other status protected by applicable national, federal, state, or local law.--

Keywords: Lever, San Francisco , Data Engineering Tech Lead (San Francisco, Engineering , San Francisco, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Other Engineering Jobs


HIRED: Front-End Engineer - Remote
Description: Join Hired and find your dream job as a Front-End Engineer at one of 10,000 companies looking for candidates just like you.Companies on Hired apply to you, not the other way around. You'll receive (more...)
Company: HIRED
Location: Novato
Posted on: 03/3/2021

Estes Express Lines, Inc.: Truck Mechanic
Description: Responsible for repairs and required preventive maintenance of diesel engines, trucks and/or forklifts Inspect, trouble shoot, diagnose and perform maintenance on equipment Perform safety inspections (more...)
Company: Estes Express Lines, Inc.
Location: West Sacramento
Posted on: 03/3/2021

Azure DevOps Engineer - 9+ Years Exp
Description: What You'll Do Azure DevOps CICD ADLS Data
Company: Adroit Resources, Inc.
Location: Pleasanton
Posted on: 03/3/2021


Collision Repair Technician
Description: Job Summary Experienced Auto Body Technician needed to repair vehicles thoroughly, safely, and profitably in a manner consistent with Caliber S.O.P., insurance partner and industry guidelines/standards. (more...)
Company: Caliber Collision
Location: Walnut Creek
Posted on: 03/3/2021

DevOps Engineer
Description: Immediate 6 month contract for Sr. DevOps Lead who has extensive experience with cloud services and platforms
Company: Experis
Location: Rancho Cordova
Posted on: 03/3/2021

Estes Express Lines, Inc.: Car Mechanic
Description: Responsible for repairs and required preventive maintenance of diesel engines, trucks and/or forklifts Inspect, trouble shoot, diagnose and perform maintenance on equipment Perform safety inspections (more...)
Company: Estes Express Lines, Inc.
Location: Carmichael
Posted on: 03/3/2021

Experienced Body Technician
Description: Job Summary Experienced Auto Body Technician needed to repair vehicles thoroughly, safely, and profitably in a manner consistent with Caliber S.O.P., insurance partner and industry guidelines/standards. (more...)
Company: Caliber Collision
Location: San Ramon
Posted on: 03/3/2021

mechanic
Description: Responsible for repairs and required preventive maintenance of diesel engines, trucks and/or forklifts Inspect, trouble shoot, diagnose and perform maintenance on equipment Perform safety inspections (more...)
Company: Estes Express Lines, Inc.
Location: Rancho Cordova
Posted on: 03/3/2021

Loads and Dynamics Engineer
Description: We are currently seeking an experienced Loads and Dynamics Engineer to join our growing team in Santa Cruz, CA. The ideal candidate brings a strong mathematical background, a detailed conceptual understanding (more...)
Company: Velocity Consulting Solutions
Location: Santa Cruz
Posted on: 03/3/2021

QA Engineer II
Description: JOB REQUISITION QA Engineer II LOCATION SAN RAMON JOB DESCRIPTION As QA Engineer II, your specific responsibilities include: Be able to understand business process and system requirements to develop relevant (more...)
Company: Robert Half
Location: San Ramon
Posted on: 03/3/2021

Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

San Francisco RSS job feeds