Sprintfwd

Lead Data Engineer

Remote

Full Time

#Engineering

#Data Engineering

#Big Data

#SQL

#Apache Spark

#Apache Kafka

#AWS Glue

#Azure Data Factory

#Google Cloud Dataflow

#Python

#Data Modeling

#Data Warehousing

#Agile Methodologies

Sprintfwd is looking for a Lead Data Engineer

Full Time Lead Remote Engineering Data Engineering Big Data SQL Apache Spark Apache Kafka AWS Glue Azure Data Factory Google Cloud Dataflow Python Data Modeling Data Warehousing Agile Methodologies English Remote work Dental insurance Vision insurance

Data is essential for all our clients decision-making needs whether it’s related to franchisee advertising effectiveness, helping key stakeholders understand business KPI’s or building new products in emerging markets. This data is deeply valuable and gives us insights into how we can continue improving our service for our team, advertisers and partners. Comma8 is seeking a highly motivated Data Engineer with a strong technical background and passionate about diving deeper into Big Data to develop state of the art Data Solutions.

“About Us” sections always feel like a forced dating bio. So we’ll cut right to it: we solve complex problems for some of the biggest brands in fit-tech. We’ve collected the expertise needed to help them find and amaze their customers with top-notch digital fitness experiences.

And we work with some unbiasedly awesome people, who believe in deep diving on new challenges, personal growth, and having a life. Since we know you’ll deliver, we’re a Results-Only Workplace Environment, where we offer as many vacation, sick and mental-health days as you need to get the job done.

With projects ranging from high-impact, cutting-edge solutions to complete strategic overhauls we can promise you one thing—your work will have a meaningful impact on an active and thriving customer base.

Benefits

Though we have an office in Irvine, CA and co-working spaces in Los Angeles, we've become a remote-first company through the pandemic. When it's safe to do so, we'd love to meet in person and host retreats. Therefore, candidates in Southern California and Pacific time-zone are preferred, but we're happy to consider any candidates in the US.

We're a Results-Only Workplace Environment (ROWE) which allows you as many vacations, sick, and mental-health days as you need, as long as you are meeting your performance goals, assigned tasks, and projects.

Other benefits include: Health, Dental, Vision and Life Insurance, 401K Plan, Various Fitness and Wellness Benefits (Group Classes, Free Training, Products, etc.), Continued Education Courses, and Conference Attendance The responsibilities and job scope discussed above may change as necessitated by business demands.

Responsibilities

Lead the design and growth of our Products and Data Warehouses around our clients Analytics

Design and develop scalable data warehousing solutions, building ETL pipelines in Big Data environments (cloud, on-prem, hybrid)

Manage the transformation of large daily batch data volumes in the cloud using Apache Spark, EMR, and Glue, ensuring streamlined processing and cost savings

Construct and maintain high-throughput streaming data pipelines using technologies like Kinesis, Spark Streaming, and Elasticsearch, while minimizing response lag

Automate and orchestrate complex data workflows using Python, Apache Airflow, and Step Functions to eliminate bottlenecks in data pipelines

Mentor and guide a team, providing technical expertise in SQL query execution, data manipulation, data visualization, and performance optimization

Develop, test, and deploy scalable reverse ETL solutions using API Gateway, Python (Flask), and Lambda, achieving near-zero latency and high scalability

Help architect data solutions/frameworks and define data models for the underlying data warehouse and data lakes

Collaborate with key stakeholders to map, implement, and deliver successful data solutions

Maintain detailed documentation of your work and changes to support data quality and data governance

Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our clients

Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team

Qualifications

3-5 years of data engineering experience developing large data pipelines

Strong SQL skills and ability to create queries to extract data and build performant datasets

Hands-on experience with data integration tools (e.g. Apache Spark, Apache Kafka)

Hands-on experience with cloud-based data services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow)

Experience with version control systems (e.g., Git) and collaborative development practices

Strong programming skills in Python

Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query)

Solid experience with data integration toolsets (i.e Airflow) and writing and maintaining Data Pipelines

Strong in Data Modeling techniques and Data Warehousing standard methodologies and practices

Familiar with Scrum and Agile methodologies

You are a problem solver with strong attention to detail and excellent analytical and communication skills

Nice to have experience with Cloud technologies like AWS (S3, EMR, EC2)

Sprintfwd

10 views

0 applied

Share this job

Copy Permalink

Discover similar jobs

Cryptio

Senior Typescript Engineer

Remote

Full Time

#Engineering

#Fintech

#Blockchain

#TypeScript

#Node.Js

#NestJS

#PostgreSQL

#AWS

#Kubernetes

#Docker

#Redis

#Pulumi

#Gitlab

Parafin

Staff Software Engineer, Lending Products

285k - 330k USD

Remote

Full Time

#Engineering

#Fintech

#Lending

#Backend Engineering

#Platform Development

#Architecture

#Cross Functional Collaboration

#Mentoring

#Infrastructure Design

#Code Review

#Reliability

Found

Staff Software Engineer, Platform

210k - 278k USD

Remote

Full Time

#Engineering

#Backend

#Public Cloud

#Observability

#Monitoring

#Incident Response

#Tech

#OpenTelemetry

#Prometheus

#Infrastructure as Code

#Terraform

LeanData

GTM Engineer (Data & AI)

Remote

Full Time

#Sales

#Revenue Operations

#Data Engineering

#AI

#Workflow Automation

#Data Warehousing

#API Integration

#Orchestration

Dijital-team-pty-ltd

Automation Engineer

Remote

Full Time

#IT

#Managed Services

#PowerShell

#Python

#Jinja

#BASH

#REST API

#JSON

#Git

#JavaScript

Wrapbook

Senior Product Manager

Remote

Full Time

#Product Management

#Fintech

#SaaS

#Product Strategy

#Roadmap Planning

#Collaboration

#Data Analysis

#SQL

#AI Tools

#Customer Insights

#Technical Systems

Candidly

Senior Infrastructure Engineer

Remote

Full Time

#Infrastructure Engineering

#Cloud Computing

#DevOps

#AWS

#Azure

#Kubernetes

#Docker

#IaC

#Python

#Linux

#Monitoring

#Security

PelotonInc

Senior Software Engineer

Remote

Full Time

#Engineering

#Full Stack

#DevOps

#Docker

#Kubernetes

#AWS

#GCP

#Azure

#Flux

#Rancher

#Continuous Delivery

#Infrastructure

#Microservices

Ivanti

Associate Site Reliability Engineer

Remote

Full Time

#Site Reliability

#Cloud Operations

#DevOps

#Linux

#Windows

#Networking

#Kubernetes

#Docker

#Python

#Java

#AWS

#Azure

#Ansible

BioIntelliSense

DevOps Engineer

Remote

Full Time

#Cloud

#DevOps

#Healthcare

#Terraform

#AWS

#Datadog

#Bitbucket Pipelines

#CircleCi

#Databricks

#Python

#Flutter

Hyperhug

QA Engineer

Remote

Full Time

#Game Development

#QA Testing

#Mobile

#Manual Testing

#TestRail

#Jira

#Android Studio

#XCode

#Unity

#Git

#Firebase

#Python

#C#

Tarmac Technologies

Python Django Backend Engineer

Remote

Full Time

#Technology

#Backend Development

#Tech

#Python

#Django

#RESTful API

#AWS

#Backend Engineering

HeyJobs

Graphic Design Creative Technology

Remote

Part Time

#Technology

#AI Tools

#Digital Marketing

#Engineering

#JavaScript

#Python

#Landing Pages

#Content

ProktaHRSolutions

Senior Software Engineer - Network Services Orchestration

India

Remote

Full Time

#Automation

#Orchestration

#Technology

#Cisco

#Python

#Java

#Linux

#DevOps

Northflank.com

Backend Software Engineer

57k - 127k USD

Remote

Full Time

#Backend Engineering

#Cloud

#Microservices

#Go

#Python

#Node.Js

#SQL

#NoSQL

#RESTful APIs

#Docker

#Kubernetes

#AWS

NewPageSolutionsInc

Python Developer

Remote

Contractor

#Technology

#Digital Health

#Software Development

#Python

#AWS Lambda

#AWS ECS

#Automated Testing

#Agile Methodologies

#Terraform

#Drupal

#PHP

Teach For All

Head of AI Solutions & Engineering

Remote

Contractor

#AI

#Education

#Technology

#TypeScript

#Python

#REST APIs

#Git

#Design

#Google Cloud

#Business Analysis

Caribou Financial

Engineering Manager

175k - 215k USD

Remote

Full Time

#Data Engineering

#Platform Engineering

#Fintech

#DBT

#BigQuery

#GCP

#Pulumi

#IaC

#Data Modeling

#Cloud Infrastructure

#GKE

#CloudSQL

Quora

Staff Machine Learning Engineer

220k - 321k USD

Remote

Full Time

#Machine Learning

#Recommendation Systems

#Engineering

#Python

#C++

#Data Pipelines

#Model Training

#Algorithms

Ramp

Security Engineer, Cloud

Remote

Full Time

#Cloud Security

#Security Engineering

#Fintech

#AWS

#Terraform

#Python

#Flask

#Infrastructure

#DevOps

Your dream job awaits.

Explore exciting opportunities, connect with top employers, and ignite your career.

Explore Jobs

Related Resources

Engineering Salary Guide

Compensation data for Engineering roles

Engineering Job Market

Hiring trends and demand for Engineering

Engineering Interview Prep

Practice questions for Engineering interviews

Data Engineering Salary Guide

Compensation data for Data Engineering roles

Data Engineering Job Market

Hiring trends and demand for Data Engineering

Data Engineering Interview Prep

Practice questions for Data Engineering interviews

Lead Data Engineer at Sprintfwd