Data Engineer
On-site
Full Time
#Engineering
#Data Science
#Marketing
#Apache Airflow
#Apache Spark
#Docker
#Python
#SQL
#ETL
#Kafka
#Redshift
#S3
#Trino
SpotHero is a parking reservation service that helps drivers find and book parking at thousands of locations across North America, and we are looking for a Data Engineer to join our team. You will work within our data engineering squad to build products and pipelines that empower our colleagues in data science, marketing, and business analytics to effectively model and analyze our data.
Responsibilities
- Collaborate with cross-functional squads to understand their data processing and pipelining requirements.
- Design and maintain scalable data models that are clear and accurate.
- Develop and manage data pipelines using Python, Apache Airflow, Apache Spark, and Docker.
- Create self-service tools that allow analysts and engineers to build their own data pipelines.
- Ensure all data processing code is thoroughly tested and well-documented.
- Work with our data warehouse in Redshift and our data lake in Trino to build impactful data products.
- Define service level agreements and configure monitoring to ensure pipeline reliability.
Must-haves
- 2 to 4 years of professional experience in data engineering.
- Proficiency in designing and implementing high-quality software using Python.
- Strong experience using SQL for data management.
- Hands-on experience with ETL scheduling tools like Airflow.
- Experience working with data platforms such as Kafka, S3, Postgres, and Redshift.
- Familiarity with containerized software deployment, continuous integration systems, and version control.
- Excellent communication skills to bridge the gap between technical and business requirements.
Nice-to-haves
- Experience with streaming or message-driven architectures using tools like Kafka, Spark, or Flink.
- Background in working with MPP databases like Presto.
- Proficiency in a JVM language such as Kotlin, Java, or Scala.
- Knowledge of infrastructure-as-code tools like Terraform.
- Experience deploying containerized applications using Kubernetes.
Benefits
- Medical, dental, and vision insurance coverage.
- 401k retirement savings plan.
- Life and disability insurance.
- Flexible PTO policy and a strong focus on work-life balance.
- Annual parking stipend.
- Opportunity to work in a collaborative, productive, and innovative environment.