Senior Data Engineer at Crisis Text Line

At Crisis Text Line, we provide free, 24/7 mental health support and crisis intervention by connecting people in need with trained volunteers. We operate at the intersection of empathy and innovation, aiming to build a world where no one feels alone, and we are looking for a Senior Data Engineer to help us scale our impact.

Responsibilities

• Work alongside engineering teams, data scientists, and business units to refine data ingestion and integration processes.
• Design, build, and maintain reliable data pipelines using Infrastructure as Code principles, Databricks, and Datadog.
• Develop and optimize big data processing tasks using Spark and PySpark.
• Write complex SQL queries to support robust ETL processes.
• Create and implement secure integration solutions between various data sources and our infrastructure.
• Automate monitoring tools to ensure high data accuracy and pipeline efficiency.
• Maintain thorough documentation for all architectures, codebases, and configurations.
• Stay current with emerging data engineering technologies to suggest and implement process improvements.

Must-haves

• A Bachelor’s or Master’s degree in Computer Science or a related field.
• At least 4 years of professional experience in data engineering.
• Expertise in managing complex data pipelines using Infrastructure as Code tools like Terraform.
• Strong proficiency in SQL, Python, Spark, and PySpark.
• Hands-on experience with AWS and Databricks platforms.
• Experience with orchestration tools such as Airflow or Databricks Workflows.
• Familiarity with streaming technologies like Kafka, Kinesis, or Spark Streaming.
• A solid understanding of distributed systems and machine learning basics.
• A stable, high-speed internet connection for remote collaboration.
• Residency in one of our eligible states: CA, CO, CT, FL, GA, HI, IL, IN, IA, MD, MA, MI, MO, NJ, NM, NY, NC, OH, PA, TN, TX, UT, VA, or WA.

Nice-to-haves

• Relevant certifications, such as the AWS Certified Data Engineer - Associate.
• Databricks Certified for Apache Spark.

Benefits

The annual salary range for this position is $107,000 to $148,250. We offer a comprehensive benefits package designed to support your holistic well-being:

• Medical, dental, and vision insurance for you and your family at no cost.
• Flexible paid time off, including 15 vacation days, 3 personal days, 7 sick days, and 20 paid holidays.
• 403b retirement plan with a 3% company contribution.
• 12 weeks of paid parental leave.
• Student loan repayment assistance after two years of service.
• Monthly stipends for mental health and internet service.
• Annual stipends for professional development and wellness.
• One-time home office setup allowance.
• Access to a virtual childcare platform.