Dandi
Senior Data Engineer
200k - 200k USD
Hybrid
Full Time
#Engineering
#Apache Spark
#Scala
#K8S
#MLlib
#TensorFlow
#Vertex AI
#Apache Airflow
#BigTable
#BigQuery
Dandi is looking for a Senior Data Engineer
Full TimeSeniorHybridEngineeringApache SparkScalaK8SMLlibTensorFlowVertex AIApache AirflowBigTableBigQueryEnglishRemote workHybrid workDental insuranceVision insuranceFlexible hours
200k - 200k USD per year
Dandi is an enterprise-grade intelligence platform dedicated to workplace diversity, equity, and inclusion. We are looking for a Senior Data Engineer to join our core team and help us build resilient, scalable systems that process massive amounts of data to drive meaningful organizational change.
Responsibilities
- Develop and expand our core systems, engines, and product services using Apache Spark for both batch and real-time streaming.
- Build and maintain Scala microservices hosted on Kubernetes.
- Utilize MLlib and TensorFlow on Vertex AI to tackle complex forecasting, simulation, and machine learning challenges.
- Design and deploy new models and engines to support innovative product ideas and data analyses.
- Collaborate within a high-throughput environment, currently handling terabytes of data and millions of writes per second.
Must-haves
- A Bachelor of Science in Computer Science or an advanced degree.
- Advanced understanding of non-relational schema models, including Column Family, Graph, Document, and Object stores.
- Proven experience designing advanced architectures, such as KAPPA and LAMBDA topologies.
- Strong proficiency in Scala or other JVM-based languages.
- Experience working with Python and high-throughput systems.
- Professional fluency in English.
Nice-to-haves
- Experience working with the Go programming language.
Benefits
The base salary for this position is 200,000 USD.
- Flexible work arrangements, including remote and hybrid options.
- Flexible working hours to support your personal balance.
- Comprehensive dental insurance.
- Comprehensive vision insurance.
Copy Permalink
