Data Platform Engineer at BigID

Who we seek:

We’re looking for a Data Platform Engineer to join our Data Platform team. The ideal candidate will have extensive experience with data engineering, specifically with Kafka and Elasticsearch, to design and maintain our data platforms. You will work closely with cross-functional teams to ensure the scalability and reliability of our data solutions.

Job Summary:
As a Data Platform Engineer, you'll be responsible for the design, development, maintenance, troubleshooting, and implementation of our big data architecture. 
Your expertise in Elastic, Kafka, and Java will be critical in ensuring the scalability and performance of our data systems.

What you’ll do:

• Implement data processing pipelines using Kafka for real-time data streaming.
• Optimize and manage search capabilities using Elastic technologies.
• Collaborate with product managers, data analysts, and other stakeholders to gather requirements and translate them into technical specifications.
• Oversee code reviews, ensure best practices in coding and data handling, and maintain high-quality standards in software development.
• Stay up-to-date with emerging trends and technologies in big data and recommend improvements to our architecture and processes.
• Troubleshoot and resolve issues in a timely manner to minimize downtime and ensure system reliability.

What you’ll bring:

• Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
• 5+ years of experience in the software engineering field. 
• 3+ years of experience in big data technologies, with a focus on Elastic and Kafka.
• Proficiency in Java programming and experience with related frameworks.
• Strong understanding of data modeling, ETL processes, and data warehousing.
• Excellent problem-solving abilities and strong analytical skills.

• A solid understanding of CI/CD principles.
• Experience working with both external and in-house APIs and SDKs 

Advantages:

• Experience with Docker, Kubernetes
• Experience with cloud platforms (e.g., AWS or Azure) 

What’s in it for you?!

Our people are the foundation of our success, and we prioritize offering a wide range of benefits that make our team happier and healthier.

• Equity participation - everyone shares in our success
• Flexible work arrangements - for parents, for remote workdays, etc.
• Office perks: dog-friendly environment, fully stocked fridge, gym, and exercise classes, weekly Happy Hours, free parking, evening meals
• Knowledge training & Career development tracks

Our Values:

We look for people who embody our values - Care, Do, Try & Shine.

• Care - We care about our customers and each other
• Do - We do what it takes to make a positive impact
• Try- We try our best and we don’t give up
• Shine- We shine and make it our mission to always stand out

#LI-Hybrid

#LI-AT1