The Wikimedia Foundation is the nonprofit organization behind Wikipedia and a variety of other free knowledge projects. We are driven by a vision of a world where every person can freely access and share the sum of all knowledge. By hosting these platforms and supporting the global volunteer communities that make them possible, we advocate for open information and build the software experiences that keep free knowledge thriving. We are currently looking for a passionate individual to join our distributed team.
What is this role?
We are seeking a Senior Big Data Engineer to join our Data Engineering team on a full-time basis. This is a senior-level position that is fully remote, and we are open to candidates located in time zones ranging from UTC-8 to UTC+2. In this role, you will help us build, maintain, and expand the shared data infrastructure that powers research, insights, and new products across the Foundation and the broader Wiki movement.
What will you do?
- Develop and maintain scalable data pipeline infrastructure, processes, and libraries using tools like Airflow, Spark, Flink, and Kafka.
- Design a robust shared data platform to support critical mission-driven use cases, such as product analytics, bot detection, image classification, and harassment prevention.
- Establish data governance and lineage solutions while implementing monitoring to ensure high data quality and operational excellence.
What makes you a great fit?
To succeed in this role, you should have at least 5 years of relevant industry experience and a degree in Computer Science or equivalent practical experience. We are looking for someone who is comfortable working in English and possesses the following qualifications:
- Advanced proficiency in SQL and relational databases, including experience with technologies like MariaDB, HiveQL, Presto, or Spark SQL.
- Strong programming skills in languages such as Python, Scala, or Java.
- Hands-on experience building data pipelines with tools like Airflow, Spark, or Yarn.
- Familiarity with stream processing systems such as Kafka or Flink.
- Excellent communication skills and a collaborative, cross-cultural mindset.
- A deep commitment to our organizational mission, values, and principles, as well as a dedication to diversity, equity, and inclusion.
What's in it for you?
We offer a competitive salary range of 100,000 USD to 160,000 USD, which is adjusted based on your specific location and experience. Beyond compensation, we provide the following benefits:
- Remote work flexibility.
- The opportunity to be part of a globally distributed, mission-driven team.
- Regular opportunities to connect with colleagues in person during annual off-sites and conferences.
