Contract Data Engineer
Remote
Contractor
#Engineering
#Python
#DBT
#Data Pipelines
#Kafka
#Spark
#AWS Kinesis
#AWS Lambda
#Apache Airflow
#SQL
#Snowflake
About the role:
As a Data Engineer in this role, you will be responsible for building core infrastructure software (pipelines, APIs, data modelling) as part of our client's data platform team. Your work will include instrumenting systems for performance, and enhancement throughout. You will work on ensuring these data offerings are to various internal & external stakeholders using secure authentication patterns.
Your role will include choosing and implementing the appropriate technologies for scaling data access patterns, batch processing, and data streaming for soft real-time consumption while considering the unique domain knowledge of the client's business. As a senior collaborator on the team, you will coach & mentor other engineers to support the growth of their technical expertise.
- Proven experience writing highly maintainable, performant Python code
- Experience with dbt-core, inclusive but not limited to macros, testing, groups etc.
- Experience building modern data pipelines using dbt, Kafka, Spark, AWS Kinesis, AWS Lambda, and Apache Airflow (or similar)
- Understanding of Data Modelling patterns
- Deep knowledge of complex SQL, with emphasis on Common Table Expressions, window functions, and their performance
- Experience working with OLAP databases, particularly Snowflake
- Experience with end-to-end monitoring & alerting experience (CloudWatch, Datadog, etc)
Non-Technical competencies:
- Problem-solving skills that balance innovation with pragmatic technology choices to solve business needs
- Comfortable working in a dynamic production environment and taking care of client expectations effectively
- Distinct customer focus and quality mindset
- Experience working closely with engineering leadership and architects to deliver high-quality solutions
- Experience maintaining a high-degree of ownership and transparency in deliverables
- An exemplar of YLD’s brand and safeguarder of our reputation
- Exceptional communication skills, able to communicate complex ideas in a simple fashion
We’re an equal opportunity employer and value diversity of all kinds. We don’t discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, pregnancy or maternity, age, marital status, or disability status. We also believe in work-life balance and offer flexible working around our core hours.
YLD
9 views
