Gistimpact

Data Engineering Lead

India

On-site

Full Time

#Engineering

#Data Analytics

#ESG

#Data Architecture

#ETL

#Big Data

#Integration

#Performance Monitoring

#Data Modeling

#Python

#Hadoop

#Spark

#Kafka

Gistimpact is looking for a Data Engineering Lead

Full Time Lead On-site India Engineering Data Analytics ESG Data Architecture ETL Big Data Integration Performance Monitoring Data Modeling Python Hadoop Spark Kafka English

About GIST Impact

GIST Impact is a leading impact data and analytics provider that has been measuring and quantifying corporate impacts for more than 16 years.

With a team of 100+ scientists, engineers, data scientists and environmental economists, GIST Impact delivers market-leading impact platforms and datasets, covering 14,000+ companies with geographically precise, time-series data.

GIST Impact works with pioneering companies across all sectors and with investors representing over $8 trillion in assets under management.

GIST Impact also partners with some of the world's largest ESG data providers, business networks, and fintech platforms to enable impact measurement across global markets.

www.gistimpact.com

Role Description:

As a Data Engineering Lead, you will play a crucial role in overseeing the design, development, and maintenance of our organization's data architecture and infrastructure. You will be responsible for designing and developing the architecture for the data platform that ensures the efficient and effective processing of large volumes of data, enabling the business to make informed decisions based on reliable and high-quality data. The ideal candidate will have a strong background in data engineering, excellent leadership skills, and a proven track record of successfully managing complex data projects.

Responsibilities

Data Architecture and Design:

Design and implement scalable and efficient data architectures to support the organization's data processing needs

Work closely with cross-functional teams to understand data requirements and ensure that data solutions align with business objectives

ETL Development:

Oversee the development of robust ETL processes to extract, transform, and load data from various sources into the data warehouse

Ensure data quality and integrity throughout the ETL process, implementing best practices for data cleansing and validation

Big Data Technologies:

Stay abreast of emerging trends and technologies in big data and analytics, and assess their applicability to the organization's data strategy

Implement and optimize big data technologies to process and analyze large datasets efficiently

Cloud Integration:

Collaborate with the IT infrastructure team to integrate data engineering solutions with cloud platforms, ensuring scalability, security, and performance

Performance Monitoring and Optimization:

Implement monitoring tools and processes to track the performance of data pipelines and proactively address any issues

Optimize data processing workflows for improved efficiency and resource utilization

Documentation:

Maintain comprehensive documentation for data engineering processes, data models, and system architecture

Ensure that team members follow documentation standards and best practices.

Collaboration and Communication:

Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and deliver solutions that meet those requirements

Communicate effectively with technical and non-technical stakeholders, providing updates on project status, challenges, and opportunities.

Qualifications:

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field

6-8 years of professional experience in data engineering

In-depth knowledge of data modeling, ETL processes, and data warehousing

In-depth knowledge of building the data warehouse using Snowflake

Should have experience in data ingestion, data lakes, data mesh and data governance

Must have experience in Python programming

Strong understanding of big data technologies and frameworks, such as Hadoop, Spark, and Kafka

Experience with cloud platforms, such as AWS, Azure, or Google Cloud

Familiarity with database systems like SQL, NoSQL, and data pipeline orchestration tools

Excellent problem-solving and analytical skills

Strong communication and interpersonal skills

Proven ability to work collaboratively in a fast-paced, dynamic environment

Your answers to our culture fit questionnaire and understanding of GIST Impact’s mission and its importance will receive as much weightage in our application process as your CV/credentials.

If this sounds like you, we would like to hear from you!

Gistimpact

9 views

0 applied

Share this job

Copy Permalink

Discover similar jobs

GameChanger

Senior Applied Machine Learning Engineer

180k - 200k USD

Remote

Full Time

#Machine Learning

#Computer Vision

#Engineering

#Python

#PyTorch

#Docker

#AWS

#Distributed Systems

#Systems

#Performance Optimization

Sift

Software Engineer

Remote

Full Time

#Fraud Detection

#Infrastructure

#Platform Engineering

#Java

#Python

#Terraform

#Kubernetes

#GCP

#AWS

#Kafka

#Jenkins

#Docker

#Spark

Unqork

Senior Application Security Engineer

117k - 160k USD

Remote

Full Time

#Application Security

#Penetration Testing

#Security Engineering

#OWASP Top 10

#Node.Js

#Python

#Burp suite

#OWASP

#SAST

#DAST

#SCA

#Vulnerability Management

CoinsPaid

DevOps Engineer

Remote

Full Time

#DevOps

#Engineering

#Fintech

#Kubernetes

#Docker

#Helm

#Terraform

#AWS

#Linux

#Python

#Prometheus

Innovativesol-2

AI Data Architect

Remote

Full Time

#Cloud Architecture

#Data Engineering

#AI

#AWS

#Azure

#Python

#SQL

#Data Modeling

#ETL

#Big Data

#Machine Learning

Linus Health

Senior Product Manager, Connected Care

150k - 170k USD

Remote

Full Time

#Digital Health

#Product Management

#AI

#Integration

#FHIR

#Data

#Stakeholder Management

#Roadmap Planning

#Cross Functional Collaboration

Wikimedia Foundation

Data Science Manager

132k - 193k USD

Remote

Full Time

#Product Analytics

#Data Science

#Nonprofit

#Experimental Design

#Statistics

#Data Processing

#Hadoop

#Hive

#Presto

#Spark

#Data Storytelling

#Partnership

#People Management

Thirstysprout

Senior Fullstack Engineer

Remote

Part Time

#Shipping

#Engineering

#Vue.Js

#Django

#PostgreSQL

#Google Cloud

#Frontend Development

#API Integration

#Code Review

Zushealth

Director, Solutions & Forward Deployed Engineering

Remote

Full Time

#Solutions Engineering

#Healthcare

#Engineering

#FHIR

#HL7

#Integrations

#APIs

#Data Pipelines

#ETL

#Snowflake

#HIPAA

#AI Tools

#Automation

Cavnue

Senior Software Engineer

150k - 195k USD

Remote

Full Time

#Infrastructure

#Software Engineering

#Systems

#Python

#C++

#PostgreSQL

#Kubernetes

#Terraform

#Redis

#Data Pipelines

#REST APIs

#GCP

#Docker

TokyoTechie

Blockchain NFT Developer

Remote

Full Time

#Technology

#Blockchain

#Consulting

#NFT

#Ethereum

#Smart Contracts

#NodeJS

#Python

#Go

#Java

#AWS

#Distributed Systems

LetsGetChecked

Business Intelligence Analyst

91k - 114k USD

Remote

Full Time

#Business Intelligence

#Healthcare

#Analytics

#SQL

#Looker

#Python

#AWS RedShift

#Data Modeling

#Data Visualization

#AWS Glue

#Agile

#LookML

Creative Fabrica

AI Marketing Specialist

Remote

Full Time

#Marketing

#AI

#Automation

#Engineering

#Email Automation

#Content

#Salesforce

#HubSpot

#Workflow Automation

Sardine

Machine Learning Engineer

US, CA

Remote

Full Time

#Fraud Prevention

#Machine Learning

#Fintech

#Go

#Python

#PyTorch

#SQL

#Data Pipelines

#Deployment

#Kubernetes

#Docker

Dorbe Leit Consulting

Senior Full-Stack Software Engineer

Remote

Full Time

#Full Stack

#Software Engineering

#Mobility

#Python

#Django

#fastAPI

#React

#PostgreSQL

#TimeScaleDB

#ETL

#Docker

#Kubernetes

Doxy.me

Senior Web Engineer

Remote

Full Time

#Telehealth

#Engineering

#React

#Next.js

#TypeScript

#CSS

#Responsive Design

#Design Systems

#Storybook

#Figma

CoderPad

Director of Engineering

Remote

Full Time

#Engineering

#Technical Leadership

#Developer Tools

#Software Engineering

#People Management

#Technical Architecture

#Product Management

#AI Tools

#Reliability

#Distributed Teams

Addi

Backend Software Engineer

Remote

Full Time

#Backend Engineering

#Fintech

#Lending

#Java

#Kotlin

#Spring Boot

#PostgreSQL

#Redis

#Docker

#Kubernetes

#Kafka

#SQS

#Automated Testing

Prime Financial Technologies

ML Engineer

Remote

Full Time

#Data Science

#Machine Learning

#Fintech

#Python

#JavaScript

#AWS

#Databricks

#Spark

#PostgreSQL

#DynamoDB

#Flask

#React

Kayzen

DevOps Engineer

India

Remote

Full Time

#DevOps

#Infrastructure

#AdTech

#Shell Scripting

#Python

#Java

#SQL

#Terraform

#Ansible

#HAProxy

#Nginx

#Kubernetes

#Prometheus

Your dream job awaits.

Explore exciting opportunities, connect with top employers, and ignite your career.

Explore Jobs

Related Resources

Engineering Salary Guide

Compensation data for Engineering roles

Engineering Job Market

Hiring trends and demand for Engineering

Engineering Interview Prep

Practice questions for Engineering interviews

Data Analytics Salary Guide

Compensation data for Data Analytics roles

Data Analytics Job Market

Hiring trends and demand for Data Analytics

Data Analytics Interview Prep

Practice questions for Data Analytics interviews

Data Engineering Lead at Gistimpact