Lead Software Engineer
On-site
Full Time
#Engineering
#SQL
#Python
#Java
#AWS
#Apache Spark
With a core belief that advertising technology can measurably improve the lives of patients, DeepIntent is leading the healthcare advertising industry into the future. Built purposefully for the healthcare industry, the DeepIntent Healthcare Advertising Platform is proven to drive higher audience quality and script performance with patented technology and the industry’s most comprehensive health data. DeepIntent is trusted by 600+ pharmaceutical brands and all the leading healthcare agencies to reach the most relevant healthcare provider and patient audiences across all channels and devices. For more information, visit DeepIntent.com or find us on LinkedIn.
Who You Are:
- Experience:
- 5+ years of experience in data engineering or related roles, with at least 2 years in a leadership or senior technical position.
- Extensive experience with data warehousing, ETL pipelines, data modeling, and data architecture.
- Strong experience working with large-scale data processing frameworks (e.g., Hadoop, Apache Spark, Kafka).
- Technical Skills:
- Proficient in SQL, Python, Java, or other relevant programming languages.
- Hands-on experience with cloud-based platforms (AWS, GCP, Azure).
- Familiarity with data orchestration tools like Apache Airflow or similar.
- Strong knowledge of databases (SQL and NoSQL) and data storage technologies.
- Education:
- Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or a related field (or equivalent work experience).
- Soft Skills:
- Excellent problem-solving and analytical skills.
- Strong communication and interpersonal skills, with the ability to work effectively with both technical and non-technical teams.
- Ability to manage multiple priorities in a fast-paced, dynamic environment.
What You’ll Do:
In this role, you will take the lead in designing, building, and optimizing data pipelines, ensuring high-quality data integration and real-time analytics. As a lead, you will mentor and guide a team of data engineers, collaborate with cross-functional teams, and drive best practices for data architecture and engineering.
- Leadership & Mentorship:
- Lead and mentor a team of engineers, ensuring technical excellence and continuous improvement.
- Provide guidance on complex technical issues, and foster a culture of collaboration and innovation.
- Develop and maintain data engineering processes, practices, and standards across the team.
- Data Architecture & Engineering:
- Design and develop robust, scalable, and efficient data pipelines for ETL (Extract, Transform, Load) processes.
- Architect data solutions and ensure seamless integration of data from diverse sources, both on-premise and in the cloud.
- Optimize data storage, retrieval, and processing for performance and scalability.
- Collaboration & Stakeholder Management:
- Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
- Collaborate with the software engineering team to ensure smooth integration of data pipelines into applications.
- Data Quality & Governance:
- Ensure data integrity, quality, and consistency across systems.
- Implement and enforce data governance policies and best practices, ensuring compliance with data privacy regulations.
- Continuous Improvement:
- Stay updated with the latest trends in data engineering, big data technologies, and cloud platforms.
- Drive automation, testing, and optimisation within data pipelines to improve overall efficiency.
- Technology Stack:
- Lead the selection and implementation of appropriate technologies for data storage, processing, and retrieval (e.g., Hadoop, Spark, Kafka, Airflow).
- Experience working with public clouds like GCP/AWS.
- Proficient with SQL, Java, Spring boot, Python or at least one Object oriented language, Bash.
- Experience with any of Apache open source projects such as Spark, Druid, Beam, Airflow etc. and big data databases like BigQuery, Clickhouse, etc
DeepIntent is committed to bringing together individuals from different backgrounds and perspectives. We strive to create an inclusive environment where everyone can thrive, feel a sense of belonging, and do great work together.
DeepIntent is an Equal Opportunity Employer, providing equal employment and advancement opportunities to all individuals. We recruit, hire and promote into all job levels the most qualified applicants without regard to race, color, creed, national origin, religion, sex (including pregnancy, childbirth and related medical conditions), parental status, age, disability, genetic information, citizenship status, veteran status, gender identity or expression, transgender status, sexual orientation, marital, family or partnership status, political affiliation or activities, military service, immigration status, or any other status protected under applicable federal, state and local laws. If you have a disability or special need that requires accommodation, please let us know in advance.
DeepIntent’s commitment to providing equal employment opportunities extends to all aspects of employment, including job assignment, compensation, discipline and access to benefits and training.
