Data Engineer at Vividly

Who We Are

Vividly is the leading modern trade promotion management (TPM) solution built by and for the consumer packaged goods industry. From campaign creation to deductions management and promotion measurement, we help brands manage every element of trade spend. With our easy-to-use platform and industry-leading experience, we pride ourselves on our ability to bring businesses to the next level.

Not familiar with trade promotion spend?  That’s OK.  Most people aren’t.  It’s a $8 trillion dollar problem that is ripe for disruption by an innovative SaaS startup.  In order to grow, consumer packaged goods (CPG) brands spend 20% of their topline revenue to get into retailers and promote their products within those retailers.  The problem is that today 70% of those promotions are not ROI positive.  This is because ROI is hard to track.  The industry operates on emails, pdfs, and excel spreadsheets, and other sources of unstructured data. At Vividly, we’re solving this massive problem using state of the art machine learning and AI methods to process this unstructured data and drive value for everyone in the chain, from brands to retailers to end consumers. Some of our customers include brands you may use and love - Liquid Death, Amy’s, and Laird Superfoods.

You Are

As a Data Engineer at Vividly, you will be responsible for designing, building, and maintaining the data infrastructure and pipelines that power our platform. You thrive on solving complex data challenges, ensuring that our systems are scalable, reliable, and efficient. You understand how to structure data to support analytics, reporting, and product development, working closely with software engineers, product managers, and business stakeholders to provide high-quality, actionable data. You’re passionate about data modeling, performance optimization, and automation, and you take pride in building robust ETL/ELT pipelines that support both real-time and batch processing needs.

What You Will Do

• Design and develop scalable data pipelines to collect, process, and store large volumes of structured and unstructured data.
• Optimize and maintain data infrastructure, ensuring reliability, efficiency, and cost-effectiveness.
• Develop end to end machine learning workflows.
• Work closely with product, engineering, and business teams to understand data needs and translate them into technical solutions.
• Implement and enforce data governance best practices, including security, privacy, and compliance.
• Develop and maintain data models that support analytics, reporting, and machine learning initiatives.
• Monitor and troubleshoot data pipelines, proactively identifying and resolving performance bottlenecks.
• Drive architectural decisions related to data storage, processing frameworks, and orchestration tools.
• Ensure high data quality through validation, testing, and monitoring strategies.
• Continuously evaluate and introduce new technologies to improve our data platform’s scalability and performance.

What We Look For

• 5+ years of experience as a Data Engineer or in a similar role, designing, building, and maintaining scalable data infrastructure and pipelines.
• Experience with our tech stack (GCP, Python, SQL, dbt, Airflow, BigQuery, Terraform) or a similar modern data stack.
• Experience with machine learning libraries such as scikit-learn, tensorflow, keras, and pytorch.
• Experience with BI tools such as Looker or Sigma.
• Proficiency in SQL and data modeling to support analytical and operational use cases.
• Experience with ETL/ELT pipelines, data orchestration frameworks (e.g., Airflow, Dagster), and data warehousing solutions (e.g., BigQuery, Snowflake, Redshift).
• Familiarity with event-driven architectures and real-time data processing frameworks (e.g., Kafka, Pub/Sub, Flink).
• Strong analytical and problem-solving skills, with the ability to debug complex data issues and optimize data pipelines for performance and cost efficiency.
• Knowledge of data governance best practices, including security, privacy, compliance, data quality management, AI modeling, and data infrastructure.
• Experience working cross-functionally with product, engineering, and business teams to deliver data-driven solutions.
• Excellent communication and documentation skills, ensuring that data infrastructure and processes are well understood across teams.
• A strong sense of ownership and initiative, with the ability to work autonomously and drive projects forward in a fast-paced environment

Additional Info

• • 100% Remote position - Open to anywhere in Colombia so long as you have internet
  • Salary and equity - We base our salary bands off of current market data to ensure you’re getting compensated fairly