Resilinc

AI Software Development Engineer in Test

Remote

Full Time

#Supply Chain

#Artificial Intelligence

#Engineering

#AI

#Python

#SQL

#Selenium

#Playwright

#Testing

#Performance Testing

#Data Validation

Resilinc is looking for a AI Software Development Engineer in Test

Full Time Senior Remote Supply Chain Artificial Intelligence Engineering AI Python SQL Selenium Playwright Testing Performance Testing Data Validation English Remote work Medical insurance 401k Paid time off Learning budget

Join the Future of Supply Chain Intelligence — Powered by Agentic AI

At Resilinc, we’re not just solving supply chain problems — we’re pioneering the intelligent, autonomous systems that will define its future. Our cutting-edge Agentic AI enables global enterprises to predict disruptions, assess impact instantly, and take real-time action — before operations are even touched. Recognized as a Leader in the 2025 Gartner® Magic Quadrant™ for Supply Chain Risk Management, we are trusted by marquee clients across life sciences, aerospace, high tech, and automotive to protect what matters most — from factory floors to patient care.

Our advantage isn’t just technology — it’s the largest supplier-validated data lake in the industry, built over 15 years and constantly enriched by our global intelligence network. It’s how we deliver multi-tier visibility, real-time risk assessment, and adaptive compliance at scale.

But the real power behind Resilinc? Our people. We’re a fully remote, mission-driven global team, united by one goal: ensuring vital products reach the people who need them — when and where they need them.

Whether it’s helping ensure cancer treatments arrive on time or flagging geopolitical risks before they disrupt critical supply lines, you’ll see your impact every day. If you're passionate about building technology that matters, driven by purpose, and being an agent of change who is ready to shape the next era of self-healing supply chains, we’d love to meet you.

Resilinc | Innovation with Purpose. Intelligence with Impact.

About The Role

At Resilinc, we build intelligent systems that safeguard the global supply chain. As a pioneer in supply chain risk management, we’re pushing the boundaries of resilience with AI-powered platforms. We are building a team of forward-thinking Agent Hackers (AI SDETs) to join our mission.

What’s an Agent Hacker? It’s not just a title — it’s a mindset. You’re the kind of engineer who goes beyond traditional QA, probing the limits of autonomous agents, reverse-engineering their behavior, and designing smart, self-evolving test frameworks.

In this role, you’ll be at the forefront of testing cutting-edge technologies, including Large Language Models (LLMs), AI agents, and Generative AI systems. You’ll play a critical role in validating the performance, reliability, fairness, and transparency of AI-powered applications—ensuring they meet high standards for both quality and responsible use.

If you think like a tester, code like a developer, and break systems like a hacker — Resilinc is your proving ground.

What You Will Do

Develop and implement QA strategies for AI-powered applications, focusing on accuracy, bias, fairness, robustness, and performance.

Design and execute automated and manual test cases to validate AI Agents/LLM models, APIs, and data pipelines and good understanding of data integrity, data models, etc

Assess AI models using quality metrics such as precision/recall, and hallucination detection.

Test AI models for bias, fairness, explainability (XAI), drift, and adversarial robustness.

Validate prompt engineering, fine-tuning techniques, and model-generated responses for accuracy and ethical AI considerations.

Service/tool development.

Conduct scalability, latency, and performance testing for AI-driven applications.

Collaborate with data engineers to validate data pipelines, feature engineering processes, and model outputs.

Design, develop, and maintain automation scripts using Selenium and Playwright for API and web testing

Work closely with cross-functional teams to integrate automation best practices into the development lifecycle.

Identify, document, and track bugs while conducting detailed regression testing to ensure product quality.

What You Will Bring

Proven expertise in testing AI models, LLMs, and Generative AI applications, with hands-on experience in AI evaluation metrics and testing tools like Arize, MAIHEM, and LangTest.

Strong proficiency in Python for writing test scripts and automating model validation, along with a deep understanding of AI bias detection, adversarial testing, model explainability (XAI), and AI robustness.

Demonstrate strong SQL expertise for validating data integrity and backend processes, particularly in PostgreSQL and MySQL.

Strong analytical and problem-solving skills with keen attention to detail, along with excellent communication and documentation abilities to convey complex testing processes and results.

If you are a person with a disability needing assistance with the application process please contact [email protected].

Benefits

We offer comprehensive benefits that are specific to each country. Your talent acquisition contact can provide you with a FAQ list for your country. Everyone at Resilinc is eligible for healthcare coverage, retirement benefits, paid time off and learning and development opportunities.

To learn more about Resilinc, visit our website:

Resilinc End-to-End Supply Chain Risk Management Solutions - Resilinc

Resilinc

7 views

0 applied

Social Media

Visit Resilinc

Share this job

Copy Permalink

Open roles at Resilinc

Resilinc

Director Senior Manager Engineering

Remote

Full Time

#Engineering

#Engineering Leadership

#Python

#Cloud Platforms

#Microservices Architecture

#Data Engineering

#AI

#Enterprise Software

#Agile Methodologies

#Kubernetes

Resilinc

Lead Senior FullStack Engineer

Remote

Full Time

#Engineering

#Java

#Python

#Angular

#API Design

#Azure

#DevOps

#CI CD

#Machine Learning

#Microservices

Resilinc

QA AI Testing and Automation Engineer

Remote

Full Time

#Engineering

#AI

#Automation

#Python

#SQL

#Selenium

#Playwright

#Testing

Resilinc

Senior Manager - Product Marketing

Remote

Full Time

#Marketing

#SaaS

#Supply Chain

#Product Marketing

#Market Analysis

#Sales Enablement

#Go To Market Strategy

#Content Strategy

Resilinc

Senior DevOps Engineer

Remote

Full Time

#Engineering

#Terraform

#Azure Cloud

#GitHub Actions

#Infrastructure as Code

Discover similar jobs

Constructive Dialogue Institute

Senior Data Scientist

United States

135k - 145k USD

Remote

Full Time

#Data Science

#Analytics Engineering

#Nonprofit

#SQL

#Python

#Data Pipelines

#AWS

#Dashboards

#Git

#Data Quality

#BI Tools

Solo.io, Inc.

RevOps Engineer

Remote

Full Time

#Revenue Operations

#Data Engineering

#Analytics

#SQL

#DBT

#Data Pipelines

#Salesforce

#BigQuery

#Fivetran

#Airbyte

#Marketo

#API Testing

Allata

Ascend Program - Data

Remote

Full Time

#Data

#Data Engineering

#Software Development

#Data Analysis

#AI

#Agile

#Jira

#Git

#Cloud Platforms

Tebra

Security Architect

179k - 204k USD

Remote

Full Time

#Security

#Cloud Security

#Healthcare

#Cloudflare

#GCP

#Kubernetes

#Terraform

#Python

#DevSecOps

#Vertex AI

#BigQuery

#Helm

#Workato

Sportalliance

Senior Commercial & Pricing Analyst

Remote

Full Time

#SaaS

#Analytics

#Pricing Strategy

#Financial Modeling

#SQL

#AI Tools

#Revenue Forecasting

#Business

#Spreadsheets

#Scenario Modeling

#Data Analysis

Snackpass

Software Engineer, Fullstack

Remote

Full Time

#Engineering

#Payments

#Analytics

#Tooling

#Mobile Apps

#Scalable Systems

OpenVPN

AI Platform Engineer

140k - 150k USD

Remote

Full Time

#AI

#DevOps

#Cloud Infrastructure

#Vertex AI

#Terraform

#GCP

#Compliance

#ISO 27001

#Pipelines

#Kubernetes

Union

Sales Engineer

Remote

Full Time

#AI

#Sales

#Machine Learning

#MLOps

#PyTorch

#TensorFlow

#Spark

#Kubernetes

#Docker

#AWS

#Terraform

#MEDDIC

NewPage Solutions Inc

Python Developer

Remote

Contractor

#Technology

#Digital Health

#Continuous Delivery

#Python

#AWS Lambda

#AWS ECS

#Automated Testing

#Agile Methodologies

#Terraform

#Drupal

#PHP

#S3

#DynamoDB

Deepgram

Pre-Sales Solutions Engineer

Remote

Full Time

#AI

#Solutions Engineering

#Python

#JavaScript

#API Integration

#Speech Recognition

#NLP

#Cloud Platforms

#Docker

#Kubernetes

#Sales Methodologies

Unit4

Senior Cloud Infrastructure Engineer

Poland

Remote

Full Time

#Cloud Infrastructure

#Engineering

#Microsoft Azure

#Infrastructure Engineering

Lightdash

Head of Engineering

Remote

Full Time

#Engineering Leadership

#AI

#Developer Experience

#TypeScript

#React

#Node.Js

#SQL

#Docker

#Kubernetes

#GCP

#Architecture

#Security

saas.group

Applied Research Scientist

Remote

Full Time

#AI

#Research

#SQL

#Python

#Data Analysis

#Experiment Design

#Data Pipelines

#Validation

#AI Tools

#Research Methodology

Pinecone

Staff/Principal Product Manager, Database

Remote

Full Time

#Product Management

#AI

#Database

#SaaS Products

#Cloud Infrastructure

#Data Analysis

#User Research

#Roadmap Planning

#Collaboration

#Technical Products

Dataiku

Fullstack Software Engineer

Remote

Full Time

#Engineering

#AI

#Solutions

#Vue.Js

#React

#Angular

#Python

#fastAPI

#Flask

#RESTful API

#Data

Ankorstore

Lead Data Platform

Remote

Full Time

#Data Engineering

#Platform

#Data Platform

#SQL

#Python

#BigQuery

#Airflow

#DBT

#Sigma

#Amplitude

#Terraform

#Product Analytics

Clyro

Technical Product Marketer Content Growth

Remote

Full Time

#AI

#Content Marketing

#Growth

#SEO Optimization

#Content Editing

#Editorial

#Keyword Research

#Management

#Social Media

#LinkedIn

#Twitter

#Ahrefs

Eight Sleep

Senior Backend Engineer

Remote

Full Time

#Software Engineering

#Distributed Systems

#Java

#Kotlin

#Scala

#C#

#Python

#NodeJS

#TypeScript

#Cloud Services

Savant Systems

Technical Sales Manager

United States

Remote

Full Time

#Technical Sales

#Sales Support

#System Design

#Support

#Product Training

#Technical Support

#Testing

#Events

HTTPie

Senior Fullstack Engineer

Remote

Full Time

#Developer Tools

#Engineering

#API Testing

#TypeScript

#React

#Next.js

#TailwindCSS

#Python

#Django

#AWS

#Terraform

#WebSocket

#Electron

Your dream job awaits.

Explore exciting opportunities, connect with top employers, and ignite your career.

Explore Jobs

Related Resources

Engineering Salary Guide

Compensation data for Engineering roles

Engineering Job Market

Hiring trends and demand for Engineering

AI Software Development Engineer in Test at Resilinc