AI Software Development Engineer in Test at Resilinc

Resilinc logo
Resilinc

AI Software Development Engineer in Test

Remote

Full Time

#Supply Chain

#Artificial Intelligence

#Engineering

#AI

#Python

#SQL

#Selenium

#Playwright

#Testing

#Performance Testing

#Data Validation

Resilinc is looking for a AI Software Development Engineer in Test

Sign up to unlock quick summaries and profile fit assessments

Join the Future of Supply Chain Intelligence — Powered by Agentic AI 
At Resilinc, we’re not just solving supply chain problems — we’re pioneering the intelligent, autonomous systems that will define its future. Our cutting-edge Agentic AI enables global enterprises to predict disruptions, assess impact instantly, and take real-time action — before operations are even touched. Recognized as a Leader in the 2025 Gartner® Magic Quadrant™ for Supply Chain Risk Management, we are trusted by marquee clients across life sciences, aerospace, high tech, and automotive to protect what matters most — from factory floors to patient care. 
Our advantage isn’t just technology — it’s the largest supplier-validated data lake in the industry, built over 15 years and constantly enriched by our global intelligence network. It’s how we deliver multi-tier visibility, real-time risk assessment, and adaptive compliance at scale. 
But the real power behind Resilinc? Our people. We’re a fully remote, mission-driven global team, united by one goal: ensuring vital products reach the people who need them — when and where they need them. 
Whether it’s helping ensure cancer treatments arrive on time or flagging geopolitical risks before they disrupt critical supply lines, you’ll see your impact every day. If you're passionate about building technology that matters, driven by purpose, and being an agent of change who is ready to shape the next era of self-healing supply chains, we’d love to meet you. 
Resilinc | Innovation with Purpose. Intelligence with Impact. 

About The Role
At Resilinc, we build intelligent systems that safeguard the global supply chain. As a pioneer in supply chain risk management, we’re pushing the boundaries of resilience with AI-powered platforms. We are building a team of forward-thinking Agent Hackers (AI SDETs) to join our mission.
What’s an Agent Hacker? It’s not just a title — it’s a mindset. You’re the kind of engineer who goes beyond traditional QA, probing the limits of autonomous agents, reverse-engineering their behavior, and designing smart, self-evolving test frameworks.
In this role, you’ll be at the forefront of testing cutting-edge technologies, including Large Language Models (LLMs), AI agents, and Generative AI systems. You’ll play a critical role in validating the performance, reliability, fairness, and transparency of AI-powered applications—ensuring they meet high standards for both quality and responsible use.
If you think like a tester, code like a developer, and break systems like a hacker — Resilinc is your proving ground.

What You Will Do
  • Develop and implement QA strategies for AI-powered applications, focusing on accuracy, bias, fairness, robustness, and performance. 
  • Design and execute automated and manual test cases to validate AI Agents/LLM models, APIs, and data pipelines and good understanding of data integrity, data models, etc 
  • Assess AI models using quality metrics such as precision/recall, and hallucination detection. 
  • Test AI models for bias, fairness, explainability (XAI), drift, and adversarial robustness. 
  • Validate prompt engineering, fine-tuning techniques, and model-generated responses for accuracy and ethical AI considerations. 
  • Service/tool development.
  • Conduct scalability, latency, and performance testing for AI-driven applications. 
  • Collaborate with data engineers to validate data pipelines, feature engineering processes, and model outputs. 
  • Design, develop, and maintain automation scripts using Selenium and Playwright for API and web testing 
  • Work closely with cross-functional teams to integrate automation best practices into the development lifecycle.
  • Identify, document, and track bugs while conducting detailed regression testing to ensure product quality. 


  • What You Will Bring
  • Proven expertise in testing AI models, LLMs, and Generative AI applications, with hands-on experience in AI evaluation metrics and testing tools like Arize, MAIHEM, and LangTest. 
  • Strong proficiency in Python for writing test scripts and automating model validation, along with a deep understanding of AI bias detection, adversarial testing, model explainability (XAI), and AI robustness. 
  • Demonstrate strong SQL expertise for validating data integrity and backend processes, particularly in PostgreSQL and MySQL. 
  • Strong analytical and problem-solving skills with keen attention to detail, along with excellent communication and documentation abilities to convey complex testing processes and results. 


  • If you are a person with a disability needing assistance with the application process please contact [email protected].
    Benefits
    We offer comprehensive benefits that are specific to each country. Your talent acquisition contact can provide you with a FAQ list for your country. Everyone at Resilinc is eligible for healthcare coverage, retirement benefits, paid time off and learning and development opportunities.  
      
    To learn more about Resilinc, visit our website:  
     
            
    Resilinc logo

    Resilinc

    7 views

    0 applied

    Social Media

    Visit Resilinc
    Share this job
    Copy Permalink
    Open roles at Resilinc
    Resilinc logo
    Resilinc

    Director Senior Manager Engineering

    Remote

    Full Time

    #Engineering

    #Engineering Leadership

    #Python

    #Cloud Platforms

    #Microservices Architecture

    #Data Engineering

    #AI

    #Enterprise Software

    #Agile Methodologies

    #Kubernetes

    Resilinc logo
    Resilinc

    Lead Senior FullStack Engineer

    Remote

    Full Time

    #Engineering

    #Java

    #Python

    #Angular

    #API Design

    #Azure

    #DevOps

    #CI CD

    #Machine Learning

    #Microservices

    Resilinc logo
    Resilinc

    QA AI Testing and Automation Engineer

    Remote

    Full Time

    #Engineering

    #AI

    #Automation

    #Python

    #SQL

    #Selenium

    #Playwright

    #Testing

    Resilinc logo
    Resilinc

    Senior Manager - Product Marketing

    Remote

    Full Time

    #Marketing

    #SaaS

    #Supply Chain

    #Product Marketing

    #Market Analysis

    #Sales Enablement

    #Go To Market Strategy

    #Content Strategy

    Resilinc logo
    Resilinc

    Senior DevOps Engineer

    Remote

    Full Time

    #Engineering

    #Terraform

    #Azure Cloud

    #GitHub Actions

    #Infrastructure as Code

    Discover similar jobs
    Constructive Dialogue Institute logo
    Constructive Dialogue Institute

    Senior Data Scientist

    us flag
    United States

    135k - 145k USD

    Remote

    Full Time

    #Data Science

    #Analytics Engineering

    #Nonprofit

    #SQL

    #Python

    #Data Pipelines

    #AWS

    #Dashboards

    #Git

    #Data Quality

    #BI Tools

    S
    Solo.io, Inc.

    RevOps Engineer

    Remote

    Full Time

    #Revenue Operations

    #Data Engineering

    #Analytics

    #SQL

    #DBT

    #Data Pipelines

    #Salesforce

    #BigQuery

    #Fivetran

    #Airbyte

    #Marketo

    #API Testing

    Allata logo
    Allata

    Ascend Program - Data

    Remote

    Full Time

    #Data

    #Data Engineering

    #Software Development

    #Data Analysis

    #AI

    #Agile

    #Jira

    #Git

    #Cloud Platforms

    Tebra logo
    Tebra

    Security Architect

    179k - 204k USD

    Remote

    Full Time

    #Security

    #Cloud Security

    #Healthcare

    #Cloudflare

    #GCP

    #Kubernetes

    #Terraform

    #Python

    #DevSecOps

    #Vertex AI

    #BigQuery

    #Helm

    #Workato

    S
    Sportalliance

    Senior Commercial & Pricing Analyst

    Remote

    Full Time

    #SaaS

    #Analytics

    #Pricing Strategy

    #Financial Modeling

    #SQL

    #AI Tools

    #Revenue Forecasting

    #Business

    #Spreadsheets

    #Scenario Modeling

    #Data Analysis

    S
    Snackpass

    Software Engineer, Fullstack

    Remote

    Full Time

    #Engineering

    #Payments

    #Analytics

    #Tooling

    #Mobile Apps

    #Scalable Systems

    OpenVPN logo
    OpenVPN

    AI Platform Engineer

    140k - 150k USD

    Remote

    Full Time

    #AI

    #DevOps

    #Cloud Infrastructure

    #Vertex AI

    #Terraform

    #GCP

    #Compliance

    #ISO 27001

    #Pipelines

    #Kubernetes

    U
    Union

    Sales Engineer

    Remote

    Full Time

    #AI

    #Sales

    #Machine Learning

    #MLOps

    #PyTorch

    #TensorFlow

    #Spark

    #Kubernetes

    #Docker

    #AWS

    #Terraform

    #MEDDIC

    N
    NewPage Solutions Inc

    Python Developer

    Remote

    Contractor

    #Technology

    #Digital Health

    #Continuous Delivery

    #Python

    #AWS Lambda

    #AWS ECS

    #Automated Testing

    #Agile Methodologies

    #Terraform

    #Drupal

    #PHP

    #S3

    #DynamoDB

    D
    Deepgram

    Pre-Sales Solutions Engineer

    Remote

    Full Time

    #AI

    #Solutions Engineering

    #Python

    #JavaScript

    #API Integration

    #Speech Recognition

    #NLP

    #Cloud Platforms

    #Docker

    #Kubernetes

    #Sales Methodologies

    U
    Unit4

    Senior Cloud Infrastructure Engineer

    pl flag
    Poland

    Remote

    Full Time

    #Cloud Infrastructure

    #Engineering

    #Microsoft Azure

    #Infrastructure Engineering

    L
    Lightdash

    Head of Engineering

    Remote

    Full Time

    #Engineering Leadership

    #AI

    #Developer Experience

    #TypeScript

    #React

    #Node.Js

    #SQL

    #Docker

    #Kubernetes

    #GCP

    #Architecture

    #Security

    saas.group logo
    saas.group

    Applied Research Scientist

    Remote

    Full Time

    #AI

    #Research

    #SQL

    #Python

    #Data Analysis

    #Experiment Design

    #Data Pipelines

    #Validation

    #AI Tools

    #Research Methodology

    P
    Pinecone

    Staff/Principal Product Manager, Database

    Remote

    Full Time

    #Product Management

    #AI

    #Database

    #SaaS Products

    #Cloud Infrastructure

    #Data Analysis

    #User Research

    #Roadmap Planning

    #Collaboration

    #Technical Products

    Dataiku logo
    Dataiku

    Fullstack Software Engineer

    Remote

    Full Time

    #Engineering

    #AI

    #Solutions

    #Vue.Js

    #React

    #Angular

    #Python

    #fastAPI

    #Flask

    #RESTful API

    #Data

    A
    Ankorstore

    Lead Data Platform

    Remote

    Full Time

    #Data Engineering

    #Platform

    #Data Platform

    #SQL

    #Python

    #BigQuery

    #Airflow

    #DBT

    #Sigma

    #Amplitude

    #Terraform

    #Product Analytics

    C
    Clyro

    Technical Product Marketer Content Growth

    Remote

    Full Time

    #AI

    #Content Marketing

    #Growth

    #SEO Optimization

    #Content Editing

    #Editorial

    #Keyword Research

    #Management

    #Social Media

    #LinkedIn

    #Twitter

    #Ahrefs

    E
    Eight Sleep

    Senior Backend Engineer

    Remote

    Full Time

    #Software Engineering

    #Distributed Systems

    #Java

    #Kotlin

    #Scala

    #C#

    #Python

    #NodeJS

    #TypeScript

    #Cloud Services

    S
    Savant Systems

    Technical Sales Manager

    us flag
    United States

    Remote

    Full Time

    #Technical Sales

    #Sales Support

    #System Design

    #Support

    #Product Training

    #Technical Support

    #Testing

    #Events

    H
    HTTPie

    Senior Fullstack Engineer

    Remote

    Full Time

    #Developer Tools

    #Engineering

    #API Testing

    #TypeScript

    #React

    #Next.js

    #TailwindCSS

    #Python

    #Django

    #AWS

    #Terraform

    #WebSocket

    #Electron

    Your dream job awaits.

    Explore exciting opportunities, connect with top employers, and ignite your career.