AI Software Development Engineer in Test at Resilinc

At Resilinc, we are redefining the future of supply chain intelligence through the power of agentic AI. As a recognized leader in the 2025 Gartner Magic Quadrant for Supply Chain Risk Management, we provide global enterprises in sectors like aerospace, life sciences, and high tech with the tools to predict disruptions and take real-time action. Our success is built upon the industry's largest supplier-validated data lake, which we have cultivated over 15 years to ensure multi-tier visibility and adaptive compliance. We are a fully remote, mission-driven team, and we are looking for a senior AI Software Development Engineer in Test to help us ensure our autonomous systems remain reliable, fair, and transparent.

What you'll be doing

• Develop and implement comprehensive QA strategies for AI-powered applications, with a specific focus on accuracy, robustness, and performance.
• Design and execute automated test frameworks using tools like Selenium and Playwright to validate AI agents, APIs, and complex data pipelines.
• Assess AI models for bias, fairness, and adversarial robustness while conducting performance testing to monitor latency and scalability.

What you'll bring

To thrive in this role, you should possess a strong background in both software engineering and quality assurance. We are looking for the following qualifications:

• Proven expertise in testing Large Language Models and Generative AI applications, including familiarity with AI evaluation metrics.
• Strong proficiency in Python for writing test scripts and automating model validation processes.
• Advanced SQL skills for validating data integrity and backend processes within databases like PostgreSQL and MySQL.
• Excellent analytical skills and the ability to communicate complex testing results to cross-functional teams.
• Fluency in English to collaborate effectively within our global, remote environment.

What you'll get

We are committed to supporting our team members through a comprehensive benefits package designed to provide security and professional growth. While specific offerings vary by your location, you will have access to the following:

• Medical insurance to support your health and well-being.
• 401k retirement planning options.
• Paid time off to ensure you have a healthy work-life balance.
• A dedicated learning budget to help you stay at the forefront of your field.
• The flexibility of a fully remote work environment.