Director of AI Model Evaluation & Quality Validation at Truveta

At Truveta, we are on a mission to save lives with data. As the world’s first health provider-led data platform, we empower clinicians and researchers to find cures faster and help families make informed care decisions. We are looking for a visionary leader to help us push the boundaries of what is possible in healthcare through advanced AI.

Role at a glance

We are seeking a Director of AI Model Evaluation & Quality Validation to join our team on a full-time basis. This is an executive-level position that supports a hybrid work environment, allowing you to work from anywhere in the country. While we operate with flexibility, we do require in-person attendance for one week each year for our planning sessions.

Your impact

• Lead the evaluation of our AI models that leverage Large Language Models to ensure they meet rigorous performance and accuracy standards.
• Develop and implement sophisticated metrics to measure the efficiency and effectiveness of our models, providing actionable insights that drive product improvement.
• Collaborate cross-functionally with software engineers, data scientists, and clinical experts to refine models and ensure they deliver tangible value to our clients.

What you'll need

You should be an expert in machine learning with a passion for solving complex technical challenges in the healthcare space. We are looking for the following qualifications:

• A Master's or Ph.D. in Computer Science, Artificial Intelligence, or a related field.
• At least 7 years of experience in machine learning, with a deep focus on natural language processing and large language models.
• Strong programming proficiency in Python and hands-on experience with frameworks like TensorFlow or PyTorch.
• Excellent analytical and problem-solving skills, with the ability to translate complex technical concepts for non-technical stakeholders.
• Fluency in English.

Perks and compensation

The base pay for this position ranges from $230,000 to $260,000, depending on your location, skills, and experience. We also offer a comprehensive benefits package designed to support your well-being and professional growth:

• Comprehensive medical, dental, and vision insurance plans.
• 401k retirement plan.
• Flexible work hours and generous paid time off.
• Maternity and paternity leave.
• Dedicated professional development and training opportunities.