Director Machine Learning
260k - 330k USD
On-site
Full Time
#Engineering
#Architecture
#ML Infrastructure
#Kubernetes
#Communication
We are Together AI, a research-driven company working to make advanced AI systems more open, affordable, and powerful. Our team has helped create breakthroughs like FlashAttention and RedPajama, and we are now focused on building the world’s best cloud for generative AI.
What is this role?
This is a full-time, on-site Director of Machine Learning position based in the United States. We are looking for an experienced engineering leader ready to guide both technical direction and team growth at the director level.
What will you do?
- Partner with Research, Product, and GTM teams to turn new ideas into reliable, customer-facing services.
- Mentor engineers and shape a high-performing, multi-level organization.
- Work closely with SRE and Infrastructure teams to keep our ML API services running smoothly in production.
What makes you a great fit?
You bring a strong grasp of the latest LLM architectures, their practical uses, and the surrounding ecosystem. You have at least five years of experience designing and running large-scale ML infrastructure, and you are comfortable moving between hands-on technical work and leading layered teams. Clear, confident communication-both written and verbal-is essential, and prior hands-on experience with Kubernetes or open-source inference engines such as VLLM or SGLang is a plus. All work is conducted in English.
What's in it for you?
The US base salary range for this role is $260k–$330k, plus equity and a full benefits package that includes medical insurance and paid time off.
