Together AI
Director, Machine Learning
260k - 330k USD
On-site
Full Time
#Engineering
#Architecture
#ML Infrastructure
#Kubernetes
#Open Source
#Communication Skills
Together AI is looking for a Director, Machine Learning
Full TimeDirectorOn-siteUnited StatesEngineeringArchitectureML InfrastructureKubernetesOpen SourceCommunication SkillsEnglishEquity compensationMedical insurance
260k - 330k USD per year
We are Together AI, a research-driven company building the world’s best cloud for generative AI. Our mission is to lower the cost of modern AI systems through co-design of software, hardware, algorithms, and models, and our team has delivered breakthroughs such as FlashAttention, Hyena, FlexGen, and RedPajama. We are seeking a Director of Machine Learning to lead our ML engineering and operations teams and turn cutting-edge research into reliable, customer-facing services.
Responsibilities
- Partner with Research, Product, and GTM teams to convert new ideas into production services.
- Collaborate with SRE and Infrastructure teams to keep ML API services running smoothly.
- Mentor engineers and grow a high-performing, multi-level organization.
- Set technical direction while continuing to make direct technical contributions.
Must-haves
- 5+ years of experience building and operating large-scale ML infrastructure.
- Strong understanding of current LLM architectures, use cases, and ecosystem.
- Proven ability to scale from hands-on work to leading a layered engineering organization.
- Excellent verbal and written communication skills.
- Full professional proficiency in English.
Nice-to-haves
- Hands-on experience with Kubernetes.
- Familiarity with open-source inference engines such as vLLM or SGLang.
Benefits
The US base salary range for this full-time, on-site role is $260k–$330k.
- Equity compensation.
- Medical insurance.
Share this job
Copy Permalink
