Deep Learning Performance Engineer, Senior at Anyscale

Anyscale logo
Anyscale

Deep Learning Performance Engineer, Senior

us flag
United States

170k - 237k USD

On-site

Full Time

#Engineering

#AI

#Machine Learning

#CUDA

#Deep Learning

#PyTorch

#Systems

#Networking

#Ray

#TensorRT

Anyscale is looking for a Deep Learning Performance Engineer, Senior

Sign up to unlock quick summaries and profile fit assessments

About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAIUberSpotifyInstacartCruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
Anyscale is based in San Francisco, CA. Employees are required to come in office 3x a week.

About the role
As a Deep Learning Performance Engineer, you will help build systems and optimizations that push the boundaries of performance across cutting edge ML models. This is an incredibly critical role to Anyscale as it allows us to provide market leading performance and price point for AI infrastructure. 

As part of this role, you will
  • Iterate very quickly with product teams to ship the latest optimizations to Anyscale platform, Anyscale Endpoints, and various open source offerings.
  • Work closely with research teams on LLM engines like vLLM, TensorRT-LLM
  • Follow the latest state-of-the-art in the open source and the research community, implementing and extending best practices 


  • We'd love to hear from you if you have
  • Prior experience working on GPUs / CUDA 
  • Solid understanding of operating systems and/or networking fundamentals and experience in such optimizations
  • Familiarity with deep learning and deep learning frameworks (e.g. PyTorch)


  • Bonus points!
  • ML Systems knowledge
  • Experience training deep learning models
  • Contributions to deep learning frameworks (PyTorch, TensorFlow)
  • Contributions to deep learning compilers (Triton, TVM, MLIR)
  • Experience using Ray


  • Compensation
  • At Anyscale, we take a market-based approach to compensation. We are data-driven, transparent, and consistent. The target salary for this role is $170,112 ~ $237,000. As the market data changes over time, the target salary for this role may be adjusted.
  • This role is also eligible to participate in Anyscale's Equity and Benefits offerings, including the following:
  • Stock Options
  • Healthcare plans, with premiums covered by Anyscale at 99%
  • 401k Retirement Plan
  • Wellness stipend
  • Education stipend
  • Paid Parental Leave
  • Flexible Time Off
  • Commute reimbursement
  • 100% of in-office meals covered


  • Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. 
    Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
    Anyscale logo

    Anyscale

    2 views

    0 applied

    Social Media

    Visit Anyscale
    Share this job
    Copy Permalink
    Open roles at Anyscale
    Anyscale logo
    Anyscale

    Developer Content Engineer

    us flag
    United States

    Hybrid

    Full Time

    #Engineering

    #Machine Learning

    #Deep Learning

    #Python

    #MLOps

    #DevOps

    Anyscale logo
    Anyscale

    Distributed LLM Inference Engineer

    us flag
    United States

    170k - 247k USD

    On-site

    Full Time

    #Engineering

    #Deep Learning

    #Distributed Systems

    #PyTorch

    #Data

    Anyscale logo
    Anyscale

    Deep Learning Performance Engineer

    us flag
    United States

    170k - 237k USD

    On-site

    Full Time

    #Engineering

    #Machine Learning

    #Artificial Intelligence

    #CUDA

    #Deep Learning

    #PyTorch

    #Systems

    #Networking

    #TensorFlow

    #Learning

    #Ray

    Anyscale logo
    Anyscale

    Deep Learning Performance Engineer

    us flag
    United States

    170k - 237k USD

    On-site

    Full Time

    #Engineering

    #AI

    #Machine Learning

    #CUDA

    #Systems

    #Networking

    #Deep Learning

    #PyTorch

    #Learning

    #Ray

    #TensorRT

    Discover similar jobs
    Blockdeliver logo
    Blockdeliver

    Senior Software Engineer

    Remote

    Full Time

    #Engineering

    #Distributed Systems

    #Networking

    #Smart Contracts

    #Backend Development

    #Unix

    #Cryptoeconomics

    #Mechanism Design

    Makersitegmbh logo
    Makersitegmbh

    Senior Data Scientist

    Remote

    Full Time

    #Engineering

    #Sustainability

    #Python

    #fastAPI

    #LLM

    #Databases

    #Docker

    #Kubernetes

    #MLOps

    C
    Conduit

    Senior Software Engineer

    Remote

    Full Time

    #Engineering

    #Blockchain

    #Golang

    #Kubernetes

    #GCP

    #AWS

    #Rust

    #Solidity

    #Distributed Systems

    #Cryptography

    #Network Protocols

    #Postgres

    Cryptio logo
    Cryptio

    Senior Typescript Engineer

    Remote

    Full Time

    #Engineering

    #Fintech

    #Blockchain

    #TypeScript

    #Node.Js

    #NestJS

    #PostgreSQL

    #AWS

    #Kubernetes

    #Docker

    #Redis

    #Pulumi

    #Gitlab

    P
    Parafin

    Staff Software Engineer, Lending Products

    285k - 330k USD

    Remote

    Full Time

    #Engineering

    #Fintech

    #Lending

    #Backend Engineering

    #Platform Development

    #Architecture

    #Cross Functional Collaboration

    #Mentoring

    #Infrastructure Design

    #Code Review

    #Reliability

    F
    Found

    Staff Software Engineer, Platform

    210k - 278k USD

    Remote

    Full Time

    #Engineering

    #Backend

    #Public Cloud

    #Observability

    #Monitoring

    #Incident Response

    #Tech

    #OpenTelemetry

    #Prometheus

    #Infrastructure as Code

    #Terraform

    L
    LeanData

    GTM Engineer (Data & AI)

    Remote

    Full Time

    #Sales

    #Revenue Operations

    #Data Engineering

    #AI

    #Workflow Automation

    #Data Warehousing

    #API Integration

    #Orchestration

    U
    UNION

    Sales Engineer

    Remote

    Full Time

    #Sales

    #Infrastructure

    #Machine Learning

    #Data Processing

    #MLOps

    #PyTorch

    #TensorFlow

    #Spark

    #Flink

    #AWS

    #GCP

    #Azure

    #Terraform

    #Docker

    #Kubernetes

    Emi Labs logo
    Emi Labs

    Back-end Engineer

    ar flag
    Argentina

    Remote

    Full Time

    #Backend Engineering

    #AI Tools

    #Systems

    #Node.Js

    #Backend Development

    #Architecture

    #AI

    #LLM

    #Testing

    #Monitoring

    #Workflow Automation

    Planner 5D logo
    Planner 5D

    AI Moderator

    Remote

    Contractor

    #Product

    #Support

    #AI

    #Attention To Detail

    #Research

    #English

    PelotonInc logo
    PelotonInc

    Senior Software Engineer

    Remote

    Full Time

    #Engineering

    #Full Stack

    #DevOps

    #Docker

    #Kubernetes

    #AWS

    #GCP

    #Azure

    #Flux

    #Rancher

    #Continuous Delivery

    #Infrastructure

    #Microservices

    I
    Ivanti

    Associate Site Reliability Engineer

    Remote

    Full Time

    #Site Reliability

    #Cloud Operations

    #DevOps

    #Linux

    #Windows

    #Networking

    #Kubernetes

    #Docker

    #Python

    #Java

    #AWS

    #Azure

    #Ansible

    H
    HeyJobs

    Graphic Design Creative Technology

    Remote

    Part Time

    #Technology

    #AI Tools

    #Digital Marketing

    #Engineering

    #JavaScript

    #Python

    #Landing Pages

    #Content

    I
    Inspiren

    Director of Product Management

    230k - 270k USD

    Remote

    Full Time

    #Product Management

    #Health Tech

    #AI

    #Hardware

    #Machine Learning

    #Product Strategy

    #Collaboration

    #Data Analysis

    #Discovery

    N
    Niche

    Senior Designer, Design Systems

    ar flag
    AR, BR

    Remote

    Full Time

    #Design Systems

    #Product Design

    #Figma

    #Design

    #Storybook

    #AI

    #Accessibility

    #Responsive Design

    T
    Teach For All

    Head of AI Solutions & Engineering

    Remote

    Contractor

    #AI

    #Education

    #Technology

    #TypeScript

    #Python

    #REST APIs

    #Git

    #Design

    #Google Cloud

    #Business Analysis

    InterNations logo
    InterNations

    Online Marketing Intern

    Remote

    Internship

    #Technology

    #SEO

    #Online Marketing

    #YouTube

    #Google Analytics

    #WordPress

    #AI

    Q
    Quora

    Staff Machine Learning Engineer

    220k - 321k USD

    Remote

    Full Time

    #Machine Learning

    #Recommendation Systems

    #Engineering

    #Python

    #C++

    #Data Pipelines

    #Model Training

    #Algorithms

    Civis Analytics logo
    Civis Analytics

    Chief Technology Officer

    225k - 325k USD

    Remote

    Full Time

    #AI

    #Data Platform

    #Technical Leadership

    #AI Systems

    #Data Engineering

    #Cloud Platforms

    #Distributed Systems

    #Technical Architecture

    #Team Leadership

    #Product

    Palantir logo
    Palantir

    Tech Fellowship - Frontier

    Remote

    Other

    #AI

    #Data Analysis

    #Foundry

    #AI Tools

    #Workflow Automation

    #Problem Solving

    #Communication

    Your dream job awaits.

    Explore exciting opportunities, connect with top employers, and ignite your career.