Deep Learning Performance Engineer at Anyscale

Anyscale logo
Anyscale

Deep Learning Performance Engineer

us flag
United States

170k - 237k USD

On-site

Full Time

#Engineering

#Machine Learning

#Artificial Intelligence

#CUDA

#Deep Learning

#PyTorch

#Systems

#Networking

#TensorFlow

#Learning

#Ray

Anyscale is looking for a Deep Learning Performance Engineer

Sign up to unlock quick summaries and profile fit assessments

About Anyscale:
At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAIUberSpotifyInstacartCruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.
With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.
Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.
Anyscale is based in San Francisco, CA. Employees are required to come in office 3x a week.

About the role:
As a Deep Learning Performance Engineer, you will help build systems and optimizations that push the boundaries of performance across cutting edge ML models. This is an incredibly critical role to Anyscale as it allows us to provide market leading performance and price point for AI infrastructure. 

As part of this role, you will:
  • Iterate very quickly with product teams to ship the latest optimizations to Anyscale platform, Anyscale Endpoints, and various open source offerings.
  • Work closely with research teams on LLM engines like vLLM, TensorRT-LLM
  • Follow the latest state-of-the-art in the open source and the research community, implementing and extending best practices 


  • We'd love to hear from you if you have:
  • Prior experience working on GPUs / CUDA 
  • Solid understanding of operating systems and/or networking fundamentals and experience in such optimizations
  • Familiarity with deep learning and deep learning frameworks (e.g. PyTorch)


  • Bonus points!
  • ML Systems knowledge
  • Experience training deep learning models
  • Contributions to deep learning frameworks (PyTorch, TensorFlow)
  • Contributions to deep learning compilers (Triton, TVM, MLIR)
  • Experience using Ray


  • Compensation
  • At Anyscale, we take a market-based approach to compensation. We are data-driven, transparent, and consistent. The target salary for this role is $170,112 ~ $237,000. As the market data changes over time, the target salary for this role may be adjusted.
  • This role is also eligible to participate in Anyscale's Equity and Benefits offerings, including the following:
  • Stock Options
  • Healthcare plans, with premiums covered by Anyscale at 99%
  • 401k Retirement Plan
  • Wellness stipend
  • Education stipend
  • Paid Parental Leave
  • Flexible Time Off
  • Commute reimbursement
  • 100% of in-office meals covered


  • Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. 
    Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
    Anyscale logo

    Anyscale

    5 views

    0 applied

    Social Media

    Visit Anyscale
    Share this job
    Copy Permalink
    Open roles at Anyscale
    Anyscale logo
    Anyscale

    Distributed LLM Inference Engineer

    us flag
    United States

    170k - 247k USD

    On-site

    Full Time

    #Engineering

    #Deep Learning

    #Distributed Systems

    #PyTorch

    #Data

    Anyscale logo
    Anyscale

    Deep Learning Performance Engineer, Senior

    us flag
    United States

    170k - 237k USD

    On-site

    Full Time

    #Engineering

    #AI

    #Machine Learning

    #CUDA

    #Deep Learning

    #PyTorch

    #Systems

    #Networking

    #Ray

    #TensorRT

    Anyscale logo
    Anyscale

    Deep Learning Performance Engineer

    us flag
    United States

    170k - 237k USD

    On-site

    Full Time

    #Engineering

    #Machine Learning

    #Artificial Intelligence

    #CUDA

    #Deep Learning

    #PyTorch

    #Systems

    #Networking

    #TensorFlow

    #Learning

    #Ray

    Anyscale logo
    Anyscale

    Deep Learning Performance Engineer

    us flag
    United States

    170k - 237k USD

    On-site

    Full Time

    #Engineering

    #AI

    #Machine Learning

    #CUDA

    #Systems

    #Networking

    #Deep Learning

    #PyTorch

    #Learning

    #Ray

    #TensorRT

    Discover similar jobs
    L
    Lightning Labs

    Assets Protocol Engineer

    Remote

    Full Time

    #Bitcoin

    #Cryptocurrency

    #Engineering

    #Go

    #Distributed Systems

    #Networks

    #Cryptography

    #Open Source

    Axle logo
    Axle

    AI Engineer II

    120k - 150k USD

    Remote

    Full Time

    #Data Science

    #AI Engineering

    #Python

    #Systems

    #Search

    #Kubernetes

    #PostgreSQL

    #Docker

    #Git

    Extreme Networks logo
    Extreme Networks

    Account Executive

    Remote

    Full Time

    #Sales

    #Networking

    #Cloud

    #B2B Sales

    #Security

    #MEDDIC

    #Account Management

    #Strategic Planning

    #Consultative Selling

    Sauce logo
    Sauce

    AI Operations Engineer

    Remote

    Full Time

    #Engineering

    #Operations

    #OpenAI

    #Node.Js

    #React

    #PostgreSQL

    #REST API

    #Cloud

    P
    Prolific

    Application Security Lead

    Remote

    Full Time

    #Application Security

    #Engineering

    #AI

    #OWASP Top 10

    #Code Review

    #Python

    #Burp suite

    #SSDLC

    #SAST

    #DAST

    #Vulnerability Management

    #ISO 27001

    S
    Snackpass

    Software Engineer, Fullstack

    Remote

    Full Time

    #Engineering

    #Payments

    #Analytics

    #Tooling

    #Mobile Apps

    #Scalable Systems

    U
    Union

    Sales Engineer

    Remote

    Full Time

    #AI

    #Sales

    #Machine Learning

    #MLOps

    #PyTorch

    #TensorFlow

    #Spark

    #Kubernetes

    #Docker

    #AWS

    #Terraform

    #MEDDIC

    U
    Unit4

    Senior Cloud Infrastructure Engineer

    pl flag
    Poland

    Remote

    Full Time

    #Cloud Infrastructure

    #Engineering

    #Microsoft Azure

    #Infrastructure Engineering

    Dataiku logo
    Dataiku

    Fullstack Software Engineer

    Remote

    Full Time

    #Engineering

    #AI

    #Solutions

    #Vue.Js

    #React

    #Angular

    #Python

    #fastAPI

    #Flask

    #RESTful API

    #Data

    H
    HTTPie

    Senior Fullstack Engineer

    Remote

    Full Time

    #Developer Tools

    #Engineering

    #API Testing

    #TypeScript

    #React

    #Next.js

    #TailwindCSS

    #Python

    #Django

    #AWS

    #Terraform

    #WebSocket

    #Electron

    Fullscript logo
    Fullscript

    Lead Data Scientist

    Remote

    Full Time

    #Data Science

    #Health Tech

    #Causal Inference

    #Python

    #Statistical Modeling

    #Research

    #Data

    #Data Analysis

    #Machine Learning

    A
    Axelera AI

    Field Application Engineering Manager

    Remote

    Full Time

    #AI

    #Field Engineering

    #Customer Success

    #PyTorch

    #TensorFlow

    #Embedded Systems

    #Python

    #CUDA

    #Computer Vision

    #Deployment

    S
    Sleeper

    Senior Frontend Engineer

    180k - 235k USD

    Remote

    Full Time

    #Mobile

    #Engineering

    #React Native

    #TypeScript

    #React Query

    #React Navigation

    #JavaScript

    #GraphQL

    #State Management

    E
    eduki

    Senior AI Engineer

    es flag
    Spain

    39.8k - 57.3k USD

    Remote

    Full Time

    #AI Engineering

    #Automation

    #Data Analytics

    #Systems

    #Databases

    #Engineering

    #AI

    #Orchestration

    #Python

    #SQL

    Flying Bisons logo
    Flying Bisons

    Head of AI Enablement

    Remote

    Contractor

    #AI

    #UX Design

    #Design

    #APIs

    #Engineering

    #Claude

    #Gemini

    #Automation Tools

    Planned Parenthood Federation of America logo
    Planned Parenthood Federation of America

    Associate Director, Information Security Engineer

    Remote

    Full Time

    #Information Security

    #Security Operations

    #SIEM

    #Splunk

    #Security Monitoring

    #Vulnerability Assessment

    #Incident Response

    #SIEM Administration

    #Windows Server

    #Firewalls

    #Networking

    P
    Propelus

    Sales Executive

    Remote

    Full Time

    #Sales

    #Enterprise Sales

    #Outbound Sales

    #Pipeline Management

    #CRM

    #Cold Outreach

    #Networking

    #Stakeholder Engagement

    #SaaS Sales

    #Solutions

    #Navigation

    StreemEnergy logo
    StreemEnergy

    Commercial Manager

    Remote

    Full Time

    #Sales

    #Renewable Energy

    #Lead Generation

    #Prospecting

    #Negotiation

    #Account Management

    #Market Research

    #Networking

    #Relationship Building

    Brainlabs logo
    Brainlabs

    IT System Administrator

    Remote

    Contractor

    #IT Support

    #Google Workspace

    #AWS

    #Azure

    #Jamf

    #Windows

    #ITSM

    #Networking

    #System Security

    #Scripting

    L
    Local Infusion

    Product Manager, Clinic Operations

    Remote

    Full Time

    #Healthcare

    #AI

    #Operations

    #Product Management

    #Data

    #Workflows

    #Systems

    #HL7

    #FHIR

    #Product Roadmap

    #Discovery

    #Metrics

    Your dream job awaits.

    Explore exciting opportunities, connect with top employers, and ignite your career.