Anyscale

Deep Learning Performance Engineer

United States

170k - 237k USD

On-site

Full Time

#Engineering

#AI

#Machine Learning

#CUDA

#Systems

#Networking

#Deep Learning

#PyTorch

#Learning

#Ray

#TensorRT

Anyscale is looking for a Deep Learning Performance Engineer

Full Time Senior On-site United States Engineering AI Machine Learning CUDA Systems Networking Deep Learning PyTorch Learning Ray TensorRT English Stock options 401k

170k - 237k USD per year

About Anyscale:

At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

Anyscale is based in San Francisco, CA. Employees are required to come in office 3x a week.

About the role:

As a Deep Learning Performance Engineer, you will help build systems and optimizations that push the boundaries of performance across cutting edge ML models. This is an incredibly critical role to Anyscale as it allows us to provide market leading performance and price point for AI infrastructure.

As part of this role, you will:

Iterate very quickly with product teams to ship the latest optimizations to Anyscale platform, Anyscale Endpoints, and various open source offerings.

Work closely with research teams on LLM engines like vLLM, TensorRT-LLM

Follow the latest state-of-the-art in the open source and the research community, implementing and extending best practices

We'd love to hear from you if you have:

Prior experience working on GPUs / CUDA

Solid understanding of operating systems and/or networking fundamentals and experience in such optimizations

Familiarity with deep learning and deep learning frameworks (e.g. PyTorch)

Bonus points!

ML Systems knowledge

Experience training deep learning models

Contributions to deep learning frameworks (PyTorch, TensorFlow)

Contributions to deep learning compilers (Triton, TVM, MLIR)

Experience using Ray

Compensation

At Anyscale, we take a market-based approach to compensation. We are data-driven, transparent, and consistent. The target salary for this role is $170,112 ~ $237,000. As the market data changes over time, the target salary for this role may be adjusted.

This role is also eligible to participate in Anyscale's Equity and Benefits offerings, including the following:

Stock Options

Healthcare plans, with premiums covered by Anyscale at 99%

401k Retirement Plan

Wellness stipend

Education stipend

Paid Parental Leave

Flexible Time Off

Commute reimbursement

100% of in-office meals covered

Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law.

Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish

Anyscale

4 views

0 applied

Social Media

Visit Anyscale

Share this job

Copy Permalink

Open roles at Anyscale

Anyscale

Developer Content Engineer

United States

Hybrid

Full Time

#Engineering

#Machine Learning

#Deep Learning

#Python

#MLOps

#DevOps

Anyscale

Distributed LLM Inference Engineer

United States

170k - 247k USD

On-site

Full Time

#Engineering

#Deep Learning

#Distributed Systems

#PyTorch

#Data

Anyscale

Deep Learning Performance Engineer, Senior

United States

170k - 237k USD

On-site

Full Time

#Engineering

#AI

#Machine Learning

#CUDA

#Deep Learning

#PyTorch

#Systems

#Networking

#Ray

#TensorRT

Discover similar jobs

Sauce

AI Operations Engineer

Remote

Full Time

#Engineering

#Operations

#OpenAI

#Node.Js

#React

#PostgreSQL

#REST API

#Cloud

Prolific

Application Security Lead

Remote

Full Time

#Application Security

#Engineering

#AI

#OWASP Top 10

#Code Review

#Python

#Burp suite

#SSDLC

#SAST

#DAST

#Vulnerability Management

#ISO 27001

Allata

Ascend Program - Data

Remote

Full Time

#Data

#Data Engineering

#Software Development

#Data Analysis

#AI

#Agile

#Jira

#Git

#Cloud Platforms

Snackpass

Software Engineer, Fullstack

Remote

Full Time

#Engineering

#Payments

#Analytics

#Tooling

#Mobile Apps

#Scalable Systems

OpenVPN

AI Platform Engineer

140k - 150k USD

Remote

Full Time

#AI

#DevOps

#Cloud Infrastructure

#Vertex AI

#Terraform

#GCP

#Compliance

#ISO 27001

#Pipelines

#Kubernetes

Union

Sales Engineer

Remote

Full Time

#AI

#Sales

#Machine Learning

#MLOps

#PyTorch

#TensorFlow

#Spark

#Kubernetes

#Docker

#AWS

#Terraform

#MEDDIC

Deepgram

Pre-Sales Solutions Engineer

Remote

Full Time

#AI

#Solutions Engineering

#Python

#JavaScript

#API Integration

#Speech Recognition

#NLP

#Cloud Platforms

#Docker

#Kubernetes

#Sales Methodologies

Unit4

Senior Cloud Infrastructure Engineer

Poland

Remote

Full Time

#Cloud Infrastructure

#Engineering

#Microsoft Azure

#Infrastructure Engineering

Lightdash

Head of Engineering

Remote

Full Time

#Engineering Leadership

#AI

#Developer Experience

#TypeScript

#React

#Node.Js

#SQL

#Docker

#Kubernetes

#GCP

#Architecture

#Security

saas.group

Applied Research Scientist

Remote

Full Time

#AI

#Research

#SQL

#Python

#Data Analysis

#Experiment Design

#Data Pipelines

#Validation

#AI Tools

#Research Methodology

Pinecone

Staff/Principal Product Manager, Database

Remote

Full Time

#Product Management

#AI

#Database

#SaaS Products

#Cloud Infrastructure

#Data Analysis

#User Research

#Roadmap Planning

#Collaboration

#Technical Products

Dataiku

Fullstack Software Engineer

Remote

Full Time

#Engineering

#AI

#Solutions

#Vue.Js

#React

#Angular

#Python

#fastAPI

#Flask

#RESTful API

#Data

Clyro

Technical Product Marketer Content Growth

Remote

Full Time

#AI

#Content Marketing

#Growth

#SEO Optimization

#Content Editing

#Editorial

#Keyword Research

#Management

#Social Media

#LinkedIn

#Twitter

#Ahrefs

HTTPie

Senior Fullstack Engineer

Remote

Full Time

#Developer Tools

#Engineering

#API Testing

#TypeScript

#React

#Next.js

#TailwindCSS

#Python

#Django

#AWS

#Terraform

#WebSocket

#Electron

Doxel

Director, Product Engineering

Remote

Full Time

#Product Engineering

#Construction

#AI

#Architecture

#Web

#Data Pipelines

#3D Rendering

#Engineering Leadership

#Team Management

McFadyen Digital

Sales Director

Remote

Full Time

#Digital

#Sales

#Technology

#Sales Cycle Management

#Pipeline Building

#Cold Calling

#Channel Partnerships

#CRM

#Digital Marketing

#AI

Fullscript

Lead Data Scientist

Remote

Full Time

#Data Science

#Health Tech

#Causal Inference

#Python

#Statistical Modeling

#Research

#Data

#Data Analysis

#Machine Learning

Axelera AI

Field Application Engineering Manager

Remote

Full Time

#AI

#Field Engineering

#Customer Success

#PyTorch

#TensorFlow

#Embedded Systems

#Python

#CUDA

#Computer Vision

#Deployment

Nestora

Mobile Developer

India

Remote

Full Time

#Technology

#Mobile Development

#AI

#AI Tools

#Claude

#Clean Code

Sleeper

Senior Frontend Engineer

180k - 235k USD

Remote

Full Time

#Mobile

#Engineering

#React Native

#TypeScript

#React Query

#React Navigation

#JavaScript

#GraphQL

#State Management

Your dream job awaits.

Explore exciting opportunities, connect with top employers, and ignite your career.

Explore Jobs

Related Resources

Engineering Salary Guide

Compensation data for Engineering roles

Engineering Job Market

Hiring trends and demand for Engineering

Engineering Interview Prep

Practice questions for Engineering interviews

AI Salary Guide

Compensation data for AI roles

AI Job Market

Hiring trends and demand for AI

AI Interview Prep

Practice questions for AI interviews

Machine Learning Salary Guide

Compensation data for Machine Learning roles

Machine Learning Job Market

Hiring trends and demand for Machine Learning

Deep Learning Performance Engineer at Anyscale