AI Infrastructure Engineer at Scale AI

Scale AI logo
Scale AI

AI Infrastructure Engineer

us flag
United States

156k - 226k USD

On-site

Full Time

#Artificial Intelligence

#Machine Learning

#Research

#Systems Engineering

#Linux

#Containerization

#Virtualization

#Go

#Rust

#C++

#Networking

#Security

Scale AI is looking for a AI Infrastructure Engineer

Sign up to unlock quick summaries and profile fit assessments

At Scale, we are dedicated to accelerating the transition from traditional software to artificial intelligence. Our mission is to transform how organizations build and deploy AI, and our platform powers the world's most advanced generative models and computer vision systems. We are trusted by industry leaders like Meta, Microsoft, and OpenAI, as well as government agencies and global enterprises. We are looking for a Senior AI Infrastructure Engineer to join our team on-site in the United States to help us build the secure, high-performance code execution layer that powers our agentic workflows.

What you'll be doing

  • Design and implement a robust sandboxing platform that supports code execution across both virtualized and containerized environments.
  • Guarantee strong isolation, security, and reproducibility for all user sessions and workloads.
  • Drive performance improvements by optimizing for cold-start latency, memory usage, and resource efficiency at scale.

What you'll bring

To succeed in this role, you should have at least 3 years of experience building high-performance systems software. You are proficient in English and possess a deep technical background in the following areas:

  • Systems Programming: Expertise in languages such as Go, Rust, or C++.
  • Linux Internals: A strong grasp of process isolation, namespaces, cgroups, and memory management.
  • Infrastructure Technologies: Experience with containerization and virtualization tools like Docker, gVisor, Firecracker, or QEMU.
  • Security and Networking: Familiarity with security hardening, kernel-level performance tuning, and networking stacks.
  • Collaboration: The ability to work across teams to lead architecture reviews and own projects from initial design through to production deployment.

What you'll get

For this full-time position in San Francisco, New York, or Seattle, the base salary range is $156,000 to $225,600 USD. Beyond your salary, we offer a comprehensive benefits package designed to support your well-being and professional growth:

  • Comprehensive medical, dental, and vision insurance.
  • Retirement planning through our 401k program.
  • A dedicated learning and development budget.
  • Generous paid time off.
Scale AI logo

Scale AI

5 views

0 applied

Social Media

Visit Scale AI
Share this job
Copy Permalink
Open roles at Scale AI
Scale AI logo
Scale AI

AI Infrastructure Engineer, ML Data Platform

us flag
United States

188k - 226k USD

On-site

Full Time

#Artificial Intelligence

#Machine Learning

#Data Platform

#Data

#Kubernetes

#Terraform

#Docker

#PyTorch

#Huggingface

#MongoDB

#Postgres

#Redis

#Airflow

Scale AI logo
Scale AI

Brand Designer

us flag
United States

116k - 140k USD

On-site

Full Time

#Marketing

#Branding

#Design

#Brand Design

#Figma

#Adobe Illustrator

#Photoshop

#Sketching

Scale AI logo
Scale AI

Creative Producer / Program Manager

us flag
United States

144k - 173k USD

On-site

Full Time

#Marketing

#Project Management

#Collaboration

#Coordination

#Process Improvement

Discover similar jobs
LuminDigital logo
LuminDigital

Cyber Security Engineer

Remote

Full Time

#Security

#Banking

#AWS

#Kubernetes

#Terraform

#Python

#PKI

#OpenSearch

#Threat Modeling

Pnlfin logo
Pnlfin

Acquiring Fraud Investigator

Remote

Full Time

#Risk

#Risk Management

#Fraud Detection

#SQL

#BI Tools

#Fraud

#Payments

#Fraud Prevention

#Machine Learning

O
OPAL

Technical Customer Success Manager

Remote

Full Time

#Sales

#Customer Success

#Account Management

#Solutions Engineering

#Terraform

#Identity Management

#Access Management

#Security

I
ITPractice

Windows Systems Administrator

Remote

Contractor

#Technology

#Windows Server

#Windows

#System Administration

#Network Management

#Troubleshooting

#Security

#Technical Support

M
Menlo Security

Sales Engineer

Remote

Full Time

#Sales

#Security

#Web

#Malware Analysis

#Network

#Email Security

#Network Security

#Virtualization

#Incident Response

A
Astronomer

Staff Software Engineer, Platform Infrastructure

215k - 250k USD

Remote

Full Time

#Engineering

#Infrastructure

#Go

#Kubernetes

#Distributed Systems

#AWS

#GCP

#Azure

#Cloud

PadSplit logo
PadSplit

Vice President, Data & AI Strategy

Remote

Full Time

#Data Science

#Data Analytics

#Snowflake

#DBT

#Machine Learning

#Analytics

#Data Governance

#Strategy

#Predictive Analytics

Cambium Networks logo
Cambium Networks

Channel Sales Manager

gb flag
United Kingdom

Remote

Full Time

#Sales

#Networking

#Channel Sales

#Partner Management

#Business Development

#MSP

#ISP

#Forecasting

#Pipeline Management

A
Advocate

Product Engineer, Tech Ops

Remote

Full Time

#Technology

#Artificial Intelligence

#TypeScript

#React

#Next.js

#Node.Js

#GraphQL

#PostgreSQL

#AWS

#Terraform

#Docker

#Python

The Browser Company logo
The Browser Company

Software Engineer, Compiler

us flag
US, CA

295k - 350k USD

Remote

Full Time

#Engineering

#Compiler

#Open Source

#Swift

#LLVM

#C++

#Windows

#Android

#Build Systems

#Tooling

#Design

Constructivedialogue logo
Constructivedialogue

Senior Impact Researcher

us flag
United States

130k - 140k USD

Remote

Full Time

#Research

#Quantitative Research

#Statistical Methods

#Data Analysis

#Research Design

#R Programming

#Survey Design

Upwave logo
Upwave

DevOps Security Contractor

us flag
United States

Remote

Contractor

#Product

#DevOps

#Security

#AWS

#Infrastructure Security

#IAM

#Incident Response

#SOC 2

#Cloud Security

Flower logo
Flower

Founding Research Engineer in the Flower Frontier Model Team

Remote

Full Time

#Engineering

#Artificial Intelligence

#PyTorch

#Jax

#Transformers

#Optimization

#Training

#Docker

#Git

#Linux

FiveToNine logo
FiveToNine

Business Development Representative

Remote

Full Time

#Sales

#B2B SaaS

#Cold Calling

#Outreach

#CRM

#Lead Qualification

#Research

Fullscript logo
Fullscript

Cloud Security Engineer

73k - 80k USD

Remote

Full Time

#Security

#Cloud

#AWS

#Google Cloud

#Terraform

#Python

#Go

#IAM

xAI logo
xAI

AI Tutor - Software Engineering Specialist

125k - 208k USD

Remote

Contractor

#Software Engineering

#Artificial Intelligence

#Programming Languages

#Debugging

#Testing

#Docker

#Backend Systems

#APIs

#Databases

Euclid Power logo
Euclid Power

Founding Enterprise Business Development Representative

100k - 120k USD

Remote

Full Time

#Sales

#Business Development

#Renewable Energy

#Outbound Prospecting

#CRM

#Research

#Pipeline Management

IntelehealthInc logo
IntelehealthInc

Partnerships Executive

Remote

Full Time

#Business Development

#Partnerships

#Proposal Writing

#Stakeholder Management

#Partnership Development

#Research

#Documentation

B
Blockworks

Senior Data Engineer

160k - 200k USD

Remote

Full Time

#Engineering

#Cryptocurrency

#Python

#Go

#Rust

#TypeScript

#SQL

#Parquet

#Postgres

#Clickhouse

#Docker

#Kubernetes

#AWS

#GCP

#Airflow

#Dagster

#DBT

Wallarm logo
Wallarm

Senior Rust Developer

Remote

Full Time

#Engineering

#Cyber Security

#Rust

#Kubernetes

#Helm

#Terraform

#Backend Systems

#Distributed Systems

Your dream job awaits.

Explore exciting opportunities, connect with top employers, and ignite your career.