AI Infrastructure Engineer at Scale AI

Scale AI logo
Scale AI

AI Infrastructure Engineer

us flag
United States

156k - 226k USD

On-site

Full Time

#Artificial Intelligence

#Machine Learning

#Research

#Systems Engineering

#Linux

#Containerization

#Virtualization

#Go

#Rust

#C++

#Networking

#Security

Scale AI is looking for a AI Infrastructure Engineer

Sign up to unlock quick summaries and profile fit assessments

At Scale, we are dedicated to accelerating the transition from traditional software to artificial intelligence. Our mission is to transform how organizations build and deploy AI, and our platform powers the world's most advanced generative models and computer vision systems. We are trusted by industry leaders like Meta, Microsoft, and OpenAI, as well as government agencies and global enterprises. We are looking for a Senior AI Infrastructure Engineer to join our team on-site in the United States to help us build the secure, high-performance code execution layer that powers our agentic workflows.

What you'll be doing

  • Design and implement a robust sandboxing platform that supports code execution across both virtualized and containerized environments.
  • Guarantee strong isolation, security, and reproducibility for all user sessions and workloads.
  • Drive performance improvements by optimizing for cold-start latency, memory usage, and resource efficiency at scale.

What you'll bring

To succeed in this role, you should have at least 3 years of experience building high-performance systems software. You are proficient in English and possess a deep technical background in the following areas:

  • Systems Programming: Expertise in languages such as Go, Rust, or C++.
  • Linux Internals: A strong grasp of process isolation, namespaces, cgroups, and memory management.
  • Infrastructure Technologies: Experience with containerization and virtualization tools like Docker, gVisor, Firecracker, or QEMU.
  • Security and Networking: Familiarity with security hardening, kernel-level performance tuning, and networking stacks.
  • Collaboration: The ability to work across teams to lead architecture reviews and own projects from initial design through to production deployment.

What you'll get

For this full-time position in San Francisco, New York, or Seattle, the base salary range is $156,000 to $225,600 USD. Beyond your salary, we offer a comprehensive benefits package designed to support your well-being and professional growth:

  • Comprehensive medical, dental, and vision insurance.
  • Retirement planning through our 401k program.
  • A dedicated learning and development budget.
  • Generous paid time off.
Scale AI logo

Scale AI

5 views

0 applied

Social Media

Visit Scale AI
Share this job
Copy Permalink
Open roles at Scale AI
Scale AI logo
Scale AI

AI Infrastructure Engineer, ML Data Platform

us flag
United States

188k - 226k USD

On-site

Full Time

#Artificial Intelligence

#Machine Learning

#Data Platform

#Data

#Kubernetes

#Terraform

#Docker

#PyTorch

#Huggingface

#MongoDB

#Postgres

#Redis

#Airflow

Scale AI logo
Scale AI

AI Infrastructure Engineer

us flag
United States

156k - 226k USD

On-site

Full Time

#Artificial Intelligence

#Machine Learning

#Research

#Systems Engineering

#Linux

#Containerization

#Virtualization

#Go

#Rust

#C++

#Networking

#Security

Scale AI logo
Scale AI

Creative Producer / Program Manager

us flag
United States

144k - 173k USD

On-site

Full Time

#Marketing

#Project Management

#Collaboration

#Coordination

#Process Improvement

Discover similar jobs
PointClickCare logo
PointClickCare

Principal ML System Engineer

Remote

Full Time

#Engineering

#Machine Learning

#Healthcare

#Python

#Java

#MLFlow

#Kubeflow

#Ray

#AWS

#Azure

#GCP

#Docker

#Kubernetes

G
Gooddata

Sr. Software Engineer (Backend)

Remote

Full Time

#Engineering

#Analytics

#AI

#Python

#Kotlin

#Rust

#Kubernetes

#Apache Arrow

#Pandas

#Polars

#API Design

#Distributed Systems

S
Seedify-fund

Junior Market Researcher

Remote

Full Time

#Research

#Crypto

#Blockchain

#Analytical Skills

#Analytics

#Blockchain Technology

#Cryptocurrencies

#Tokenomics

#DeFi

#NFT

R
REKA

Member of Technical Staff (Robotics)

Remote

Full Time

#Artificial Intelligence

#Robotics

#Python

#C++

#3D

#Computer Vision

#Machine Learning

Twingate logo
Twingate

Senior DevOps Engineer

Remote

Full Time

#Engineering

#DevOps

#Terraform

#Kubernetes

#Linux

#Python

#GCP

#GitOps

#Flux

Nedcargo logo
Nedcargo

Junior Business Development Manager

Remote

Full Time

#Sales

#Logistics

#Business Development

#Supply Chain

#Networking

#Tender Management

Pnlfin logo
Pnlfin

Fraud Risk Manager

Remote

Full Time

#Risk

#Risk Management

#Fraud

#Fraud Detection

#Machine Learning

#SQL

#PowerBI

#Data Analytics

#Team Management

#Risk Assessment

Finom logo
Finom

Fraud Risk Manager

Remote

Full Time

#Risk

#Risk Management

#Fraud

#Fraud Detection

#Machine Learning

#SQL

#PowerBI

#Data Analytics

#Team Management

#Risk Assessment

R
Rula

Sr. Staff AI Engineer - Applied AI

Remote

Full Time

#Engineering

#Healthcare

#Artificial Intelligence

#Python

#AWS

#GCP

#Distributed Systems

#Integration

#MLOps

#Databases

#Compliance

Opsbrasil logo
Opsbrasil

Data Engineer - Oracle to PostgreSQL Re-Platform

Remote

Contractor

#Technology

#Python

#TypeScript

#Go

#AWS

#OpenTelemetry

#Terraform

#Search

D
Develocity

Pre-Sales Engineer

Remote

Full Time

#Sales

#Developer Tools

#Observability

#Build Tools

#Tooling

#Security

#MEDDIC

#Presentation Skills

#Time Management

R
Railway

Senior Full-Stack Engineer - Product

Remote

Full Time

#Product

#Cloud Computing

#Developer Tools

#TypeScript

#GraphQL

#Rust

#Temporal

#Frontend Architecture

#Microservices

#UI Development

#Data Modeling

#CLI

Rainfocus logo
Rainfocus

Cybersecurity Engineer

Remote

Full Time

#Research

#Technology

#Tenable

#SonarQube

#Burp suite

#Linux

#AWS

#Jira

#Python

Bannerbank logo
Bannerbank

Principal AI & Cloud Security Engineer

135k - 178k USD

Remote

Full Time

#Technology

#Information Security

#Security

#Threat Modeling

#DevSecOps

#Microsoft Defender

#azure monitor

#Microsoft

#Python

#Terraform

P
Pindrop

Business Development Representative

45k - 55k USD

Remote

Full Time

#Sales

#Business Development

#Cyber Security

#Salesforce

#SalesLoft

#Cold Calling

#Email Campaigns

#Lead Qualification

#SaaS

#Research

#Communication

Palantir logo
Palantir

American Tech Fellowship

Remote

Other

#Technology

#Training

#Python

#Java

#C++

#TypeScript

#JavaScript

#SQL

#Git

#Docker

Veris Insights logo
Veris Insights

Research Consultant

us flag
United States

80k - 92.5k USD

Remote

Full Time

#Research

#Consulting

#Client Management

#Survey Design

#Data Analysis

#Storytelling

#Project Management

#Quantitative Analysis

#Executive Presentation

anlatan logo
anlatan

UI Designer

Remote

Full Time

#Design

#Artificial Intelligence

#Figma

#UI Design

#User Research

#Prototyping

#AI

PatternAI logo
PatternAI

Lead Engineer

Remote

Full Time

#Engineering

#Artificial Intelligence

#Software Engineering

#Data Engineering

#Data Science

#Cloud Infrastructure

#Machine Learning

#System Monitoring

#Code Review

#Team Leadership

WhiteRabbit logo
WhiteRabbit

Research Scientist Intern

Remote

Internship

#Research

#AI

#Healthcare

#Deep Learning

#Python

#Computer Vision

#Machine Learning

#Networks

Your dream job awaits.

Explore exciting opportunities, connect with top employers, and ignite your career.