AI Infrastructure Engineer at Scale AI

Scale AI logo
Scale AI

AI Infrastructure Engineer

us flag
United States

156k - 226k USD

On-site

Full Time

#Artificial Intelligence

#Machine Learning

#Research

#Systems Engineering

#Linux

#Containerization

#Virtualization

#Go

#Rust

#C++

#Networking

#Security

Scale AI is looking for a AI Infrastructure Engineer

Sign up to unlock quick summaries and profile fit assessments

At Scale, we are dedicated to accelerating the transition from traditional software to artificial intelligence. Our mission is to transform how organizations build and deploy AI, and our platform powers the world's most advanced generative models and computer vision systems. We are trusted by industry leaders like Meta, Microsoft, and OpenAI, as well as government agencies and global enterprises. We are looking for a Senior AI Infrastructure Engineer to join our team on-site in the United States to help us build the secure, high-performance code execution layer that powers our agentic workflows.

What you'll be doing

  • Design and implement a robust sandboxing platform that supports code execution across both virtualized and containerized environments.
  • Guarantee strong isolation, security, and reproducibility for all user sessions and workloads.
  • Drive performance improvements by optimizing for cold-start latency, memory usage, and resource efficiency at scale.

What you'll bring

To succeed in this role, you should have at least 3 years of experience building high-performance systems software. You are proficient in English and possess a deep technical background in the following areas:

  • Systems Programming: Expertise in languages such as Go, Rust, or C++.
  • Linux Internals: A strong grasp of process isolation, namespaces, cgroups, and memory management.
  • Infrastructure Technologies: Experience with containerization and virtualization tools like Docker, gVisor, Firecracker, or QEMU.
  • Security and Networking: Familiarity with security hardening, kernel-level performance tuning, and networking stacks.
  • Collaboration: The ability to work across teams to lead architecture reviews and own projects from initial design through to production deployment.

What you'll get

For this full-time position in San Francisco, New York, or Seattle, the base salary range is $156,000 to $225,600 USD. Beyond your salary, we offer a comprehensive benefits package designed to support your well-being and professional growth:

  • Comprehensive medical, dental, and vision insurance.
  • Retirement planning through our 401k program.
  • A dedicated learning and development budget.
  • Generous paid time off.
Scale AI logo

Scale AI

5 views

0 applied

Social Media

Visit Scale AI
Share this job
Copy Permalink
Open roles at Scale AI
Scale AI logo
Scale AI

AI Infrastructure Engineer, ML Data Platform

us flag
United States

188k - 226k USD

On-site

Full Time

#Artificial Intelligence

#Machine Learning

#Data Platform

#Data

#Kubernetes

#Terraform

#Docker

#PyTorch

#Huggingface

#MongoDB

#Postgres

#Redis

#Airflow

Scale AI logo
Scale AI

Brand Designer

us flag
United States

116k - 140k USD

On-site

Full Time

#Marketing

#Branding

#Design

#Brand Design

#Figma

#Adobe Illustrator

#Photoshop

#Sketching

Scale AI logo
Scale AI

Creative Producer / Program Manager

us flag
United States

144k - 173k USD

On-site

Full Time

#Marketing

#Project Management

#Collaboration

#Coordination

#Process Improvement

Discover similar jobs
Parallel Domain logo
Parallel Domain

Product Manager

130k - 180k USD

Remote

Full Time

#Product

#Python

#Machine Learning

#Product Management

#Roadmapping

#Customer Discovery

#Technical Communication

#Problem Solving

9
9amHealth

Director of Consultant Relations

Remote

Full Time

#Sales

#Healthcare

#B2B Sales

#Relationship Management

#Networking

#Pipeline Management

#Strategic Partnerships

C
Conduit

Software Engineer, Control Plane

Remote

Full Time

#Engineering

#Blockchain

#Infrastructure

#Go

#Python

#gRPC

#Kubernetes

#Postgres

#Redis

#GCP

#Protobuf

#YAML

E
Elastic

Senior Support Engineer

113k - 179k USD

Remote

Full Time

#Support

#Technology

#Technical Support

#Linux

#Unix

#System Administration

#Network Engineering

#Software Engineering

#Elastic

#SaaS

#Distributed Systems

M
MojoHire

DevOps Engineer

Remote

Full Time

#Technology

#DevOps

#Cloud Infrastructure

#Containerization

#Deployment

#Problem Solving

S
Socket

Threat Researcher

Remote

Full Time

#Security

#Engineering

#Research

#Malware Analysis

#Threat Intelligence

#Reverse Engineering

#Digital

#Incident Response

#Automation

#TypeScript

#JavaScript

E
Edmentum

Instructional Services Partnership Manager

85k - 90k USD

Remote

Full Time

#Sales

#Edtech

#CRM

#Presentation

#Networking

#Relationship Management

C
Cytora.com

Senior Platform Engineer

us flag
United States

150k - 160k USD

Remote

Full Time

#Engineering

#Insurance

#AWS

#GCP

#Terraform

#Python

#Serverless

#Lambda

#S3

#RDS

#API Gateway

#Networking

C
Center for Applied Linguistics

Language Testing Specialist

Remote

Full Time

#Research

#Education

#Writing

#Data Analysis

#Quality Control

#Project Coordination

#Standards Alignment

#Feedback

O
Overstory

Engineering Manager, Machine Learning

us flag
US, CA, +9 more

Remote

Full Time

#Engineering

#Machine Learning

#Tech

#Python

#Data

#Team Leadership

#Coaching

#Cross Functional Collaboration

Stacklok logo
Stacklok

Senior Forward Deployed Engineer - Kubernetes

sg flag
Singapore

Remote

Full Time

#Engineering

#Kubernetes

#AI

#Go

#Helm

#GitOps

#Flux

#ArgoCD

#Prometheus

#OpenTelemetry

#Datadog

#Grafana

H
Harvey

Senior Software Engineer, Core Infrastructure

200k - 250k USD

Remote

Full Time

#Engineering

#Infrastructure

#Python

#Go

#Kubernetes

#Terraform

#Pulumi

#Azure

#GCP

#Datadog

#Sentry

#Redis

AeroVect logo
AeroVect

Senior Software Engineer, Perception (Radar)

Remote

Full Time

#Engineering

#Aerospace

#Autonomous

#Python

#C++

#Signal Processing

#Object Detection

#CUDA

SpectraForce1 logo
SpectraForce1

Medical Safety Physician

Remote

Contractor

#Research

#Reporting

#Clinical Research

#Risk Management

Iheartjane logo
Iheartjane

Lead Software Engineer, Ads

Remote

Full Time

#Engineering

#AdTech

#Go

#Java

#Terraform

#Database

#Ops

Rackner logo
Rackner

AI/ML Engineer

Remote

Full Time

#Engineering

#AI

#Python

#Machine Learning

#LLM

#Power Automate

#Azure

#API Integration

S
Stability AI

Forward Deployed Engineer

Remote

Full Time

#Artificial Intelligence

#AI

#Technology

#Python

#PyTorch

#Machine Learning

#Computer Vision

#API Integration

#Cloud Infrastructure

#Data Pipelines

#Integration

Diagrid logo
Diagrid

Developer Relations Engineer

Remote

Full Time

#Developer Relations

#Open Source

#Cloud Native

#Python

#Go

#TypeScript

#.NET

#Kubernetes

#Distributed Systems

#Microservices

#Content Creation

#Community Building

1upHealth logo
1upHealth

Senior Software Engineer

Remote

Full Time

#Engineering

#Healthcare

#Full Stack

#Cloud Native

#AWS

#System Design

#Distributed Systems

#Security

#Mentoring

#AI Tools

Arealytics logo
Arealytics

Field Researcher

Remote

Full Time

#Research

#Real Estate

#Data Collection

#Photography

#Drone

#Critical Thinking

#Communication

Your dream job awaits.

Explore exciting opportunities, connect with top employers, and ignite your career.