Research Engineer at Aisafety

Aisafety logo
Aisafety

Research Engineer

us flag
United States

On-site

Full Time

#Engineering

#AI

#Machine Learning

#NLP

#PyTorch

#Huggingface

#Data

#Transformers

#Design

Aisafety is looking for a Research Engineer

Sign up to unlock quick summaries and profile fit assessments

Introduction
The Center for AI Safety is a non-profit organization based in San Francisco, dedicated to research and the advancement of the field of AI safety. We believe that artificial intelligence will be a powerful technology that will dramatically change society, and our aim is to mitigate potential high-consequence risks. We are doing this through:
- Technical and conceptual research;
- Promotion of safety within the broader machine learning community;
- Collaboration with academics, industry researchers, philosophers, and policy drivers who are uniquely positioned to influence the future of AI safety.
We’re seeking a skilled research engineer who is aligned with our mission to develop and promote the field of AI safety. As a research engineer here, you will pursue a variety of research projects in fields such as Power Aversion, Trojans, Machine Ethics, and Reward Hacking. You will assist in writing and submitting articles for publication at top conferences. You will collaborate with both internal research staff (e.g. Dan Hendrycks) as well as academics at top universities (including Stanford, UC Berkeley, CMU, or MIT). You will have access to the latest technology with our compute cluster to run experiments at scale on large language models. You’ll also have the opportunity to grow the field of AI safety by advising and leading competitions, workshops and socials at top ML conferences and identifying other ways for CAIS to engage with the global research community.

Example Projects Include:
  • Fine-tuning large-scale transformers and evaluating them under different data domains such as HarmBench.
  • Creating and designing new datasets to evaluate the robustness of different models.
  • Evaluating models in sequential decision-making games.
  • Developing and launching ML competitions (e.g., Trojan Detection Challenge) and other initiatives to grow the AI safety field.
  • Collaborating with academics on research ranging from transparency, robustness, honest AI, interpretable uncertainty, and so on.


  • You might be a good fit if you:
  • Have a degree in Computer Science (or related machine learning field).
  • Have co-authored an NLP paper in a top conference. Bonus if you are the first author on the paper. 
  • Are aligned with our mission to reduce societal-scale risks from AI. Bonus if you have a point of view on the most tractable and important technical problems to solve.
  • Are able to read an ML paper, understand the key result, and understand how it fits into the broader literature. Bonus if this spurs ideas on directions for future research.
  • Are familiar with relevant frameworks and libraries (e.g., pytorch and huggingface).
  • Have experience launching and training distributed ML jobs i.e. can scale machine learning systems to hundreds or thousands of GPUs.
  • Communicate clearly and promptly with teammates, including with non-technical teams.
  • Have ideas and are motivated by the idea of building the field of AI safety through AI-safety focused events at top ML conferences and/or other initiatives.
  • Can work well with others in both large and small groups. Have experience collaborating with technical and non-technical professionals.


  • Benefits:
  • Health, dental, vision insurance for you and your dependents (100% coverage for employees)
  • Competitive PTO401(k) plan with 4% matching
  • Lunch and dinner at the office
  • Commuter benefits
  • Personalized ergonomic technology set-up
  • Access to some of the top talent working on technical and conceptual research in the space
  • We’re a young organization and currently building out our benefits offerings, so we expect this list to grow!


    If you have any questions about the role, feel free to reach out to [email protected].
    The Center of AI Safety is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status, or any other characteristic protected by law.
    Some studies have found that a higher percentage of women and underrepresented minority candidates won't apply if they don't meet every listed qualification. The Center for AI Safety values candidates of all backgrounds. If you find yourself excited by the position but you don't check every box in the description, we encourage you to apply anyway!
    Aisafety logo

    Aisafety

    0 views

    0 applied
    Visit Aisafety
    Share this job
    Copy Permalink
    Open roles at Aisafety
    Aisafety logo
    Aisafety

    Research Engineer Intern

    us flag
    United States

    Hybrid

    Full Time

    #Research

    #Machine Learning

    #PyTorch

    #Debugging

    #Code Review

    #Large Language Models

    Aisafety logo
    Aisafety

    DevOps Engineer

    us flag
    United States

    Hybrid

    Full Time

    #Research

    #Full Stack

    #SRE

    #DevOps

    #Docker

    #Distributed Systems

    #Pipelines

    #HPC

    #Workflows

    #Flask

    #React

    Discover similar jobs
    Blockdeliver logo
    Blockdeliver

    Senior Software Engineer

    Remote

    Full Time

    #Engineering

    #Distributed Systems

    #Networking

    #Smart Contracts

    #Backend Development

    #Unix

    #Cryptoeconomics

    #Mechanism Design

    Makersitegmbh logo
    Makersitegmbh

    Senior Data Scientist

    Remote

    Full Time

    #Engineering

    #Sustainability

    #Python

    #fastAPI

    #LLM

    #Databases

    #Docker

    #Kubernetes

    #MLOps

    C
    Conduit

    Senior Software Engineer

    Remote

    Full Time

    #Engineering

    #Blockchain

    #Golang

    #Kubernetes

    #GCP

    #AWS

    #Rust

    #Solidity

    #Distributed Systems

    #Cryptography

    #Network Protocols

    #Postgres

    Cryptio logo
    Cryptio

    Senior Typescript Engineer

    Remote

    Full Time

    #Engineering

    #Fintech

    #Blockchain

    #TypeScript

    #Node.Js

    #NestJS

    #PostgreSQL

    #AWS

    #Kubernetes

    #Docker

    #Redis

    #Pulumi

    #Gitlab

    P
    Parafin

    Staff Software Engineer, Lending Products

    285k - 330k USD

    Remote

    Full Time

    #Engineering

    #Fintech

    #Lending

    #Backend Engineering

    #Platform Development

    #Architecture

    #Cross Functional Collaboration

    #Mentoring

    #Infrastructure Design

    #Code Review

    #Reliability

    F
    Found

    Staff Software Engineer, Platform

    210k - 278k USD

    Remote

    Full Time

    #Engineering

    #Backend

    #Public Cloud

    #Observability

    #Monitoring

    #Incident Response

    #Tech

    #OpenTelemetry

    #Prometheus

    #Infrastructure as Code

    #Terraform

    A Thinking Ape logo
    A Thinking Ape

    Associate 2D Game Artist

    ca flag
    Canada

    70k - 70k USD

    Remote

    Full Time

    #Creative

    #Mobile

    #2D Art

    #Adobe Photoshop

    #Design

    L
    LeanData

    GTM Engineer (Data & AI)

    Remote

    Full Time

    #Sales

    #Revenue Operations

    #Data Engineering

    #AI

    #Workflow Automation

    #Data Warehousing

    #API Integration

    #Orchestration

    U
    UNION

    Sales Engineer

    Remote

    Full Time

    #Sales

    #Infrastructure

    #Machine Learning

    #Data Processing

    #MLOps

    #PyTorch

    #TensorFlow

    #Spark

    #Flink

    #AWS

    #GCP

    #Azure

    #Terraform

    #Docker

    #Kubernetes

    Glooko logo
    Glooko

    Strategic Account Director

    Remote

    Full Time

    #Sales

    #Enterprise Sales

    #Integration

    #Management

    #HL7 FHIR

    #RFP

    #Relationship Building

    #Data

    #Problem Solving

    Emi Labs logo
    Emi Labs

    Back-end Engineer

    ar flag
    Argentina

    Remote

    Full Time

    #Backend Engineering

    #AI Tools

    #Systems

    #Node.Js

    #Backend Development

    #Architecture

    #AI

    #LLM

    #Testing

    #Monitoring

    #Workflow Automation

    Planner 5D logo
    Planner 5D

    AI Moderator

    Remote

    Contractor

    #Product

    #Support

    #AI

    #Attention To Detail

    #Research

    #English

    PelotonInc logo
    PelotonInc

    Senior Software Engineer

    Remote

    Full Time

    #Engineering

    #Full Stack

    #DevOps

    #Docker

    #Kubernetes

    #AWS

    #GCP

    #Azure

    #Flux

    #Rancher

    #Continuous Delivery

    #Infrastructure

    #Microservices

    TheSparkGroup logo
    TheSparkGroup

    Senior Paid Digital Strategist

    Remote

    Full Time

    #Digital Marketing

    #Social

    #Advertising

    #Campaign Management

    #Data

    #Reporting

    H
    HeyJobs

    Graphic Design Creative Technology

    Remote

    Part Time

    #Technology

    #AI Tools

    #Digital Marketing

    #Engineering

    #JavaScript

    #Python

    #Landing Pages

    #Content

    I
    Inspiren

    Director of Product Management

    230k - 270k USD

    Remote

    Full Time

    #Product Management

    #Health Tech

    #AI

    #Hardware

    #Machine Learning

    #Product Strategy

    #Collaboration

    #Data Analysis

    #Discovery

    N
    Niche

    Senior Designer, Design Systems

    ar flag
    AR, BR

    Remote

    Full Time

    #Design Systems

    #Product Design

    #Figma

    #Design

    #Storybook

    #AI

    #Accessibility

    #Responsive Design

    J
    Jump

    Product Manager & Designer

    Remote

    Full Time

    #Product Management

    #Design

    #Tech

    #Product Strategy

    #Product Design

    #Engagement

    #Ticketing Systems

    #Management

    #Operations

    #Customer Empathy

    T
    Teach For All

    Head of AI Solutions & Engineering

    Remote

    Contractor

    #AI

    #Education

    #Technology

    #TypeScript

    #Python

    #REST APIs

    #Git

    #Design

    #Google Cloud

    #Business Analysis

    InterNations logo
    InterNations

    Online Marketing Intern

    Remote

    Internship

    #Technology

    #SEO

    #Online Marketing

    #YouTube

    #Google Analytics

    #WordPress

    #AI

    Your dream job awaits.

    Explore exciting opportunities, connect with top employers, and ignite your career.