High Performance Computing Engineer at Boson AI

At Boson AI, we are building powerful large language tools designed to be accessible to everyone. Our team is led by founders Alex Smola and Mu Li, and we are comprised of experts in deep learning, optimization, statistics, and engineering. We are currently focused on creating high-quality generative AI models for language, audio, and entertainment. We are looking for a Senior High Performance Computing Engineer to join us in a hybrid role within the United States to help manage our datacenter infrastructure.

What you'll be doing

• You will manage our private, high-end GPU clusters, which includes working directly with NVIDIA H100 and A100 hardware.
• You will take ownership of the full lifecycle of our physical systems, from deploying new hardware to performing triage and troubleshooting.
• You will configure and maintain our complex networking and software stack, including Layer 3 networking, Mellanox Infiniband, Ceph, Slurm, and Kubernetes.

What you'll bring

To succeed in this role, you should have a strong background in high performance computing and on-premises datacenter operations. We are looking for someone who can demonstrate the following:

• A proven ability to manage large hardware clusters and perform firmware or system updates on platforms like SuperMicro.
• Proficiency in at least one programming language, such as Python, and the ability to write clean, maintainable code for automation.
• Experience designing and maintaining production-grade machine learning systems at scale.
• Familiarity with GPU utilization techniques and optimization for machine learning workloads.
• Strong problem-solving skills and a genuine desire to learn new tools and technologies.
• Fluency in English to collaborate effectively with our engineering team.
• Technical experience with Linux, Networking, Slurm, and Ceph.

What you'll get

We value the balance between professional excellence and personal well-being. As part of our team, you will receive the following benefit:

• Hybrid work flexibility to support your productivity and work-life balance.