Principal AI Solutions Software Engineer at SambaNova Systems

At SambaNova Systems, we are leading the charge in the era of pervasive AI by providing the first full-stack, generative AI platform that spans from chip to model. Our proprietary SN40L chip powers an integrated solution that allows enterprise and government organizations to fine-tune and own their generative AI assets, and we are looking for a Principal AI Solutions Software Engineer to help us transform cutting-edge research into high-performance, customer-empowering solutions.

Responsibilities

• Develop robust, scalable AI solutions by working closely with both internal engineering teams and external users.
• Integrate the latest advancements in model architecture, data curation, and performance optimization into our technical stack.
• Build end-to-end machine learning applications that facilitate model training and fine-tuning on domain-specific data.
• Enable high-throughput and low-latency inference for large-scale deployments.
• Collaborate across hardware and software teams to innovate on customer-centric applications.
• Work effectively with a variety of data types, including textual, tabular, unstructured, and multimodal information.

Must-haves

• Bachelor’s degree or higher in Computer Science, Electrical Engineering, Physics, Statistics, or Applied Mathematics.
• At least 5 years of industry experience, with a minimum of 3 years focused on deep learning algorithm development, compilers, or software-hardware co-design.
• Strong proficiency in Python or C++, supported by a solid foundation in algorithms, data structures, and machine learning.
• Hands-on experience with popular machine learning frameworks like PyTorch, TensorFlow, or JAX.
• Proven experience in machine learning productization, pipeline development, and the deployment of model training and inference at scale.
• Practical knowledge of multi-lingual LLM applications, vision-language multimodality, and tools such as DeepSeed, Megatron, vLLM, and TensorRT.
• Fluency in English.

Nice-to-haves

• Programming skills in CUDA or OpenCL, including experience with CuDNN and CUDA math libraries like CuBLAS or CuFFT.
• Recognition as a first author in a machine learning or computer science publication.

Benefits

The annual base salary for this position is between $165,000 and $190,000, depending on your experience, location, and qualifications.

• Equity compensation.
• Comprehensive medical, dental, and vision insurance.
• Disability insurance.
• Employee assistance program for counseling services.