Software Engineer - Machine Learning Infrastructure at Moloco

We are looking for a Senior Software Engineer to join our Machine Learning Infrastructure team on a full-time basis. Moloco is a machine learning company that helps organizations of all sizes grow by unlocking the value of their first-party data. We are transforming performance advertising by bringing the speed and scale of machine learning to businesses everywhere. As a leader in the industry, we have been recognized as one of the fastest-growing private companies and are committed to fostering a culture of inclusion and belonging. You will play a vital role in building the robust infrastructure that powers our advanced models, helping our team ship better technology more efficiently.

Responsibilities

• Develop and maintain the high-performance software infrastructure that enables our machine learning team to build and deploy models with greater speed and efficiency.
• Collaborate with advanced frameworks like JAX and Tensorflow2 to optimize our utilization of hardware accelerators such as GPUs and TPUs.
• Manage and scale infrastructure capable of supporting the training of 1,000 model instances every day while serving 7 million queries per second with sub-25 millisecond latency.

Requirements

• At least 4 years of professional software engineering experience using modern programming languages such as Python, Java, C#, Go, or C++.
• A minimum of 4 years of experience working on backend or infrastructure systems, with a preference for those who have a background in machine learning infrastructure.
• A Bachelor’s degree or higher in Computer Science or a related technical field.
• A solid understanding of distributed computing concepts, ideally with hands-on experience in large-scale distributed systems.
• Familiarity with hardware accelerators like GPUs and TPUs, including experience optimizing workloads for these environments.
• Experience with cloud platforms like GCP, AWS, or Azure is highly preferred.
• Strong problem-solving abilities and clear communication skills.

What we offer

The base compensation for this position ranges from $133,476 to $200,214 USD, depending on your individual skills, experience, and knowledge. In addition to salary, we provide a comprehensive benefits package designed to support your well-being and professional growth, including:

• Medical, dental, and vision insurance.
• Life insurance and 401k plans.
• Paid time off and maternity/paternity leave.
• Flexible working hours.
• Opportunities for professional development.
• Equity compensation.