Software Engineer - Machine Learning Infrastructure
133k - 200k USD
On-site
Full Time
#Engineering
#Machine Learning
#Infrastructure
#Python
#Java
#C#
#Go
#C++
#Jax
#Distributed Systems
We are looking for a Senior Software Engineer to join our Machine Learning Infrastructure team on a full-time, on-site basis. Moloco is a machine learning company that helps organizations of all sizes grow by unlocking the value of their first-party data. We are reshaping the digital economy by making robust, machine learning-powered performance advertising accessible beyond the largest technology platforms. As a rapidly growing organization, we pride ourselves on our inclusive culture and our mission to empower businesses through operational machine learning.
Responsibilities
- Develop and maintain the software infrastructure that enables our machine learning team to build, deploy, and iterate on models with greater speed and efficiency.
- Collaborate with advanced frameworks such as TensorFlow 2 and JAX to effectively utilize hardware accelerators like GPUs and TPUs.
- Support high-scale infrastructure capable of training approximately 1,000 model instances daily while serving 7 million queries per second with a latency of under 25 milliseconds.
Requirements
- At least 4 years of professional software engineering experience using modern languages such as Python, Java, C#, Go, or C++.
- A minimum of 4 years of experience in backend or infrastructure systems development, with a strong preference for candidates who have worked specifically on machine learning infrastructure.
- A Bachelor’s degree in Computer Science or a related technical field.
- A solid grasp of distributed computing concepts, with a preference for those who have managed large-scale distributed systems.
- Practical knowledge of hardware accelerators like GPUs and TPUs, including experience optimizing workloads for these environments.
- Familiarity with public cloud platforms such as GCP, AWS, or Azure.
- Excellent problem-solving abilities and strong communication skills.
What we offer
The base compensation range for this position is $133,476 to $200,214 USD. We also provide a comprehensive benefits package designed to support our employees and their families, including:
- Medical, dental, and vision insurance.
- Life insurance and 401k plans.
- Paid time off and flexible working hours.
- Maternity and paternity leave.
- Equity compensation.
- Opportunities for professional development.






