JobCubby JobCubby
Sign up
T

Senior Machine Learning Infrastructure Engineer

True Talent Solutions Partners San Francisco, California, United States · $200K–$400K/yr

2 d ago
Remote machine-learning Senior (5-10 yrs) Full-time United States
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

Applying here? Try the free cover letter tool — paste this posting and your résumé, no account needed.

About the role

Design, deploy, and maintain distributed machine learning training and inference clusters for large foundation models. Build scalable pipelines for petabyte-scale datasets and optimize low-level GPU operations for performance.

What they look for

Machine Learning Infrastructure Distributed Training Inference Optimization FSDP DeepSpeed CUDA JAX Docker Kubernetes Linux Cloud Computing Scalable Model Serving GPU Performance Optimization Foundation Models Physical AI

Requirements

Requires two to ten years of experience building large-scale infrastructure for pretrained foundation models. Proficiency in distributed training frameworks, GPU optimization, and cloud platforms is essential.

Full description

About the Role

Join an AI research team developing large foundation models for physical systems, starting with weather. You will build the infrastructure that enables distributed training and reliable, high-performance inference at scale.

What You'll Do

  • Design, deploy, and maintain distributed machine learning training and inference clusters.
  • Build scalable pipelines for petabyte-scale datasets and manage models throughout the machine learning lifecycle.
  • Research and test training approaches, including parallelization strategies and numerical precision trade-offs.
  • Profile and debug low-level GPU operations to improve performance.
  • Follow emerging research and apply useful techniques to infrastructure and workflows.

What We're Looking For

  • Two to ten years of experience building large-scale infrastructure for pretrained foundation models, including compute, data, distributed training, and inference.
  • Experience optimizing large-scale training, data, or inference workloads, with proficiency in distributed training frameworks such as FSDP or DeepSpeed.
  • Hands-on experience with low-level GPU performance optimization and debugging, including CUDA and JAX.
  • Familiarity with cloud platforms such as GCP, AWS, or Azure, and with Docker, Kubernetes, Linux, and scalable model serving.
  • Background in physical AI or AI for science, such as robotics, biology, or related scientific fields, and a generalist approach across the ML lifecycle.
  • Strong problem-solving skills and comfort working in a fast-moving, mission-driven environment.

Compensation & Benefits

Salary range: $200,000 to $400,000 USD annually. Visa sponsorship is not available.

Location

Remote within the United States. Primary location: San Francisco, California.

Similar roles