Senior Distributed ML Engineer
- Level
- Senior
Not stated in the posting: salary, work type, visa.
Open. First seen 2 October 2026.
About the role
We are seeking a senior distributed machine learning (ML) research developer to join our team working on a novel AI safety agenda. In this role, you will work closely with ML research scientists to solve difficult training and inference problems using very large models.
Key Responsibilities
- Collaborate with researchers to accelerate research, model training and inference, and facilitate the use of large-scale models in distributed computing environments.
- Investigate performance bottlenecks, profile research experiment code, debug reported issues, and optimize the utilization of computing resources.
- Develop tools and libraries to simplify and orchestrate the use of distributed computing resources for research experiments.
- Establish, document, and maintain best practices for large-scale, distributed ML model development workflows.
Skills and Qualifications
- A degree in a relevant computer science field (e.g., computer science, computer engineering, software engineering) is required. An advanced degree (master’s or PhD) related to machine learning or distributed ML systems is preferred but not required if the candidate demonstrates exceptional abilities and experience.
- 3+ years of experience in designing and implementing distributed ML training frameworks, with recent experience using e.g. Megatron, DeepSpeed, HuggingFace Accelerate, FSDP, vLLM, and/or verl.
- Ability to collaborate effectively with cross-functional teams, document best practices, and stay updated with the latest advancements in ML and software development.
- Experience with cloud platforms (e.g., AWS, GCP, Azure) and workload managers (e.g., Ray, SLURM).
- Experience with GPU profiling tools (e.g. PyTorch profiler, PyProf, NVIDIA Nsight).
- Familiarity with containerization tools (e.g., gRPC, Docker, Kubernetes).
- Familiarity with data infrastructures and platforms (e.g., vector databases).
- A track record of contributing to high-quality research projects in deep learning.
The title of Engineer is used for reference purposes and may or may not be the official title of the applicant based on jurisdiction.
LawZero's standard text
About LawZero
LawZero is a non-profit organization committed to advancing research and creating technical solutions that enable safe-by-design AI systems. Its scientific direction is based on new research and methods proposed by Professor Yoshua Bengio, the most cited AI researcher in the world. Based in Montreal, LawZero’s research aims to build AI that learns primarily to understand the world rather than to act in it, giving truthful answers to questions based on transparent and externalized probabilistic reasoning.
Such AI systems could be used to accelerate scientific discovery, to provide oversight for agentic AI systems, and to advance the understanding of AI risks and how to avoid them. LawZero believes that AI should be cultivated as a global public good—developed and used safely towards human flourishing. For more information, visit www.lawzero.org
You belong here
At LawZero, diversity is important to us. We value a work environment that is fair, open and respectful of differences. We welcome applications from highly qualified individuals interested in working towards our mission in a respectful, inclusive and collaborative setting.
Your personal information will be collected and processed by LawZero to evaluate your application for employment in compliance with our Privacy Policy. Under privacy laws in force in your country of residence, you may have several privacy rights, such as to request access to your personal information or to request that your personal information be rectified or erased. Details on how you can exercise your rights can be found in our Privacy Policy.
What this role asks for
Particular to this role
AWS · Azure · GCP · Hugging Face · gRPC
Rare in LawZero's other 7 open postings.
Standard for data science / ML roles
Machine Learning · PyTorch
Common in data science / ML postings at any company.
54% of this description is written for the role. The rest is LawZero's standard text, folded away below.
Compared with LawZero's other open jobs.
The team: Science HIRES STEADILY
This role is one of 7 open in Science. 1 was posted in the last 30 days and the oldest in June: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Machine Learning (6 of 7), Deep Learning (4 of 7), Docker (4 of 7), Kubernetes (4 of 7), PyTorch (3 of 7), Vector Databases (3 of 7), AWS (2 of 7)
OTHER ROLES ON THIS TEAM
- Senior ML Data Processing Developer posted Nov 17
- Senior Data Platform Engineer posted Sep 9
- Machine Learning Manager posted Jun 10
- Mathematical Scientist for AI Safety Research posted May 22
- Senior ML Research Scientist posted Jun 3
- Senior ML Research Developer posted Jun 3
From the team and dates on LawZero's own job board.
Similar jobs
- Machine Learning Engineer at Cognite - AI for Industry
Shares 10 skills: Hugging Face, gRPC, Deep Learning… - Senior AI Engineer at dunnhumby
Shares 9 skills: Hugging Face, gRPC, Vector Databases… · Senior level - Senior Solutions Architect II (AI/ML) at DigitalOcean
Shares 8 skills: Hugging Face, PyTorch, Docker… - Lead AI Engineer - Generative AI & Azure AI Platform at SSC HR Solutions
Shares 8 skills: Hugging Face, gRPC, Vector Databases… - Frontend Architect (human) at Neura Robotics
Shares 6 skills: gRPC, Docker, GCP… · same country - Senior ML Data Processing Developer at LawZero
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.