Free Lesson
How to Utilize a Cluster: All About SLURM
45 min
Jul 9, 2025 11:00 AM
Virtual (Zoom)
In this video
What you'll learn
Why is managing multiple computer difficult?
We will learn *why* tools like SLURM, Kubernetes, and the like exist for when people mention "scale"
Why SLURM?
Why is SLURM my go-to choice between them all? What makes it special? Isn't it more... intense? (Spoiler: no)
I just use Colab... do I really need to know this?
We'll discuss why knowing SLURM (or in general how these systems work) is imperative in this modern age of Deep Learning
How can I set up SLURM at home?
We're going to see how I've managed a SLURM cluster *in my house*, so that you know how to apply it to your own cluster
Why this topic matters
In the modern age of Deep Learning, gigantic models are trained on hundreds and thousands of GPUs at a given time. Knowing how to utilize what the modern labs are doing for cluster management is a rapidly needed skill, which sadly means learning some Linux. Even if you may not have access to a cluster TODAY to apply this to, if you ever will, this lesson will be invaluable.
You'll learn from
Zach Mueller
Instructor, Technical Lead at Hugging Face
Previously at
