SLURM

A Scalable Execution Architecture for Data-Intensive Workloads

/ Leave a Comment
Distributed system architecture for HPC

1. Introduction There are many ways to design systems for data-intensive workloads. This article presents one practical approach: a scalable execution architecture built on a clear separation of orchestration, scheduling, execution, and state management. The architecture is composed of loosely coupled layers, each responsible for a distinct concern. Orchestration defines when work should happen and … [Read more…]

SLURM: Building a Reliable Control Plane with systemd

/ Leave a Comment

Introduction Slurm (Simple Linux Utility for Resource Management) is an open-source workload manager and job scheduler designed for Linux-based high-performance computing environments. Its primary role is to allocate compute resources, queue and schedule jobs, and enforce fair-use policies across shared infrastructure such as CPU clusters, GPU nodes, and large-memory systems. Rather than relying on ad-hoc … [Read more…]