Skip to content

Template for using multiprocessing Python scripts on an High-Performance-Cluster (HPC) with Slurm

License

Notifications You must be signed in to change notification settings

jlplenio/slurm_template_for_Python

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Multiprocessing Python template for HPC with Slurm

Template for running a multiprocessing Python script on an HPC with Slurm. Job files will be copied to and run in the temporary scratch directory. After job completion, all script and calculation outputs will be saved in an output folder in the user home. The scratch directory will be deleted.

The example calculates Pi 100 times (with default 4 cores) and saves an .scv output file.
See slurm_job.sh for all relevant settings.

Script was tested on the High-Performance-Cluster High-Performance Computing at ZEDAT of the Freie Universität Berlin, Germany

For an implementation in R see slurm_template_for_R_Language

About

Template for using multiprocessing Python scripts on an High-Performance-Cluster (HPC) with Slurm

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published