Document Actions
How can I run in parallel without using MPI
Up to Table of Contents
If you have many independent jobs which you wish to run simultaneously, you can use pbsdsh
You can run many independent jobscripts in parallel by submitting one single job script to the queue, using pbsdsh.
Here is a simple concrete example of how to use one parallel job to launch 4 sequential jobs (job0, job1, job2, job3).
The "Masterjob" launches "SingleJobCaller" which runs "jobN".
Masterjob:
#!/bin/bash
#PBS -lnodes=4
#PBS -lwalltime=01:00:00
pbsdsh $HOME/test/SingleJobCaller
SingleJobCaller ($PBS_VNODENUM is an environment variable which returns the rank of the job):
#!/bin/bash
$HOME/test/job$PBS_VNODENUM
job0 (and similar for job1, job2 job3):
#!/bin/bash
echo I am job 0
The output of Masterjob would be like:
I am job 0
I am job 1
I am job 3
I am job 2
The four jobs have been run in parallel (simultaneously)
