Changes between Version 12 and Version 13 of External_Supercomputing_Notes

Timestamp:

Jan 15, 2014, 5:02:10 PM (13 years ago)

Author:

watersc1

Comment:

--

External_Supercomputing_Notes

@@ -141 +141 @@
 == 2014-01-15 ==
 
+I've started playing around with running jobs with the MOAB scheduler, and after being completely confused by the msub/srun split, I think I've sorted out more details on how to submit jobs.
+
+My first test was to submit a ppImage job to the Moab scheduler.  Using the command {{{msub -v ppI_test.cmd}}} where that command script contains:
+
+{{{
+#!/bin/tcsh
+##### Moab controll lines
+#MSUB -l nodes=1:ppn=4,walltime=1:00:00
+#MSUB -j oe
+#MSUB -V
+#MSUB -o /scratch3/watersc1/job.out
+
+##### Commands
+date
+ppImage -file /scratch3/watersc1/o5303g0240o.ota67.fits /scratch3/watersc1/ppI_test -recipe PPIMAGE CHIP -Db PHOTOM F -Db DARK F -Db FLAT F -Db NOISEMAP F -Db MASK F -Db NONLIN F -threads 4
+date
+}}}
+
+This submitted the job and executed it, saving the stderr/stdout information in the job.out file specified.  This runs all the commands contained sequentially, meaning that there is no parallelization internal to the task, and all allocated resources can be used by each command in the task.
+
+The second test used srun as the main command, allowing multiple jobs to be run in parallel, sharing the allocated resources: {{{msub -V ppI_srun_test.cmd}}}.
+
+{{{
+#!/bin/tcsh
+##### Moab controll lines
+#MSUB -l nodes=2:ppn=4,walltime=0:10:00
+#MSUB -j oe
+#MSUB -V
+#MSUB -o /scratch3/watersc1/job_srun.out
+
+##### Commands
+date
+srun -n2 -l --multi-prog ppI_srun_test.config
+date
+}}}
+
+The config file for srun:
+{{{
+# ppI double run test config file
+# srun -n2 -l --multiprog ppI_srun_test.config
+
+0     ppImage -file /scratch3/watersc1/o5303g0240o.ota67.fits /scratch3/watersc1/ppI_srun_test_0 -recipe PPIMAGE CHIP -Db PHOTOM F -Db DARK F -Db FLAT F -Db NOISEMAP F -Db MASK F -Db NONLIN F -threads 1
+1     ppImage -file /scratch3/watersc1/o5303g0240o.ota67.fits /scratch3/watersc1/ppI_srun_test_1 -recipe PPIMAGE CHIP -Db PHOTOM F -Db DARK F -Db FLAT F -Db NOISEMAP F -Db MASK F -Db NONLIN F -threads 1
+}}}