Boost your efficiency when dealing with multiple jobs on Shaheen and Ibex
The workshop entitled: “Boost your efficiency when dealing with multiple jobs on Shaheen and Ibex” took place on Tuesday, December 12th, 10:00 – 11:30 a.m. in the Computer Lab room, Level 3, University Library
In this talk, Dr Samuel KORTAS presented some advice and a set of tools to increase users' productivity when dealing with a large number of jobs simultaneously on KSL machines.
Agenda:
09:45 Welcome coffee and cookies
10:00 A few tips before launching many jobs
10:10 4 typical use cases (15 minutes each):
- How to launch, monitor and manage more than 800 jobs with Breakit
- How to have a guaranteed elapse time using Maestro.
- How to transfer efficiently files to the ramdisk of a set of Shaheen Compute Nodes
- How to add fault-tolerance management to your workflow with Decimate
11:15 Open discussion and hands-on-session for those interested
Slides and 1001 Jobscript Generator