KAUST Supercomputing Laboratory Newsletter 10th December 2020

In this newsletter:

  • RCAC meeting
  • Tip of the week
  • Support during holiday period
  • Next maintenance session
  • Follow us on Twitter
  • Previous Announcements
  • Previous Tips

 

RCAC meeting

The project submission deadline for the next RCAC meeting is 31st December 2020. Please note that the RCAC meetings are held once per month. Projects received on or before the submission deadline will be included in the agenda for the subsequent RCAC meeting. The detailed procedures, updated templates and forms are available here: https://www.hpc.kaust.edu.sa/account-applications

 

Tip of the week: Running Pre-Processing, Processing and Post-processing jobs with dependency

Sometimes you might want to run various pieces of your workflow that have dependency. One way is obviously to run then one-by-one after ensuring that the dependent jobs are finished. That strategy might be inconvenient if you have many parametric studies planned simulataneously. An easier approach is to use a slurm feature "#SBATCH --dependency=singleton" that allows you to submit many jobs at once such that the jobs run with dependency based on the order they were submitted. The dependent jobs need to have the same name. The best way to fully understancd it you tru it yourself. The test case is based on a CFD code - OpenFOAM. In the first step, the mesh is generated and partitioned, using one node. The solver, icoFOAM runs in the second job using two nodes, and the reconstruction of solution happens in the third job. Since these jobs require different number of nodes for execution, you cannot/should not combine these steps in one job script. 

 

Test it yourself:

tar -xf /sw/xc40cle7/openfoam/openfoam_dependency.tar 

cd openfoam_dependency/

sbatch job1.sh

sbatch job2.sh

sbatch job3.sh

squeue -u $USER

 

Support during holiday period

Please be aware that many KSL staff will be on leave during this month and next. Shaheen will be supported as usual, but there may be delays in responding to some of the less urgent tickets.

 

Next maintenance session

The system will be unavailable from 7am on the 11th of January 2021 until 5pm on the 12th of January. There will also be no access to files during this period. This outage will allow us to perform essential upgrades to the datacentre in anticipation of new project filesystem to be installed in the following months. Please let us know (help@hpc.kaust.edu.sa) should this cause any concerns.

 

Follow us on Twitter

Follow all the latest news on HPC within the Supercomputing Lab and at KAUST, on Twitter @KAUST_HPC.

Previous Announcements

http://www.hpc.kaust.edu.sa/announcements/

Previous Tips

http://www.hpc.kaust.edu.sa/tip/