Extended maintenance sessions in October.
Maintenance work on Shaheen II is taking longer than originally envisioned. Service will not be returned by tomorrow but we are hopeful that Shaheen II will be operational by the end of the week. There will be occasional disruption to the CDLs, but at least one CDL will be available for users to login to during this period.
Tip of the week: Optimizing your I/O Performance
For many applications a technique called file striping will increase I/O performance. A file is said to be striped when read and write operations access multiple disks concurrently. The default I/O striping width is 1 on the Shaheen II parallel filesystem. This is optimal for many cases especially when every MPI process writes to its own file resulting in as many files as number of processes used.
It is advised however to increase the stripe count in situations when multiple processes write to a single shared file as with MPI-IO and parallel HDF5 or NetCDF.
The Lustre filesystem stripe count can be modified using the following command with a maximum stripe count of 144:
lfs setstripe --count [stripe-count] filename/directory
For more details, please refer to https://www.hpc.kaust.edu.sa/training/2015/cray/material/4.01_IO.pdf
Follow us on Twitter
Follow all the latest news on HPC within the Supercomputing Lab and at KAUST, on Twitter @KAUST_HPC.
KSL Announcements archives can be viewed at http://www2.hpc.kaust.edu.sa/mailman/private/announce.
Questions, concerns, or problems related to Shaheen should be directed to email@example.com. From there your issue will be assigned to an appropriate primary contact who will track your issue to resolution. We may sometimes have to request items from KAUST IT or other service providers.
Getting an account
FAQs on the process and requirements for obtaining access to the Shaheen Systems are available here.
Getting an account on Shaheen is a three-step process and is detailed in this flowchart.
You should consult our Terms and Conditions of Usage.
- Your organisation or department must submit the Organisational Access Application, establishing a relationship between your home organisation and the KAUST Supercomputing Laboratory (KSL).
- You (or your Principal Investigator) must submit a project proposal describing the work to be done and the resources your project will require:
Shaheen I: Project Proposal
Shaheen II: Project Proposal
- You must submit an Individual Account Application, supplying identification information from which we can generate login credentials.
Use the secure submission form to submit credentials or other private information.
Accessing KSL Systems
After you have been given login credentials (i.e., a username and password) you will be able to access any Shaheen systems to which you have been granted access. Primary computational access to Shaheen and Neser is available via the ssh (secure shell) protocol.
PIs are required to submit periodic project reports during the course of their work on the KSL systems, there is a template available for this.
Data Centre Visits
To request a visit to the Data Centre, in the first instance, please complete this form.
Because the Shaheen Systems are a widely shared resource, user reservations are not encouraged. However, if a user feels that making a reservation for dedicated access to all or part of the Shaheen systems is essential for their work, then KSL will consider such requests on a case-by-case basis within the bounds of the following guidelines:
- A minimum of 14 days, preferably 30 days, notice is required for all reservations.
- The maximum duration allowed for a reservation will be 48 hours.
- A reservation may request dedicated access to between 1 and 16 racks of the Shaheen BG/P system. Reservations of less than 1 rack of BG/P will not be permitted.
- Users’ project accounts will be charged for all racks reserved for the entire reservation period, regardless of whether they are all used or not.
- There are no guarantees that a reservation request will be accepted.
Exceptions to this policy may be allowed based on the merits of a request, but very rarely.
- If a user has a complaint about a KSL decision relating to resource allocation, and the user remains unhappy after discussing their concerns with KSL Management, users can request arbitration from the Chairman of the KSL Resource Allocation Committee (KSL RAC) (currently Dr David Keyes). If the user remains unhappy with the decision of the Chairman of the KSL RAC, users can request arbitration from the Chairman of the KSL Management Committee (KSLMC).
- If a user has a complaint about KSL policies, or other matters not relating to resource allocation, and the user remains unhappy after discussing their concerns with KSL Management, users can request arbitration from the Chairman of the KSL Management Committee (KSLMC).
- Get a quick look at the machines.
© 2015 King Abdullah University of Science and Technology. All rights reserved