Overview
The Campus Cluster compute environment leverages three shared file systems, providing researchers with a powerful I/O subsystem to accelerate their work. These storage sub-systems are:
- Harbor – An all-NVME unit from VAST Data that provides users with 100GB/750,000 inodes in their $HOME directory (/u/$NETID); also provides the clusters /sw partition for shared software installations
- Taiga – A DDN Lustre hybrid NVME/HDD file system that underpins the /projects directories on the system; this FS is also mounted at /taiga. Taiga is mounted not only on ICCP, but is available on Delta/DeltaAI and NCSA’s Radiant system as it is NCSA’s global namespace. Additionally this FS can be NFS and/or SMB exported to machines on the UIUC campus.
- Scratch – A DDN Lustre all-NVME file system that services the /scratch mount on the system, this FS is dedicated to ICCP and is not global like Harbor and Taiga are. Users each get 10TB of space on this FS, but data older than 30 days is purged twice a day.
Hardware
Information regarding the hardware configurations for Harbor and Taiga can be found in their documentation linked above.
For the ICCP /scratch file system, a DDN ES400X3 appliance with 24 x 15.36TB Phison PCIe Gen 5 NVME drives is leveraged. This unit provides ~260TB of usable capacity for ephemeral data storage during job runs and is connected to the cluster via multiple 400GbE links.
All storage connections to Harbor C-Nodes, Taiga LNET Routers, and the Scratch appliance, run through the ICCP core switch infrastructure with 2.8Tbps (350GB/s) of connectivity.
Storage and Data Guide
You can learn all the details about how to manage your storage and data on the cluster in our storage and data guide.
Buy Storage
The Illinois Campus Cluster Program is now utilizing NCSA’s center-wide filesystem, Taiga, for project directories. You can request storage space through Taiga by following these instructions. You can learn more about the Taiga system in the Taiga documentation.
Disaster Recovery (DR) Service
This option is beneficial for projects with offsite disaster recovery storage needs for their primary research storage investment. You can learn more on our buy storage page.
