University at Buffalo - The State University of New York
Skip to Content

Storage

CCR offers a wide range of storage options to suit the variety of needs and budgets of our all users.  See below for details on all we have to offer.  Please contact us to discuss your data storage needs and how we can best provide assistance for your research projects.

On this page:

EMC Isilon NAS Storage

The EMC Isilon NAS storage solution serves as the high reliability core storage for user home and group project directories.  The storage system consists of 1PB of usable storage in a hierarchical storage pool connected to the CCR core network with two 10GigE links per server.  The storage is designed to tolerate simultaneous failures, helping ensure the 24x7x365 availability of the Center's primary storage.    

  • User home and group project disk space at CCR is contained in a fault tolerant, high availability network attached storage (NAS) solution
  • CCR provides a total of 1 PB of available disk storage to all the clusters in the Center. 
  • Directories are available via NFS mounts on the clusters and accessible from all compute nodes.
     
  • Home directories: /user
    • Example: /user/UBIT_username/
    • Default user quota is 5GB.
    • Backed up by UB's Central Computing Enterprise Infrastruture Services department nightly

  • Projects directories: /projects
    • Additional disk space is available for research groups in the project directories.
    • Example for academic users: /projects/academic/mygroup/
    • Example for industrial users: /projects/industry/mygroup [or projectname]
    • Faculty interested in project disk space should contact the CCR staff.
    • The default project directory quota is 500GB.  The quota can be increased to 1TB without charge.
    • Backed up by UB's Central Computing Enterprise Infrastruture Services department nightly.  Please note some project spaces are larger than others and may require more than 24 hours to complete a backup.  Consider keeping a separate backup of files that change frequently and are very important to you.
    • If you require more than 1TB of storage, additional space can be purchased at a rate of $700/TB.  This rate is good for the 5 year lifespan of the storage warranty (which ends in December 2020).  After this time, you must buy in to any new storage CCR upgrades to.

      See here for how to purchase additional storage

       

GPFS High Speed Scratch

The 3 PB (petabyte) IBM GPFS storage system is CCR's high performance parallel file system.   With 40GigE connections to the core Arista network, it provides I/O performance in excess of 30 GigaBytes per second sustained in tests.  Designed for high performance and concurrent access, CCR’s GPFS is primarily intended for generation and analyses of large quantities of short-lived data (scratch usage).

CCR provides 500TB of high performance global scratch space.   

  • /gpfs/scratch
    • Accessible from all front end servers and compute nodes via the GPFS client.
    • Available to all users for temporary use.  Just create yourself a directory in /gpfs/scratch
    • Data that has not been accessed in more than 3 weeks is subject to removal by a scrubber.  Please remove all data promptly after your job completes.
    • There is NO backup of data.
       

Local Scratch

All servers and compute nodes in all the clusters have local disk space (/scratch).

  • This scratch space is available to batch jobs running on the clusters.
  • Data on local scratch may be subject to removal as soon as the job completes
  • There is NO backup of data in /scratch.
     

Archival (budget) Storage

  • Lower-tier storage than the Enterprise Isilon networked-attached storage solution used for home and project directories
  • There is NO backup of data for the budget storage directories
  • There is no guarantee of uptime or performance on budget storage
  • Cost is $150/TB with a minimum purchase of 10TB.  Initially, maximum purchase is 50TB.
    NOTE: Rate is for UB faculty and staff only.  External collaborators must pay an extra UB check fee.  Please contact CCR staff for a quote.
  • This rate is good for the 5 year lifespan of the storage warranty (January 2020).  After this time, you must buy in to any new storage CCR upgrades to.
  • Available to groups actively using CCR compute resources.
  • Available only internally to CCR servers and clusters.  Not available as a file mount to external machines.

    See here for how to purchase additional storage

 

UB maintains a research compute cloud, Lake Effect, available for access by UB faculty, staff, and students.  There is a small fee for usage.  In addition to access to virtual machines, users can also purchase storage in the cloud.  This storage is only accessible from servers within the cloud so it is not intended for use on the HPC clusters at CCR.  If you're looking for general cloud storage, we recommend you use UBbox, a product offered by UBIT

For more details, please check out our detailed Lake Effect knowledgebase articles.

NOTE: Data in the cloud is NOT backed up!

 

Additional Info about our storage options: