Reaching Others University at Buffalo - The State University of New York
Skip to Content

CCR General Compute Cluster (rush)

CCR's general compute cluster is made up of over 8,000 CPUs in various configurations.  Many of these servers are kept cool by individual air conditioners and sealed doors.

Important: Users submitting MPI jobs should add the IB constraint

The UB-HPC cluster has some compute nodes that do not have InfiniBand.  Please add the "--constraint=IB" to your SLURM scripts.  

#SBATCH --constraint=IB

See the Requesting Specific Node Resources table below.


Server (Node) Types:

Type of Node # of Nodes # Cores/Node Clock Rate RAM Network* SLURM TAGS Local /scratch
32 16 2.20GHz 128GB Infiniband (M) IB CPU-E5-2660 773GB
Compute 372 12 2.40GHz 48GB



IB CPU-E5645 884GB
Compute (Dell) 128 8 2.13GHz 24GB Infiniband (M) IB CPU-L5630 268GB
Compute (IBM) 128 8 2.27GHz 24GB Infiniband (M) IB CPU-L5520 268GB
High Memory Compute  (INTEL CPUs) 8 32 2.13GHz 256GB Infiniband (QL) IB CPU-E7-4830 3.1TB
High Memory Compute (AMD CPUs) 8 32 2.20GHz 256GB Infiniband (QL) IB CPU-6132HE 3.1TB
High Memory Compute (INTEL CPUs) 2 32 2.13GHz 512GB Infiniband (QL) IB CPU-E7-4830 3.1TB
GPU Compute 32 12 2.67GHz 48GB Infiniband (M) IB CPU-X5650 0.9TB

* NETWORK: Infiniband (M) = Mellanox and Infiniband (QL) = Q-Logic


Requesting Specific Node Resources:

Node Resources Sample SLURM Directives
Multi-node with InfiniBand

--nodes=2 --ntask-per-node=12 --constraint=IB


--nodes=2 --ntasks-per-node=12 --constraint=IB&CPU-E5645

32 Core Nodes  
512GB nodes --partition=largemem --nodes=1 --ntasks-per-node=32 --mem=512000
256GB nodes (INTEL Processors) --partition=largemem --nodes=1 --ntasks-per-node=32 --mem=256000 --constraint=CPU-E7-4830
256GB nodes (AMD Processors) --partition=largemem --nodes=1 --ntasks-per-node=32 --mem=256000 --constraint=CPU-6132HE
Any 32 core nodes --partition=largemem --nodes=1 --ntasks-per-node=32
16 Core Nodes
Nodes with 16 cores --nodes=1 --ntasks-per-node=16 --constraint=CPU-E5-2660
Nodes with at least 16 cores --nodes=1 --ntasks-per-node=16
12 Core Nodes  
Nodes with 12 cores --nodes=1 --ntasks-per-node=12 --constraint=CPU-E5645
Any nodes with at least 12 cores --nodes=1 --ntasks-per-node=12
8 Core Nodes  
Nodes with 8 cores (IBM) --nodes=1 --ntasks-per-node=8 --constraint=CPU-L5520
Nodes with 8 cores (DELL) --nodes=1 --ntasks-per-node=8 --constraint=CPU-L5630
Any nodes with at least 8 cores --nodes=1 --ntasks-per-node=8
Any nodes with at least 48GB
--nodes=1 --mem=48000
Nodes with GPUs --partition=gpu --nodes=1 --ntasks-per-node=12 --gres=gpu:2