Academic Compute Cluster (UB-HPC)

CCR General Compute Cluster

CCR's general compute cluster for academic users is made up of over 8,000 CPUs in various configurations.  Many of these servers are kept cool by individual air conditioners and sealed doors.

IMPORTANT: Users submitting MPI jobs need to add the IB constraint

The UB-HPC cluster has some compute nodes that do not have InfiniBand/OmniPath.  Please add the "--constraint=IB" or "--constraint=OPA" as needed to your SLURM scripts.  

#SBATCH --constraint=IB

See the Requesting Specific Node Resources table below.

Server (Node) Types:

Type of Node


# of Nodes

# Cores per Node  Clock Rate RAM Network* SLURM TAGS Local /scratch
Compute 86 32 2.10GHz 192GB OmniPath (OPA) OPA CPU-Gold-6130 0.9TB
32 16 2.20GHz 128GB Infiniband (M) IB CPU-E5-2660 773GB
Compute 372 12 2.40GHz 48GB



IB CPU-E5645 884GB
Compute (Dell) 128 8 2.13GHz 24GB Infiniband (M) IB CPU-L5630 268GB
Compute (IBM) 128 8 2.27GHz 24GB Infiniband (M) IB CPU-L5520 268GB
High Memory Compute (INTEL CPUs) 16 32 2.10GHz 768GB OmniPath (OPA) OPA CPU-Gold-6130 INTEL 3.6TB
High Memory Compute  (INTEL CPUs) 8 32 2.13GHz 256GB Infiniband (QL) IB CPU-E7-4830 INTEL 3.1TB
High Memory Compute (AMD CPUs) 8 32 2.20GHz 256GB Infiniband (QL) IB CPU-6132HE AMD 3.1TB
High Memory Compute (INTEL CPUs) 2 32 2.13GHz 512GB Infiniband (QL) IB CPU-E7-4830 INTEL 3.1TB
GPU Compute 16 32 2.1GHz 192GB OmniPath (OPA) OPA CPU-Gold-6310 0.9TB

* HPC NETWORKS: Infiniband (M) = Mellanox and Infiniband (QL) = Q-Logic, Intel OmniPath (OPA)

Requesting Specific Node Resources:

Node Resources Sample SLURM Directives
Multi-node with InfiniBand

--nodes=2 --ntask-per-node=12 --constraint=IB


--nodes=2 --ntasks-per-node=12 --constraint=IB&CPU-E5645

32 Core Nodes  
512GB nodes --partition=largemem --nodes=1 --ntasks-per-node=32 --mem=512000
256GB nodes (INTEL Processors) --partition=largemem --nodes=1 --ntasks-per-node=32 --mem=256000 --constraint=CPU-E7-4830
256GB nodes (AMD Processors) --partition=largemem --nodes=1 --ntasks-per-node=32 --mem=256000 --constraint=CPU-6132HE
Any 32 core nodes --partition=largemem --nodes=1 --ntasks-per-node=32
16 Core Nodes
Nodes with 16 cores --nodes=1 --ntasks-per-node=16 --constraint=CPU-E5-2660
Nodes with at least 16 cores --nodes=1 --ntasks-per-node=16
12 Core Nodes  
Nodes with 12 cores --nodes=1 --ntasks-per-node=12 --constraint=CPU-E5645
Any nodes with at least 12 cores --nodes=1 --ntasks-per-node=12
8 Core Nodes  
Nodes with 8 cores (IBM) --nodes=1 --ntasks-per-node=8 --constraint=CPU-L5520
Nodes with 8 cores (DELL) --nodes=1 --ntasks-per-node=8 --constraint=CPU-L5630
Any nodes with at least 8 cores --nodes=1 --ntasks-per-node=8
Any nodes with at least 48GB
--nodes=1 --mem=48000
Nodes with GPUs --partition=gpu --nodes=1 --ntasks-per-node=32 --gres=gpu:2