You are here

FY2022 System Renewal Details

(Last update: Nov 4, 2022) Information about the new system scheduled to be launched in 2023.

Hardware

node type CPU, GPU memory [GiB] # of nodes Local scratch
on NVMe SSD [GB]
note
TypeC AMD EPYC 7763 (64 cores 2.45 GHz) [2 CPUs/node] 256 804 1536 for vnode/core jobs
TypeF 1024 14 for large memory vnode jobs
TypeG AMD EPYC 7763 (64 cores 2.45 GHz) [2 CPUs/node]
NVIDIA A100 NVLink 80 GB [8 GPUs/node]
256 16 for GPU jobs
  • Node jobs will be assigned to vnode(s). A vnode has 64 cores.
  • In addition to global scratch space (corresponding to /work in the previous system), local scratch space on NVMe SSD is available for jobs.

Storage

14.8 PB (Lustre)
 

Interconnect

InfiniBand
 

Queue Classes and Queue Factor for FY2023

Node jobs will be assigned vnodes (64 cores/vnode). A computation node consists of two vnodes.

queue
name
(jobtype)
# of total vnodes
(# of total cores)
limit for a job memory
[GiB/core]
group limit queue factor assign
unit
node type
assigned points cores/GPUs # of jobs
H
(largemem)
28 vnodes
(1,792 コア)
1-14 vnodes
(64-896 cores)
7.875 7,200,000+
2,400,000+
720,000+
240,000+
-240,0024
9,600/72
6,400/48
4,096/28
3,200/12
768/8
1,000 60 points / (1 vnode * 1h) vnode TypeF
H
(vnode)
1,248+ vnode
(79,872+ cores)
1-50 vnodes
(64-3,200 cores)
1.875 45 points / (1 vnode * 1h) TypeC
H
(core)
200+ vnodes
(12,800+ cores)
1-63 cores 1 point / (1 core * 1h) core
H
(gpu)
32 vnodes
(2,048 cores
128 GPUs)
1-48 GPUs
1-16 cores/GPU
60 points / (1 GPU * 1h)
1 point / (1 core * 1h)
TypeG
HR*
[private]
- - 1.875 - - - 45 points / (1 vnode * 1h)

vnode

TypeC
  • Jobs must be finished before the scheduled maintenance.
  • Only around half of available nodes may accept long jobs (more than a week).
  • You can omit jobtype in your jobscript except for jobtype=largemem; other types can be judged from the requested resources.
  • 80 nodes of TypeC (160 vnodes) will be shared by "vnode" and "core" jobs.
  • Short "vnode" jobs can be assigned to a "largemem" node.
  • Short "core" jobs can be assigned to a "gpu" node.
  • (Queue factors during FY2022 is different from these values.)