Last modified: June 24 2026.
Contact: hpchelp [at] iitd.ac.in

HPC Downtime: 8th July 2026 - 14th July 2026


Dear All,

Access to the HPC facility will not be available from July 8, 2026 for a period of 7 days due to a scheduled downtime. This is required to integrate the new nodes into the cluster, and to enhance the infiniband connectivity.

Users are advised to plan jobs accordingly and to take full backups of any required data (including PBS jobs) since access to login nodes and data will not be available.

All efforts will be made to release the cluster at the earliest. Inconvenience is regretted.

Please Note:

Updates will be posted from time to time on the HPC website. As usual, please contact hpchelp@iitd.ac.in using your IIT Delhi email for any queries not addressed in this mail.

The severe disruption is deeply regretted, and all efforts are being made to reduce the length of the downtime.


How to Use and setup the environment.

You will need an ssh client to connect to the cluster through your IITD kerberos credentials. CPU login is available through ssh hpc.iitd.ac.in (Use IITD credentials). To copy data use scp to hpc.iitd.ac.in. GPU or Mic (Xeon Phi) nodes can be directly accessed through gpu.hpc.iitd.ac.in and mic.hpc.iitd.ac.in respectively. Please avoid using gpu and mic for large data transfer.

Once logged in to the system, you have access to your home (backed up) and scratch (not backed up) directories. Please generate an ssh key pair in your .ssh directory to start using PBS. Please report issues to hpchelp[@]iitd.ac.in

 

Hardware Specifications

    Total number of Nodes: 634
    CPU only nodes: 417
    GPU accelerated nodes: 217

    Icelake Nodes (December 2022 onward):
  • Total number of nodes: 32
    CPU nodes: 16 (256GB RAM)
    GPU nodes: 16 (512GB RAM)
    (with two Nvidia A100 card on each GPU node)
  • Basic Configuration:
    GPU: NVIDIA A100 (40GB)
    CPU: 2x Intel Xeon Platinum 8358 (32 cores 2.6 GHz) "Ice Lake"
  • All connected over 200G HDR Infiniband.
    • Skylake Nodes (July, 2019 onward):
  • Total number of nodes: 184
    CPU nodes: 144
    GPU nodes: 40
    (with one Nvidia V100 cards on each GPU node: 17)
    (with two Nvidia V100 card on each GPU node: 23)
  • Basic Configuration:
    GPU: NVIDIA V100 (32GB 5120 CUDA cores)
    CPU: 2x Intel Xeon G-6148 (20 cores 2.4 GHz) "Skylake"
    RAM: 96GB
  • 8 CPU, 40 GPU nodes have 192 GB RAM each

    • Haswell Nodes (November, 2015 onward):
  • Total number of compute nodes: 420
    CPU nodes: 259
    GPU accelerated nodes: 161
  • Basic configuration:
    GPU: 2x NVIDIA K40 (12GB, 2880 CUDA cores)
    [Please contact hpchelp[@]iitd.ac.in]
    CPU: 2x E5-2680 v3 2.5GHz/12-Core "Haswell"
    RAM: 62 GB
  • 12 CPU and 8 GPU nodes have 500 GB RAM each

  • The cluster can be accessed through 4 general login nodes, 2 GPU login nodes.

  • Storage:
    HOME space 2.3 PB
    SCRATCH space 9.0 PB

  • Primary network: Fully non-blocking FDR 56Gbps infiniband. Latency ~700ns.