Athena System Configuration

Theoretical peak speed: (56 cores) * (2.6 Gcycles/s/core) * (8 DP flop/cycle) = 2.33 Tflop/s, double precision
   Assumes one AVX-512 FMA (fused multiply-add with 8 DP additions and 8 DP multiplications) every cycle
   Does not account for memory bandwidth limitations, or dynamic frequency scaling due to AVX-512 instructions
 
Timeline
 
Early Oct. 2021:     Purchased from Red Barn Computers with Ubuntu 20.04 and selected applications preinstalled
Late Oct. 2021:     Did additional installations of Open MPI and Intel oneAPI Fortran
Jan. 2022:     Installed OpenSSH, new NVIDIA drivers, DKMS, X2Go server, and MATE desktop environment
May 2023:     Did a system refresh, made preparations for adding remote users
Nov. 2023:     Updated Paraview to 5.11.2
 
Hardware Configuration
 
Server Type:     Supermicro Super Workstation 740A-T - 4U tower - serial no. C7450FJ45MQ0180
     (Appears be a custom build, as Red Barn's Chimera series is typically ASUS- or Tyan-based)
 
Processors:     56 cores, 2x 28-Core Intel Xeon Gold "Ice Lake" Processors*, 6348, 42MB Cache, 2.60GHz
     *Sockets for this processor are LGA 4189 or "Socket P4"
Memory:     128GB, 8x 16GB ECC Registered DDR4 SDRAM DIMMs, 3200MHz*
     *Highest speed possible
Bootable Hard Drive:     1TB, Samsung 980 PRO SSD, PCIe 4.0, M.2
Additional Hard Drives:     16TB, 2x Seagate Exos 7E8 512e SATA ST8000NM000A (each 8TB), 7200RPM SATA3 6.0Gbps, 3.5"
Chipset:     Intel C621A ("Lewisburg"), 14 SATA3 ports
Network Interface Controller:     Dual Intel Corporation I210 Gigabit Network Connections
 
Motherboard and BIOS:     Supermicro X12DAi-N6; American Megatrends, Inc. (AMI) BIOS
 
Graphics Accelerator:     GIGABYTE GeForce RTX 3080 TURBO 10G, 10GB GDDR6X, 8704 CUDA cores, 1710 MHz boost clock
     Interfaces: 2x HDMI 2.1, 2x DisplayPort 1.4a, PCI Express 4.0 x16
 

Disk Structure

PropertyDrive Maker and Size
Samsung SSD, 1TB Seagate HDD, 8TB Seagate HDD, 8TB
Partition Names /dev/nvme0n1p1 /dev/nvme0n1p2 /dev/nvme0n1p3 /dev/sda /dev/sdb
Mount Points in Ubuntu /boot/efi (swap) /  (root) /data1 /data2

 

Hardware Interrogation Commands
 
Processors:     more /proc/cpuinfo
Memory:     more /proc/meminfo; top; sudo dmidecode --type memory   #grep for Size or Speed
Bootable Hard Drives:     sudo fdisk -l | grep dev   #bootable partitions are marked *
Additional Hard Drives:     lsblk; sudo blkid; sudo gparted (Device Information panel in GParted GUI)
RAID-0 Hard Drives (N/A):     lspci | grep -i raid; dmraid -r; cat /proc/mdstat   #the last one detects software RAID
I/O Controller Hub (N/A):     lspci | grep SATA; sudo dmidecode --type 8 | grep SATA
Network Interface Controller:     lspci | grep -i ether
Motherboard and BIOS:     sudo dmidecode --type baseboard; sudo dmidecode --type bios
Graphics Accelerator:     lspci | grep VGA; nvidia-smi
Devices and Mount Points:     sudo parted -l; df -h; mount
 

Software Configuration Changes

Late Oct. 2021: Did additional installations of Open MPI and Intel oneAPI Fortran

Jan. 2022: Installed OpenSSH, new NVIDIA drivers, DKMS, X2Go server, and MATE desktop environment

May 2023: Did a system refresh, made preparations for adding remote users

Nov. 2023: Updated ParaView to 5.11.2



Last updated on 7/5/24 by Steve Lantz (steve.lantz ~at~ cornell.edu)