AI: Compute, storage & environment
AI-enabling hardware - GPU, DPU, SmartNIC
In one line AI infrastructure is built around accelerators (GPUs) kept busy by intelligent NICs (SmartNIC / DPU) that offload networking and storage so the expensive GPUs never wait. The components * GPU - the accelerator: massive parallel compute plus high-bandwidth memory (HBM). GPUs connect intra-server by NVLink/NVSwitch (scale-up)