AI: Security
Requirement / business driver The hosting model sets the entire security posture of an AI environment - choose it against sensitivity, sovereignty, and threat exposure, not just cost. Options * Air-gapped - totally isolated, no external connectivity; for classified / sovereign / highly sensitive training. Highest security, lowest agility. * Private (on-prem / private cloud) - enterprise
AI: Security
In one line You cannot drop a firewall into the middle of a lossless RDMA fabric - so AI back-end security comes from isolation and segmentation, not inline inspection. The tension RoCE/RDMA is line-rate, latency-sensitive, and lossless (RDMA, RoCE and RoCEv2, Lossless fabric - PFC, ECN, DCQCN). Inline
AI: Security
Requirement / business driver Safely share extremely expensive GPU infrastructure across tenants/teams without lateral movement or data leakage between them. Why it's hard GPUs are too costly to dedicate per tenant, so clusters are shared - which means each tenant's compute, RDMA traffic, and storage must be
AI: Security
In one line The model and the training data are the crown jewels - protect their confidentiality and integrity across the whole lifecycle, not just the network around them. The threats * Model theft / exfiltration - the trained model is valuable IP; protect against extraction. * Training-data confidentiality - datasets often contain sensitive/regulated
AI: Security
Requirement / business driver Inference endpoints and APIs are user/internet-facing services - protect them against malicious use, the way you would any exposed application, plus AI-specific abuse. The surface Inference is served via APIs/apps (often internet-facing, north-south, AI-ML workloads and their infrastructure impact). This is
AI: Security
Note: Adjacent scope This is AI used as a defensive tool, distinct from securing the AI fabric (Securing the high-performance fabric). It maps to the blueprint's "protection against malicious uses" and to Core zero-trust policy-building with AI/ML - a common exam-adjacent AI