Home / artificial-intelligence-machine-learning / NVIDIA-Certified Associate: AI Infrastructure and Operations (NCA-AIIO) / Cheat Sheet
NVIDIA-Certified Associate: AI Infrastructure and Operations (NCA-AIIO)

NCA-AIIO Cheat Sheet

NCA-AIIO Tests Matching NVIDIA Products to Purposes — Not Building Clusters by Hand

An entry-level, multiple-choice exam for people who plan, buy or support GPU infrastructure. No commands or output reading: spot the one keyword in each scenario and pick the product, interconnect, cooling or sharing model that fits.

Check Your Readiness →
Among the harder certs
Avg: Not published by NVIDIA
Pass: 750 / 1000
Most candidates understand NVIDIA-Certified Associate: AI Infrastructure and Operations (NCA-AIIO) concepts — and still fail. This exam tests how you apply knowledge under pressure.

NCA-AIIO Domain Map (January 2026 study guide)

The official 40% infrastructure domain is split in two here. Fifty short recognition items in 60 minutes, roughly a minute each. A scenario names a workload, constraint or lifecycle stage and you match it to a concept or NVIDIA product.

  1. 01
    AI Infrastructure: compute and fabric (part of 40%) — scale-up vs. scale-out, NVLink, InfiniBand, RoCE, Spectrum-X, GPUDirect, BlueField DPUs
  2. 02
    AI Infrastructure: facility and deployment (part of 40%) — rack power density, air vs. liquid cooling, PUE, on-prem vs. cloud vs. hybrid
  3. 03
    Essential AI Knowledge (38%) — AI vs. ML vs. DL, CUDA, cuDNN, NCCL, TensorRT, Triton, NIM, NGC, training vs. inference
  4. 04
    AI Operations (22%) — nvidia-smi vs. DCGM, Slurm vs. Kubernetes vs. Run:ai, GPU metrics, MIG vs. vGPU vs. passthrough

Wrong instinct vs correct approach

GPUs across a training cluster sit idle while nodes exchange gradients between servers
✕ Wrong instinct

Add more GPUs inside each server

✓ Correct approach

Idle time during cross-node communication points to the scale-out fabric. NVLink and NVSwitch are scale-up within a node or NVLink domain; InfiniBand or Spectrum-X Ethernet with GPUDirect RDMA connects servers.

An operations team must watch GPU health and telemetry across hundreds of nodes on dashboards
✕ Wrong instinct

Script nvidia-smi on each node and collect the output

✓ Correct approach

nvidia-smi is a quick single-node view. DCGM provides telemetry, health checks and diagnostics at cluster scale and exports to Prometheus and Grafana. The BMC through IPMI or Redfish still works when the OS is down.

GPU utilization is low on a training node while CPU and I/O wait are high
✕ Wrong instinct

Replace the GPUs with a faster generation

✓ Correct approach

The GPU is being starved by data loading, storage or the CPU. Fix the data path, for example with GPUDirect Storage or faster preprocessing such as RAPIDS; faster GPUs would simply wait longer.

A company plans to run an always-busy training platform for several years and asks where to host it
✕ Wrong instinct

Move it to on-demand cloud because cloud is cheaper

✓ Correct approach

At sustained high utilization, owned on-premises infrastructure often costs less over time, and data egress adds cloud cost. Cloud suits fast starts and elastic bursts; hybrid balances control and flexibility.

Know these cold

  • ▸ Deep learning is inside machine learning, which is inside AI; pick the narrowest correct label
  • ▸ Training stresses compute and interconnect; inference stresses latency and cost per query
  • ▸ DGX is NVIDIA's complete system; HGX is the GPU baseboard partners build servers on
  • ▸ Tensor Cores do mixed-precision matrix math; FP8, INT8 and FP4 are common in inference
  • ▸ BlueField DPU offloads networking, storage and security; it never does the model math
  • ▸ Slurm queues batch training jobs; Kubernetes runs always-on, autoscaling services
  • ▸ Kubernetes sees GPUs only via NVIDIA's device plugin, usually installed by the GPU Operator
  • ▸ Run:ai pools GPUs and sets quotas across teams; it runs on Kubernetes, not instead of it
  • ▸ Thermal throttling shows as high temperature with reduced clocks, not as an application bug
  • ▸ A rising correctable ECC count needs investigation; XID events log driver-reported GPU faults

Can you answer these without checking your notes?

In this scenario: "GPUs across a training cluster sit idle while nodes exchange gradients between servers" — what should you do first?
Idle time during cross-node communication points to the scale-out fabric. NVLink and NVSwitch are scale-up within a node or NVLink domain; InfiniBand or Spectrum-X Ethernet with GPUDirect RDMA connects servers.
In this scenario: "An operations team must watch GPU health and telemetry across hundreds of nodes on dashboards" — what should you do first?
nvidia-smi is a quick single-node view. DCGM provides telemetry, health checks and diagnostics at cluster scale and exports to Prometheus and Grafana. The BMC through IPMI or Redfish still works when the OS is down.
In this scenario: "GPU utilization is low on a training node while CPU and I/O wait are high" — what should you do first?
The GPU is being starved by data loading, storage or the CPU. Fix the data path, for example with GPUDirect Storage or faster preprocessing such as RAPIDS; faster GPUs would simply wait longer.

Common Exam Mistakes — What candidates get wrong

Choosing TensorRT when the scenario needs a model served behind an API

TensorRT compiles a trained model for faster inference using layer fusion and reduced precision. Triton Inference Server hosts models from many frameworks with dynamic batching, and NIM packages an optimized model, runtime and standard API as a ready microservice.

Calling CUDA a deep learning framework

CUDA is NVIDIA's parallel computing platform and programming model. PyTorch and TensorFlow are the frameworks built on it; cuDNN accelerates neural network layers and NCCL handles collective communication between GPUs across nodes.

Assuming RDMA forces an InfiniBand design

RoCE delivers RDMA over Ethernet when the network is lossless or congestion-controlled, and Spectrum-X adds AI tuning such as adaptive routing. InfiniBand remains the established choice for dedicated training clusters, with native RDMA and in-switch SHARP reductions.

Treating MIG and vGPU as interchangeable ways to share a GPU

MIG partitions a GPU in hardware into up to seven instances with dedicated memory and compute. NVIDIA vGPU time-slices a GPU among VMs and needs licensing. Passthrough gives one VM the whole GPU at near bare-metal speed.

Reading a higher PUE figure as the more efficient facility

PUE is total facility power divided by IT equipment power, so values nearer 1.0 mean less overhead. AI racks now draw tens to over 100 kW, and the densest rack-scale systems need direct-to-chip liquid cooling.

Resources to help you pass NVIDIA AI Infrastructure & Operations Associate on your first attempt

NCA-AIIO rewards picking the right NVIDIA product for each constraint. See how your matching holds up.