Hardware

Question 1

Nvidia’s H100 chip

Answer 1

One of the most popular graphics processing units (GPUs) used for AI training. Companies are clamoring for the H100 because it’s seen as the best at handling AI workloads over other server-grade AI chips. However, while the extraordinary demand for Nvidia’s chips has made it among the world’s most valuable companies, many other tech companies are developing their own AI chips, which could eat away at Nvidia’s grasp on the market.

Question 2

Neural processing units (NPUs)

Answer 2

Dedicated processors in computers, tablets, and smartphones that can perform AI inference on your device. (Apple uses the term “neural engine.”) NPUs can be more efficient at doing many AI-powered tasks on your devices (like adding background blur during a video call) than a CPU or a GPU.

Question 3

GPU

Question 4

TPU

Question 5

TOPS

Answer 5

“trillion operations per second,” is a term tech vendors are using to boast about how capable their chips are at AI inference.