AI Hardware Flashcards
PCIe stands for
PCI express
PCI stands for
Peripheral component interconnect
Bus
a communication system that transfers data between components inside a computer, or between computers.
At a high level physical level what does the term “bus” mean?
a path between the components of a computer
What do you insert into a PCI slot?
A PCI card (that I guess is or is attached to some peripheral like a video card, sound card, etc)
PCI was common when?
From 1993 to 2007
PCIe definition
A dual-slot card design by Nvidia that requires no connection to the power supply, unlike the PCI cards
NVidia NLink
a high-bandwidth, energy-efficient interconnect that can transfer data up to ten times faster than PCIe
SXM2
A card slot design that allows the GPU to communicate either with each other or to the CPU through Nvidia’s NVLink
Tesla P100 price in 2016
Roughly $6k to roughly $10k depending on the type of interconnect
Dollars per TFLOPs of P100 in 2016?
~$1200 to $1800 depending on the variant selected for the memory and the interconnect
What Tesla GPU was of the generation before P100?
Tesla K40
How much did a K40 cost? [ostensibly when it was in season]
~$2350 per TFLOP
A100 die area (aka die size)
826 square mm
A100 transistor count
54 billion
Estimate of how many dies fit on an A100 wafer
64
What is the relationship between wafers and and a die?
A wafer is the round slice that the individual dice (dice is plural of die) are printed/somehow constructed on on. Each die is then sliced off from the wafer
Warps/wavefronts
. Warps/Wavefronts: In NVIDIA GPUs, for example, threads are organized into warps, which are sets of 32 threads that execute the same instruction at the same time but on different data.
