Introduction Flashcards

1
Q

What does High-Performance Computing (HPC) usually refer to?

A

The practice of aggregating computing power to deliver much higher performance than a typical desktop computer for solving large problems in science, engineering, or business.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Why is HPC needed in physical sciences and engineering?

A

Many realistic problems generate complex systems of equations that cannot be solved analytically, requiring numerical solutions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Name an example of an organization that heavily uses HPC in the UK

A

The Met Office (for weather forecasting, climate change studies, and oceanography)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

How is HPC used in astrophysics?

A

To simulate star formation and analyze telescope data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is a “digital twin” in computational engineering?

A

A virtual representation of a physical system that is continuously updated with real-time data for simulations and analysis.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

How is HPC applied in life sciences?

A

Genomics, including DNA sequencing and protein structure analysis.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the Top500 List?

A

A ranking of the world’s fastest HPC systems based on High-Performance Linpack (HPL) benchmark performance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How often is the Top500 List published?

A

Twice a year.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What does the Linpack benchmark measure?

A

Floating point operations per second (FLOPS) using a dense linear algebra workload.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is HPL?

A

High-Performance Linpack: a parallel version of Linpack used for ranking HPC systems.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

How has HPC performance changed over time?

A

It has grown exponentially since the 1990s

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Why is parallelism essential in HPC?

A

HPC calculations require a vast number of floating-point operations, and running them in parallel makes the solution feasible.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Why is parallel programming harder than serial programming?

A

It requires ensuring both correctness and efficiency while managing synchronisation and communication between tasks.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Why can’t we rely on just one really fast processor?

A

Due to physical limits: power consumption, heat dissipation, and the breakdown of Dennard scaling.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is Moore’s Law?

A

The number of transistors on a chip doubles approximately every 24 months.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is Dennard Scaling?

A

A principle stating that as transistors get smaller, power density remains constant, allowing chips to become faster and more energy efficient—though this has now broken down.

17
Q

What is a commodity cluster?

A

An HPC system built using commercially available components rather than specialized hardware.

18
Q

How does a massively parallel processing (MPP) system differ from a commodity cluster?

A

MPP systems use more specialised hardware and are less reliant on off-the-shelf components.

19
Q

What is the most common HPC architecture today?

A

Commodity clusters

20
Q

Name an example of an MPP system

A
  • Fugaku
  • IBM BlueGene
  • Cray XC Series
21
Q

What is the University of Exeter HPCL Isca?

A

A commodity cluster using Intel x86 compute nodes, Infiniband interconnect, and a GPFS parallel filesystem.

22
Q

What are the four main components of an HPC cluster?

A
  1. Compute nodes
  2. Interconnect
  3. Mass Storage
  4. Login Nodes
23
Q

What is the function of compute nodes?

A

They provide the processor cores and memory required to execute workloads.

24
Q

What is the purpose of an interconnect in an HPC cluster?

A

It enables compute nodes to communicate and access storage.

25
What is the role of mass storage in an HPC cluster?
It provides disk arrays and storage nodes for user filesystems.
26
What is a login node in an HPC system?
It provides external access (via SSH) for users and administrators.
27
Why do HPC applications typically use compiled languages?
To maximise performance, as compilers can optimise code at compile time.
28
What are the three most common languages used in HPC?
1. C 2. C++ 3. Fortran
29
Why is Fortran still widely used in HPC?
Many legacy HPC codes and libraries are written in Fortran, making rewrites expensive.
30
What is OpenMP?
A shared-memory parallel programming model that uses directives in C, C++, and Fortran
31
What is MPI?
**Message Passing Interface:** a standard for parallel programming in distributed-memory systems.
32
Why can’t compilers automatically parallelise most HPC code?
Parallelisation is too complex, requiring programmer intervention to define tasks, synchronisation, and data movement.
33
Name two specialised parallel programming languages used in HPC.
1. Chapel 2. Julia They are not as widely used currently