Representing Digital Media Flashcards

1
Q

What is a microphone?

A

A transducer, converts audio (sound waves) into an electrical signal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are some ways of creating digital audio?

A

Sampling and synthesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the anatomy of audio?

A

Sine wave (S(t)=a sin(2pi f(t-theta))

a is amplitude

f is frequency

t- theta is the phase

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What does amplitude, frequency, and phase relate to sound?

A

Amplitude relates to the loudness of the sound

Frequency is related to the perceived pitch

Phase can depend on the relative location of the sound

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Can any periodic function be expressed as a sum of sine waves? What about non periodic?

A

Yes

Yes just make the period as long as the signal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is dB-SPL?

A

Sound pressure level

A relative logarithmic unit relative to the 20 micropascals

=20log(sound/threshold)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are the hearing frequency limits!

A

16 Hz to 20 kHz

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How does the upper bound limit for hearing change?

A

Varies between people and steadily decreases with age

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What does digitizing sound involve?

A

Taking samples at a fixed rate and recording them

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What happens when the sampling rate is too slow or too fast?

A

Too slow means it’s inaccurate

Too fast means the file is very large

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What does the Nyquist-Shannon sampling theorem say?

A

The sampling interval must be less that or equal to half a period

Should sample periodic signal at least twice the frequency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

If the frequency of a periodic signal is 10 Hz what should the sampling be at minimum?

A

20 Hz minimum

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is bit depth? What does a high bit depth mean?

A

determines the number of possible amplitude values we can record for each audio sample

higher means more accurate sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is a bit depth of less than 8 used for?

A

Can be used to record physical processes like blood pressure, heartbeat, motion due to walking or running (not sound)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is a bit depth of 8 used for?

A

telephones, sometimes quantization noise can be heard

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is a bit depth of 16 used for?

A

High quality sound

CDs, MP3, DAT etc

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is a bit depth of 24 used for?

A

DVD-Audio, DTS

often used before or during mastering (sound processing/editing)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Combining bit depth and bit rate gives you what?

A

bit rate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What format is uncompressed audio typically saved in?

A

.wav

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is lossless vs lossy audio compression?

A

lossless is similar to text lossless compression

lossy removes imperceptible sounds, and reduces bit rate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is codec? Where did the word come from?

A

Compression and decompression algorithms for audio (and video)

“compressor” and “decompressor”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What are some examples of codecs? Are they lossy or lossless?

A

FLAC, lossless (using a combination of run-length and Huffman encoding), used for archiving high quality audio, 62% comrpession

MP3, lossy, 13% compression, uses psychoacoustics, Huffman encoding, and lower bit rates (mobile devices)

AAC, lossy, 14% compression, Uses psychoacoustics, Huffman encoding, and lower bit rates, better quality than MP3 (apple and modern smartphones)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What are the 4 types of cells in human retina?

A

1 rod (low light vision)

3 cones (short/medium/long wavelenght sensivitve)

24
Q

WHat happens when all three cone cells are stimulated by light?

A

you see white

25
Q

What is the RGB colour model?

A

three integers (usually in the range of 0-255) describe the amount of red, green, blue required to produce the colour

26
Q

What is white in RGB model, what about black, red, green, blue?

A

white: 255,255,255
black:0,0,0
red:255,0,0
green:0,255,0
blue:0,0,255

27
Q

What are some other colour models?

A

CMYK (cyan,magenta,yellow,black)

HSL (hue,saturation,luminence)

YUV: (luminence,blue,red)

28
Q

What is CMYK usually used for?

A

colour printers, start with white paper and subtract individuals components

29
Q

What are HSL and YUV similar to?

A

colour wheel principle, better maps how the human brain interprets colour

30
Q

How many hexadecimal digits are used to represent a colour?

A

6

RRGGBB

31
Q

Where does the word pixel come from? What are they?

A

picture element,dots of colour on an image

32
Q

What does resolution mean?

A

the number of pixels on an image (or dispaly)

size of image measured in pixels, sometimes reffered to as pixel density

33
Q

What are vector graphicss? How are they created?

A

image that is defined using mathematical equations representing lines, curves, and polygons

Using drawing applications or text editors

34
Q

What vector graphics be enlarged?

A

yes, without loss of detail or an increase in file size

35
Q

What does SVG stand for? What are they?

A

scalable vector graphics

are text based files that can be compresseed accordingly

36
Q

What are raster graphics? How are they created/edited?

A

Imagine that is comprised of a matrix of pixels

Painting applications

37
Q

What is a drawback for raster graphics?

A

Suffer from pixelation

When enlarged the shape of the pixels becomes really obvious

38
Q

What is indexed colour?

A

Popular way to compress images

Similar to keyword encoding, only saves important colors

39
Q

What does GIF stand for? What are they?

A

Graphics interchange format

Allow for transparency and animation, has a compression rate of 10%, lossless encoding and uses indexed colour and coding related to huffmans (max 256 colors)

40
Q

What does PNG stand for? What are they?

A

Portable network graphic

Lossless compression that uses ibdexed colours and run length encoding, compression rate of 7%, allows for transparency and more modern

41
Q

What are png and gif best for?

A

Line drawings, logos, diagrams

42
Q

What does JPEG stand for? What are they?

A

Joint photographic experts group

Good for photos, bad for images with text or sharp lines, lossy and has compression of 1-10 depending on quality, divides images into blocks of 8x8 pixels

43
Q

What is virtual reality?

A

Immersive technology, images change with head motion to always show the proper perspective

44
Q

What are some challenges for virtual reality?

A

Processing power, needs more complex hardware, images need to be generated faster than for movies, cannot be used for too long

45
Q

What are videos?

A

Comprised of frames of still images combined with audio

46
Q

What are some typical frame rates?

A

24-30 frames per second to 60 frames per second

47
Q

What are spatial compression techniques? Example?

A

Use information from within the same frame to reduce file size (intra-frame technique)

M-JPEG

48
Q

What are temporal techniques? Example?

A

Use data from nearby frames to reduce the file size (inter-frame technique)

MPEG

49
Q

What are key frames?

A

Typically compressed with spatial techniques, can be independently reproduced, inserted automatically at scene changes and/or regular intervals to preserve quality

50
Q

What are P and B frames?

A

Encoded by saving differences between it and key frames

P is predictive B is bidirectional

51
Q

What happens if the nitrate of a video is too slow?

A

Becomes pixelated

52
Q

What is CBR?

A

Constant bit rate,same but rate throughout the video

53
Q

What is VBR?

A

Variable bitrate , can vary up to a maximum, higher nitrates during fast paced scenes and lower when there is no motion

54
Q

What are some extensions associated with file containers?

A

.avi (audio video interface)
.mp4 (MPEG-4)
.mkv (matroska)

55
Q

What are some example codecs for videos?

A

HuffYUV (Huffman, YUV colour space), Lossless, Huffman encoding, compression ratios around 47%

MPEG-2(Lossy,temporal and spatial compression,Huffman encoding Compression ratios around 3.3%, Highly dependent on bitrate and other encoding options
H.264 (Lossy,temporal and spatial compression, frame prediction, Predicts the next frame using spatial and temporal information, compares with
the actual frame, saves only the difference,Compression ratios around 1.6%)

• H.265(HEVC)
• successor of H.264: further 50 % reduction of size, much more complex!
• Often drains battery faster
EECS1520 Digital Media

56
Q

A sound wave with a frequency of 2 kHz has a period of what? What is the general formula to solve this?

A

1/2000 sec

1/frequency

57
Q

What is not rate determined by?

A

Sampling rate and bit depth