5 Image visualization and enhancement Flashcards

1
Q

Perception of color

A

•Color perception takes place in the human eye and the associated part of the brain

•Tristimulus mode
–The retinas in human eyes have cones and rods.

•The knowledge of the Tristimulus phenomenon led to the development of color television screens and monitors
–Color screens are composed of a large number of small dots arranged in a regular pattern of groups of three (Red/Green/Blue)
–Color is created by mixing different amounts of Red/Green/Blue
–The mixing takes place in our brain.
–We get the same impression when we see yellow light as when we see a mixture of red and green.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Perception of color - Tristimulus mode

Cones

A
  • Cones are light-sensitive receptors that send signals to the brain when hit by photons in different parts of EM spectrum
  • There are three different types of Cones corresponding to red/green/blue lights.
  • The signal received by human brain gives a sensation of color.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Perception of color - Tristimulus mode

Rods

A
  • Rods sense brightness.
  • They can sense low-intensity light
  • Do not contribute to color vision
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Color spaces - RGB (Red/Green/Blue)

A

–Three colors are added: additive color scheme
–Light beams that are superimposed mix their colors additively
–Used in color television screens and monitors

–White: all three colors mixed equally
–Magenta: red and blue
–Yellow: red and green
–Cyan: green and blue

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Color spaces - YMC (Yellow/Magenta/Cyan)

A

–Three colors are subtracted: subtractive color scheme

–Each component acts like a filter that subtracts a primary color from whitelight
•Cyan = white - red
•Magenta = white - green
•Yellow = white - blue

–YMC color scheme is used in printers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Color spaces - IHS (Intensity/Hue/Saturation)

A

–A more natural reflection of our sensation of colors

–A color is described by three values
•Hue: name of color e.g. red, green, purple (degrees 0 360)
•Intensity : a color is light or dark (0 1)
•Saturation : description in terms of purity (percentage 0 100)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Image display thingy (1/2)…

A
  • A computer screen usually have a certain pixel depth (e.g. 8 bits)
  • When displaying an 8-bit gray scale image on a monitor with 8-bit pixel depth, a pixel having the value zero is displayed as black and a pixel having the value 255 will be shown as white
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Image display thingy (1/2)…

Single-band data are shown as

A

–Grey scale image e.g. Osh region, Kyrgyzstan, August 2016, SPOT-6

–Pseudo color image e.g. land surface temperature; land use & land cover

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Image display thingy (2/2)…

A
  • Computer screens usually have three channels, each fed by grey scale image
  • When we have multi-band imagery, any combination of bands can be used as input to the RGB channels of the monitor
  • The choice should be made based on the intended use of the RGB image

•Color composites
–True color composite
–False color composite
–Pseudo natural color composite

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Image display thingy (2/2)…

Color composites: True (natural)

A
–True color composite corresponds to how we see the world
–Vegetation appears green
–Water appears blue to black
–Snow and clouds appear white
–Bare soil appears light gray and brown
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Image display thingy (2/2)…

Color composites: False

A

–NIR –> R
–Red –> G
–Green –> B
–Vegetation appears in a red purple color

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Image display thingy (2/2)…

Color composites: Pseudo-natural

A

–Also called false-color composite

–Different pseudo-natural color composites can be formed for different applications

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Sentinel-2 band combinations

What do you know about Sentinel-2?

A

Sentinel-2, an optical remote sensing sensor, launched by the European space agency, is a constellation with twin satellites which carry sensors called multi-spectral instrument (MSI)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Sentinel-2 band combinations

True color composite (4,3,2)

fact 1/2

A

–Healthy vegetation: green

–Recently cleared vegetation: very light

–Unhealthy vegetation: brown and yellow

–Roads and urban features: white and gray

–Contrast can be low due to the scattering of blue light in the atmosphere

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Sentinel-2 band combinations

True color composite (4,3,2)

fact 2/2

A

–Clouds and snow appear white and difficult to distinguish

–Shallow water is not distinguished from soil

–Difficult to distinguish vegetation types

–Difficult to distinguish healthy vegetation from stressed vegetation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Sentinel-2 band combinations

The disadvantage of true-color composite (4,3,2)

A
  1. high scattering in blue spectrum resulted in low contrast image
  2. Cant distinguish between cloud and snow
  3. It is difficult to distinguish healthy vegetation in true-color image
17
Q

Sentinel-2 band combinations

False color composite (5,4,3)

fact

A

–Usually called Color Infrared
–Chlorophyll has a high reflection in NIR and low reflection in visible bands

  • Vegetation: shades of red
  • Soils: dark to light brown
  • Urban areas: cyan/yellow/grey
  • Water: dark blue
18
Q

Sentinel-2 band combinations

The advantage of False color composite (5,4,3)

A

Esier to distinguish different types of vegetation than in true color composite

19
Q

Sentinel-2 band combinations

Pseudo natural color composite (11,8,2)

fact

A

–Chlorophyll has a high reflection in NIR

–High reflectance in SWIR1 when water content is low.

–Vegetation: shades of green

*notes
Healthy vegetation = band blue and SWIR1 (red) small, NIR 1 (green) big. So healthy vegetation appears green

20
Q

Sentinel-2 band combinations

The advantage of Pseudo natural color composite (11,8,2)

A

Easier to distinguish different types of vegetation than in true color composite

21
Q

Image enhancement

A

•Histogram operations
–Global contrast enhancement
–Location of pixels are not important

•Filter operations
–Enhancing some aspects of the image and suppress other aspects
–Based on neighboring pixel values

22
Q

Image histogram

A
  • A histogram describes the distribution of pixel values in a band of an image
  • without considering the location of pixels
23
Q

A histogram can be summarized by descriptive statistics

A

–Minimum and maximum

–Mean
•Average of all pixel values
•Does not necessarily coincide with the most frequent value

–standard deviation (low std means histogram not spread all over the certain range of an image)
•Indicates the spread of the DNs around the mean
•Small standard deviation: narrow histogram, low contrast

–n% and 100 n% values

24
Q

Image enhancement

Histogram operations

A
  • Remote sensors are designed to detect a wide range so they are capable of measuring different illuminations/emission conditions
  • The full range is not always given within one particular scene

•Gray scale transformation stretches the histogram over the entire range to achieve a better visualization
–Linear contrast stretch
–Histogram equalization

25
Q

Image enhancement

Histogram operations: Linear contrast stretch

A
–Cut off values are selected
•Values higher/lower than cut off values are considered as noise
•Min/Max from the data
•N% cut off
•mean NxStd

–Values are linearly transferred in a way that selected cut off values become 0/255

–Straightforward method for contrast enhancement

–Works best when the input image has a narrow histogram, but close to a uniform distribution

26
Q

Image enhancement

Histogram operations: Histogram equalization

A

–Nonlinearly transforms the values in a way that spreads out the most frequent intensity values

–Histogram equalization improves the global contrast of the image Histogram operations

27
Q

Image enhancement

Filter operations - applications

A

–Enhance image e.g. reduce noise (low pass filters) or sharpen a blurred image (high pass filters)

–Extract features e.g. edges and lines

28
Q

Image enhancement

Filter operations - image filters

*note
Filtering is usually carried out on a single band

A

–Defined through a kernel

–The kernel is moved through the image

–A new value is calculated for each pixel as a linear combination of itsneighboring pixels.

–The kernel defines the size of neighborhood to be considered

29
Q

Image enhancement Filter operations

Moving average filter

A

–Calculates the local average of pixels within a kernel around each pixel

–Does not need to be square

–Is used to smooth the image

30
Q

Image enhancement Filter operations

Gaussian filter

A

–Is used to smooth the image

–An approximation of Gaussian function

–Gives less weight to pixels further away from the center

–Is used to smooth the image

31
Q

Sharpening

A
  • Smooth filter the image
  • Subtract the smoothed image from the original to highlight the details
  • Add the details to the original image

original - smoothed = detail
original + detail = sharpened

32
Q

Image enhancement Filter operations

Median filter

A

–The median of all values within a kernel is assigned to the pixel

–Useful in reducing random noise

33
Q

Image enhancement Filter operations

Sobel edge detection

A
–Approximate derivatives in two directions
# Hx Horizontal kernel ->  if we have short change in horizontal direction, it can be detected by this Hx Horizontal Kernel
# Hy Vertical kernel -> If we have high derivatives in the vertical direction, it can be detected by Hy vertical kernel

–Gradient magnitude is estimated from the gradient approximations
G = (Gx^2 + Gy^2)^0.5

34
Q

Image enhancement Filter operations

Sobel edge detection note

A

Before applying Sobel edge detection, we apply smoothing filter (Gaussian filter) on the original image. Because Sobel edge detection is sensitive to any changes in the image