Streaming Analytics Windowing Functions

Question 1

There are five kinds of temporal windows to choose from…

Answer 1

Tumbling,Hopping,Sliding,Session, andSnapshotwindows

Question 2

You use the window functions in the…….. of the query syntax in your Stream Analytics jobs.

Answer 2

GROUP_BY clause

Question 3

You can also aggregate events over multiple windows using the….

Answer 3

Windows() function

Question 4

All thewindowingoperations output results at the….of the window

Answer 4

End

Question 5

Note that when you start a stream analytics job, you can specify the…..and the system will automatically fetch previous events in the incoming streams to output the first window at the specified time; for example when you start with theNowoption, it will start to emit data immediately. The output of the window will be a ….. The output event will have the time stamp of the …. of the window and all window functions are defined with ……

(hint: when you start? how do you start?)
(hint: what do streaming windows capture?)
(hint: start or end)
(hint: all window functions last for a specific amount of time or …)

Answer 5

Job output start time

single event based on the aggregate function used.

end

a fixed length

Question 6

SELECT System.Timestamp() as WindowEndTime, TimeZone, COUNT(*) AS Count
FROM TwitterStream TIMESTAMP BY CreatedAt
GROUP BY TimeZone, TumblingWindow(second,10)

Will return?

Answer 6

WindowEndTime TimeZone Count

Example:
2021-10-26T10:15:10 - PST - 5
2021-10-26T10:15:20 - PST - 2

Question 7

Tumbling window

Tumblingwindow functions are used to segment a data stream into …. and perform a function against them.

The key differentiators of a Tumbling window are that they repeat, do not overlap, and an event cannot belong to more than one tumbling window.

Answer 7

distinct time segments

Question 8

Tumbling window

Tumblingwindow functions are used to segment a data stream into distinct time segments and perform a function against them.

The key differentiators of a Tumbling window are that they …

Answer 8

repeat, do not overlap, and an event cannot belong to more than one tumbling window.

Question 9

Hopping window

Hoppingwindow functions hop … by …. It may be easy to think of them as Tumbling windows that can overlap and be emitted more often than the window size. Events can belong to more than one Hopping window result set. To make a Hopping window the same as a Tumbling window, specify the hop size to be the same as the window size.

Answer 9

hop forward in time

a fixed period

Question 10

Hopping window

Hoppingwindow functions hop … by …. It may be easy to think of them …. Events can belong to more than one Hopping window result set. To make a Hopping window the same as a Tumbling window, …

Answer 10

hop forward in time

a fixed period

as Tumbling windows that can overlap and be emitted more often than the window size

specify the hop size to be the same as the window size.

Question 11

Hopping window

Hoppingwindow functions hop forward in time by a fixed period. It may be easy to think of them as Tumbling windows that can overlap and be emitted more often than the window size. Events can belong to more than one Hopping window result set. To make a Hopping window the same as a Tumbling window, …

Answer 11

specify the hop size to be the same as the window size.

Question 12

SELECT System.Timestamp() as WindowEndTime, Topic, COUNT(*) AS Count
FROM TwitterStream TIMESTAMP BY CreatedAt
GROUP BY Topic, HoppingWindow(second,10,5)

Answer 12

WindowEndTime - Topic - Count

2021-10-26T10:15:10 - Streaming - 5
2021-10-26T10:15:15 - Streaming - 3
2021-10-26T10:15:20 - Streaming - 2

Question 13

Sliding window

Slidingwindows, unlike Tumbling or Hopping windows, output events only for points in time when the …. In other words, when an event enters or exits the window. So, every window has at least one event. Similar to Hopping windows, events can belong to more than one sliding window.

Answer 13

content of the window actually changes

Question 14

Sliding window

Slidingwindows, unlike Tumbling or Hopping windows, output events only for points in time when the content of the window actually changes. In other words, when an event …. So, every window has at least one event. Similar to Hopping windows, events can belong to more than one sliding window.

Answer 14

enters or exits the window

Question 15

Sliding window

Slidingwindows, unlike Tumbling or Hopping windows, output events only for points in time when the content of the window actually changes. In other words, when an event enters or exits the window. So, every window has …. Similar to Hopping windows, events can belong to more than one sliding window.

Answer 15

at least one event

Question 16

SELECT System.Timestamp() as WindowEndTime, Topic, COUNT() AS Count
FROM TwitterStream TIMESTAMP BY CreatedAt
GROUP BY Topic, SlidingWindow(second,10)
HAVING COUNT() >=3

Will output?

Answer 16

Question 17

Session window

Sessionwindow functions group events that arrive at…, filtering out periods of time where …. It has three main parameters: timeout, maximum duration, and partitioning key (optional).

Answer 17

similar times

there is no data.

Question 18

Session window

Sessionwindow functions group events that arrive at…, filtering out periods of time where …. It has three main parameters: timeout, maximum duration, and partitioning key (optional).

A session window begins when the ….. If another event occurs within the specified timeout from the last ingested event, then …. Otherwise if no events occur within the timeout, then the window is closed at the timeout.

Answer 18

similar times

there is no data.

first event occurs

the window extends to include the new event.

Question 19

Session window

A session window begins when the ….. If another event occurs within the specified timeout from the last ingested event, then …. Otherwise if no events occur within the timeout, then the window is closed at the timeout.

If events keep occurring within the specified timeout, the session window will keep extending until …. The maximum duration checking intervals are set to be the same size as the specified max duration. For example, if the max duration is 10, then the checks on if the window exceed maximum duration will happen at t = 0, 10, 20, 30, etc.

Answer 19

first event occurs

the window extends to include the new event.

until maximum duration is reached.

Question 20

Session window

Sessionwindow functions group events that arrive at similar times, filtering out periods of time where there is no data. It has three main parameters: timeout, maximum duration, and partitioning key (optional).

A session window begins when the ….. If another event occurs within the specified timeout from the last ingested event, then …. Otherwise if no events occur within the timeout, then the window is closed at the timeout.

Answer 20

first event occurs

the window extends to include the new event.

Question 21

Session window

Sessionwindow functions group events that arrive at similar times, filtering out periods of time where there is no data. It has three main parameters: timeout, maximum duration, and partitioning key (optional).
.
.
.
When a partition key is provided, the events are …. is applied to each group independently. This partitioning is useful for cases where you need different session windows for different users or devices.

Answer 21

grouped together by the key and session window

Question 22

SELECT System.Timestamp() as WindowEndTime, Topic, COUNT(*) AS Count
FROM TwitterStream TIMESTAMP BY CreatedAt
GROUP BY Topic, SessionWindow(second,5,10)

Will return …

Answer 22

WindowEndTime Topic Count

2021-10-26T10:15:09 - Streaming - 2
2021-10-26T10:15:24 - Streaming - 4

Question 23

Snapshot window

Snapshotwindows group events that have the… . Unlike other windowing types, which require a specific window function (such asSessionWindow() for example), you can apply a snapshot window by adding System.Timestamp() to the GROUP BY clause.

Answer 23

the same timestamp

Question 24

Snapshot window

Snapshotwindows group events that have the the same timestamp. Unlike other windowing types, which require a specific window function (such as…, you can apply a snapshot window by adding System.Timestamp() to the GROUP BY clause.

Answer 24

SessionWindow()) for example

Question 25

Snapshot window

Snapshotwindows group events that have the the same timestamp. Unlike other windowing types, which require a specific window function (such asSessionWindow() for example), you can apply a snapshot window by …..

Answer 25

adding System.Timestamp() to the GROUP BY clause

Question 26

SELECT System.Timestamp() as WindowEndTime, Topic, COUNT(*) AS Count
FROM TwitterStream TIMESTAMP BY CreatedAt
GROUP BY Topic, System.Timestamp()

Will return…

Answer 26

WindowEndTime Topic Count

2021-10-26T10:15:04 - Streaming - 4
2021-10-26T10:15:10 - Streaming - 2

Question 27

Tumbling window

Tumblingwindow functions are used to segment a data stream into distinct time segments and perform a function against them.

The key differentiators of a Tumbling window are that they …, …., and ….

Answer 27

repeat, do not overlap and an event cannot belong to more than one tumbling window.

Question 28

What is the difference between hopping window function and tumbling window function?

Answer 28

The hopping window is similar to the tumbling window, except that it is not contiguous. It aggregate events with a fixed time sized window, but you can choose to update that information in another time frame. Another example: “Every 20 minutes, give me the number of pizza orders I got in the last 10 minutes”.

Question 29

What is the difference between tumble window and sliding window?

Answer 29

What is the difference between tumble window and sliding window?
The main difference between these windows is that, Tumbling windows are non-overlapping whereas Sliding windows can be overlapping.

Question 30

What is Session window?

Answer 30

A session window begins when the first event occurs. If another event occurs within the specified timeout from the last ingested event, then the window extends to include the new event. Otherwise if no events occur within the timeout, then the window is closed at the timeout.

Question 31

What is a Snapshot window?

Answer 31

Snapshot windows groups events that have the same timestamp. Unlike other windowing types, which require a specific window function (such as SessionWindow(), you can apply a snapshot window by adding System.

Question 32

Tumbling ….
Hopping is simlar to …..
Sliding…

Answer 32

Tumbling repeats at a non-overlapping interval. Como escalera en cada intervalo de tiempo, no se pisan

Hopping is simlar to tumbling, but hopping generally has an overlapping interveral. Cada cierto X tiempo va tomando fotos haya o no eventos, puede hacer overlap de eventos. Tiene un Hop o salto para ir revisando X segundos hacia atras.
Example:
A 10 second Hopping Window with a 5 second “hop”
Every 5 seconds give me the count of tweets over the last 10 seconds

Sliding triggers at regular time intervals. Cada X segundos va revisando si hay un nuevo evento, si es asi abre una ventana nueva q puede abarcar los eventos anteriores