Final Exam

Question 1

True or False, Topic Modeling is an unsupervised learning technique

Answer 1

True

Question 2

True or False, Singular Value Decomposition (SVD) aims to address skewed frequency of terms

Answer 2

False

Question 3

True or False, If a model performs indistinguishably from a random value, its AUC will be closer to zero

Answer 3

False

Question 4

True or False, Mutual information ensures better predictive performance when it is available than no weight option in SAS Enterprise Miner

Answer 4

False

Question 5

What is the incorrect answer about weightings in text filtering?

a) Term weights are consistent across documents
b) Inverse document frequency depends on the distribution of terms across documents
c) Log transformation for local weights reduces the impact of term frequency more than binary and linear options
d)Mutual information requires a categorical target variable

Answer 5

Inverse document frequency depends on the distribution of terms across documents

Question 6

Zipf’s law can be interpreted as follows: “The product of the frequency of words (f) and their rank is approximately constant.” Let a be the product of the frequency and rank. What is the incorrect answer?

a) In(f) = In(a) - In(r)
b) The frequency of the terms exponentially decreases with rank
c) Hypothetically, the second most prevalent word appears twice as frequently as the fourth frequent word.
d) Topmost frequent words are likely to be good discriminators

Answer 6

Topmost words are likely to be good discriminators

Question 7

Quiz 1, Question 9, see slide

Answer 7

Correct!

Question 8

Write a text filter in SAS Enterprise Miner to return all documents having the term “White House” and not including “Canada.”

Answer 8

“White House” -Canada

Question 9

Provide a possible situation where you might prefer interpretability over predictive power?

Answer 9

In situations where you are presenting to executives or a operational or business audience.

Question 10

Quiz 1, Question 12, see slide on Lecture 5

Answer 10

Correct!

Question 11

True or False - When you’re interested in a small set of terms in text mining, specifying a stop list will be more effective than specifying a start list

Answer 11

False

Question 12

True or False, The skip-gram model aims to predict context words using a target word

Answer 12

True

Question 13

True or False, In a long short-term memory (LSTM) model, you determine how much information from previous hidden states and the current state information should be retained through a forget gate

Answer 13

True

Question 14

True or False, The Bidirectional Encoder Representations from Transformers (BERT) model has both an encoder and a decoder

Answer 14

False

Question 15

True or False, In training machine learning algorithms, you can overcome high bias by collecting a large number of data points

Answer 15

False

Question 16

Explainable machine learning indicates that your model can be understood by a human without further technical support

Answer 16

False

Question 17

This is a set of co-occurrence probabilities for target words “ice” and “steam” in the GloVe model. According to the results, the term “gas” is more effective in distinguishing between “ice” and “steam” than the term “water”

Question 18

Choose the incorrect answer about embedding models:

A. Bag of words can be considered a special case of the n-gram model
B. A bigram model considers one previous word to predict a word’s probability
C. GloVe learns embedding from global context via a word-word co-occurrence matrix
D. TF-IDF can handle unseen words by leveraging the context in which they appear in the document corpus

Answer 18

D.

Question 19

Choose the incorrect answer about the structure of deep learning models.

A. Bias plays a similar role to that of y-intercept in the linear equation
B. Weights are used to introduce non-linearity in the model
C. Inputs can be viewed as features or attributes in a data set
D. The work of the summation is to bind the weights and inputs together and calculate their sum

Answer 19

B.

Question 20

Choose the incorrect answer about the structure of deep learning models

A. Bias plays a similar role to that of y-intercept in the linear equation
B. Weights are used to introduce non-linearity in the model
C. Inputs can be viewed as features or attributes in a dataset
D. The work of the summation function is to bind the weights and inputs and calculate their sum

Answer 20

B.

Question 21

Choose the incorrect answer about Recurrent Neural Networks (RNNs) and their extensions.

A. RNN retains a memory, which is a distinct characteristic from a basic neural network
B. RNNs are more suitable for handling spatial data rather than sequential data
C. The long short-term memory model is intended to overcome the vanishing gradient problem of RNNs
D. Unlike RNNs, the transformer can effectively deal with dependencies between terms with long distances in the input sequence due to the attention mechanism.

Answer 21

B.

Question 22

Choose the incorrect answer about the Transformer model and its extensions.

A. An encoder is a to process the input while a decoder generates the output
B. Parallelization enables the transformer to save training times more compared to recurrent neural networks.
C. Unlike the original transformer, BERT introduced positional encodings to maintain word order information.
D. Pre-training and fine-tuning enable data scientists with limited computing resources to build a high-performing model

Answer 22

C.

Question 23

Choose the incorrect answer about fairness issues in machine learning

A. Machine learning algorithms can generate discriminatory outcomes even without the developer’s intention.
B. The high accuracy of a model guarantees fair algorithms to users.
C. Algorithms can learn bias embedded in their training dataset
D. Even if a predictive model for advertising didn’t learn human bias, its advertising outcomes can be biased due to market mechanisms

Answer 23

B.

Question 24

Choose the incorrect answer about interpretable and explainable machine learning

A. Higher performing models tend to be less interpretable
B. The goal of permutation importance technique is to understand how the model works.
C. Linear regression is considered one of the interpretable machine learning models
D. The objective of shuffling values in permutation importance is to remove the contribution of the independent variable

Answer 24

B.