Amazon EMR | Debugging Flashcards

1
Q

How quickly does Amazon EMR retire support for old Hadoop versions?

Debugging

Amazon EMR | Analytics

A

Amazon EMR service retires support for old Hadoop versions several months after deprecation. However, Amazon EMR APIs are backward compatible, so if you build tools on top of these APIs, they will work even when Amazon EMR updates the Hadoop version it’s using.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

How can I debug my cluster?

Debugging

Amazon EMR | Analytics

A

You first select the cluster you want to debug, then click on the “Debug” button to access the debug a cluster window in the AWS Management Console. This will enable you to track progress and identify issues in steps, jobs, tasks, or task attempts of your clusters. Alternatively you can SSH directly into the Amazon Elastic Compute Cloud (Amazon EC2) instances that are running your cluster and use your favorite command-line debugger to troubleshoot the cluster.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is the cluster debug tool?

Debugging

Amazon EMR | Analytics

A

The cluster debug tool is a part of the AWS Management Console where you can track progress and identify issues in steps, jobs, tasks, or task attempts of your clusters. To access the cluster debug tool, first select the cluster you want to debug and then click on the “Debug” button.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

How can I enable debugging of my cluster?

Debugging

Amazon EMR | Analytics

A

To enable debugging you need to set “Enable Debugging” flag when you create a cluster in the AWS Management Console. Alternatively, you can pass the –enable-debugging and –log-uri flags in the Command Line Client when creating a cluster.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Where can I find instructions on how to use the debug a cluster window?

Debugging

Amazon EMR | Analytics

A

Please reference the AWS Management Console section of the Developer’s Guide for instructions on how to access and use the debug a cluster window.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What types of clusters can I debug with the debug a cluster window?

Debugging

Amazon EMR | Analytics

A

You can debug all types of clusters currently supported by Amazon EMR including custom jar, streaming, Hive, and Pig.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Why do I have to sign-up for Amazon SimpleDB to use cluster debugging?

Debugging

Amazon EMR | Analytics

A

Amazon EMR stores state information about Hadoop jobs, tasks and task attempts under your account in Amazon SimpleDB. You can subscribe to Amazon SimpleDB here.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Can I use the cluster debugging feature without Amazon SimpleDB subscription?

Debugging

Amazon EMR | Analytics

A

You will be able to browse cluster steps and step logs but will not be able to browse Hadoop jobs, tasks, or task attempts if you are not subscribed to Amazon SimpeDB.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly