3b. Multiple Choice for Metrics & Analytics Flashcards
Question #1: An employee tells you in a presentation that your customer base typically buys 40% of your offerings. This metric is called:
- Share of wallet
- Return on investment
- Attrition
- Product penetration
Correct Answer:
Product penetration
Explanation: Product penetration is the percentage of your product line (offerings) that a customer is buying. Share of wallet is the percentage of the customers’ total spending that he/she is spending with your company. Return on investment is the percentage of increased value gained by investing in something. Attrition is the percentage of turnover or churn or non-renewals or lost customers.
Question #2: What is the Net Promoter Score when 30% of survey respondents are promoters, 40% are passive, and 30% are detractors?
- 70%
- 10%
- 0%
- -10%
Correct Answer:
0%
Explanation: 30% promoters minus 30% detractors = 0%
Question #3: A new technology will cost $500,000 and it is expected to increase sales by $750,000. What is the ROI?
- None of the above
- 150%
- 50%
- 75%
Correct Answer:
50%
Explanation: ROI = [(gain from investment - cost of investment) / cost of investment] = [(750,000 - 500,000) / 500,000] = 250,000 / 500,000 = 50%
Question #4: A double-barreled question makes [xxxxx] weak.
- Vaildity
- Reliability
- Confidence
- Standard deviation
Correct Answer:
Vaildity
Explanation: Validity is lost when your data does not measure what it is meant to measure. A double-barreled question has two elements, so you do not know which element the customer is rating.
Question #5: Top box scores are useful in customer experience management to:
- Show managers how many customers selected the highest rating
- Identify the value of resolving customers’ chronic issues
- Quantify customer churn and customer lifetime value
- Refine Net Promoter Scores
Correct Answer:
Show managers how many customers selected the highest rating
Explanation: . Top box = the highest point on a survey rating scale. Top 2 boxes = the 2 highest points, e.g. 9 and 10 for a 10-point – or 4 and 5 for 5-point scales. Bottom box is the opposite: the lowest point. (Detractors represent a bottom-7-box summary, and Promoters represent a top-2-box summary.)
Question #6: [xxxxx] data shows what happened and [xxxxx] data shows why.
- Operational, customer
- Quantitative, descriptive
- Descriptive, quantitative
- Customer, operational
Correct Answer:
Operational, customer
Explanation: Operational data shows what happened. Ask customers to find out why.
Question #7: Which customer experience metric will influence managers the most?
- Trends of key drivers of loyalty and comparisons across business units
- Revenue at-risk or at-opportunity related to groups of customers dissatisfied or satisfied with a key driver of loyalty
- Net Promoter Score and revenue growth rate comparisons to others in the same industry
- Survey ratings and Net Promoter Score
Correct Answer:
Revenue at-risk or at-opportunity related to groups of customers dissatisfied or satisfied with a key driver of loyalty
Explanation: Showing customer experience data within the context of company financial data is compelling to managers and helps them see why and how they can make a difference. (it hints about probability of managers’ future success; everyone wants more budget)
Question #8: A comprehensive customer experience dashboard contains:
- Summarized customer ratings of critical moments of truth
- Summarized customer behavior data, such as penetration, lifetime value, engagement, share of budget
- Progress metrics of action plans tied to customer behavior and ratings improvement initiatives
- All of the above
Correct Answer:
All of the above
Explanation: Ideally all of these are included in one dashboard. Connect the dots, with high visibility, between what employees do, what customers think, what customers do, and how much the company is growing.
Question #9: Which of the following metrics is about customer perceptions?
- Sentiment
- Churn
- Response rate
- Engagement
Correct Answer:
Sentiment
Explanation: Sentiment is about positive and negative feelings. Engagement is about interaction. Churn is about turnover or loss (stop buying). Response rate is about survey participation.
Question #10: When your CEO asks you to show how customer perception data is related to revenue, you should:
- Compare ratings trends to share of budget (i.e. wallet) trends
- All these answers are effective links between perceptions and revenue
- Look for patterns among key driver ratings, relationship length, purchase trends, and your company’s operational performance among all customers or groups of customers
- Compare ratings and purchase volume of individual responses last year versus this year
Correct Answer:
All these answers are effective links between perceptions and revenue
Explanation: Finding patterns in VoC combined with operational and financial data will be more convincing to executives than VoC alone.
Question #11: Which one of these does NOT affect validity?
- Mixed interpretations of scales
- Mixed interpretations of phrases
- Low sample size
- Double-barreled questions
Correct Answer:
Low sample size
Explanation: Low sample size affects statistical significance, or confidence. The other 3 choices affect validity.
Question #12: After you call Customer Service for something you bought, you are asked how difficult it was to get the help you needed. This is an example of:
- NPS
- Customer Health Score
- Customer Effort Score
- CSAT
Correct Answer:
Customer Effort Score
Explanation: Customer Effort Score asks: “The company made it easy for me to handle my issue: Strongly Agree, Agree, Slightly Agree, Slightly Disagree, Disagree, Strongly Disagree.
Question #13: Statistical significance is also known as confidence because:
- You must avoid double-barreled questions
- Your scales and words must be interpreted the same way by all participants
- Your findings must be stable for this time period
- Your sample must accurately reflect the population
Correct Answer:
Your sample must accurately reflect the population
Explanation: Confidence = Statistical Significance = p-value = your sample reflects the population.
Question #14: What is the retention rate? 1000 customers January 1st, 1200 customers March 31st, 300 customers acquired.
- 10%
- 90%
- 30%
- 70%
Correct Answer:
90%
Explanation: Customer Retention = (customers at the end of the time period minus customers acquired) divided by customers at the beginning of the period. (1200 - 300) / 1000 = 900 / 1000 = 90%.
Question #15: Text mining, voice mining, and video mining are possible via this technology:
- Natural language programming (NLP)
- Customer Lifecycle Management (CLM)
- Net Promoter System (NPS)
- Enterprise feedback management (EFM)
Correct Answer:
Natural language programming (NLP)
Explanation: NLP allows computers to understand human language (text, audio, vide).
Question #16: 1 minus the margin of error is:
- Repeatability
- Confidence interval
- Confidence, or statistical significance
- Validity
Correct Answer:
Confidence interval
Explanation: Confidence interval = 1 minus the margin of error, or the percentage likelihood that a data point is accurate, or the number of times the data point would be true if you repeat your study 100 times.