Adobe Target Flashcards
A popular Travel and Hospitality website will occasionally change home page banner promotion for hotel rooms with seasonal deals and special rates for certain customers.
Choose the activity type that are best suited to meet the business needs of the above situation (Choose all that apply)
a) A/B test
b) Experience Targeting
c) recommendations
d) AP
e) Multivariate Test
b) Experience Targeting
d) AP
e) Multivariate Test
Consider the following:
A financial services mobile app has recently started optimizing there digital properties with Adobe Target. Their Android and iOS apps have been using a very stale splash page to welcome users and stakeholders doesn’t agree on the changes that should be made to the images and messaging on the page.
Choose the activity type that are best suited to meet the business needs of the above situation (Choose all that apply)
a) A/B test
b) Experience Targeting
c) recommendations
d) AP
e) Multivariate Test
a) A/B test
e) Multivariate Test
Consider additonal aspects of the same situation:
A financial services mobile app has recently started optimizing there digital properties with Adobe Target. Their Android and iOS apps have been using a very stale splash page to welcome users and stakeholders doesn’t agree on the changes that should be made to the images and messaging on the page.
Choose the best approach to configuring the activity:
a) MVT test with VEC
b) A/B test with VEC using custom code option
c) A/B testing using form based workflow
d) A/B testing with Target Classic
c) A/B testing using form based workflow
Mr. Singh has to setup a test to validate changes to two different elements of the home page which is receiving lots of traffic. Element A – Hero BannerElement B – Header Link In total, each of the elements had two versions including the default control version. Key stakeholders from the marketing team want to understand whether change in hero banner had a greater impact on the conversions than changing the header link? In this situation, which of the following test would be appropriate to identify the impact of elements.
a) Experience Targeting
b )A/B
c) MVT
d) Automated Personalization
c) MVT
Our client XYZ.com ran a campaign on website to improve their order conversion with 95% of the confidence. For the next year, client had estimated total # of orders 10,000. Based on the results of the existing test (Table below) they have decided to go ahead with winner. As a Target BP you are tasked to calculate the incremental number of orders for next year.
a 13,000
b 3,000
c 23,000
d I need more information for this.
b 3,000
You are currently running one MVT test where you have different offer combinations or discount which you would like to show to users at different paces on the page. You have configured and activated the campaign. One of your stakeholders saw one experience where users were seeing 2 contradicting offers. He raised this issue with your, what you will do or forget to do while configuring the test.
a It is expected behaviour in an MVT test
b You must have forgot to exclude the audience for that experience.
c You forgot to exclude the experience from ‘preview section’
d You forgot to exclude the experience within “Exclusion Group” section of test
c You forgot to exclude the experience from ‘preview section’
Boss at Travel company wants to increase the booking numbers. A product manager suggesting that we should have the Flight and Hotel booking module on Hero Banner, however, UX manager is saying that this will impact the user experience of the customers and will increase the bounce rate from the page.Which test type you would recommend in this scenario?
a MVT
b A/B Test
c Behavioural Targeting
d Recommendation
b A/B Test
The optimization team for a very hip and trend fashion blog want to improve the depth of the visit and page consumption of the site. Bounce rate of the website is very high and stakeholders are asking for improvements that will encourage visitors to read more articles, view additional slideshows, and watch more videos.As an optimization consultant, what will you suggest from below?
Run an experiment targeting test with various set of segments.
Run an AB test to find the best layout and then run Experience Targeting test
Run a recommendation Test
Run and MVT followed by a Recommendation test
Run a recommendation Test
A test was configured to show the experience for a new users who started his website journey from home.html with tablet device.
Below are 4 journey of 4 users, please choose who will be qualified for the experience?
- Paul entered on website via home.html using mobile phone and added products to the cart in past but never made a purchase.
- Simon is a new visitor and currently on home.html page of the website using Tablet devices and used paid search while landed at product.html page.
- Rose is using a tablet device and visited few videos of the brand on youtube in the past. She started her journey from home.html
- Charlie never visited the website in the past and started her journey on website first time from home.html using a mobile device.
Simon
Rose
Charlie
Paul
Rose
Mr. John, an optimization practice lead had setup an A/B test 2 weeks back, which had an estimated test duration of three weeks. One of the experience reached confidence 95%+. Stakeholders approved to stop the test and analyze the results. The test showed a 10% increase in overall orders. The sample size was reached, which was set to prove up to a 20% difference in revenue per visitor (RPV) The following effects were observed:• 10% increase in order rate• 3% increase in page views per visit• 3% increase in average order size• 10% increase in product views A stakeholder asks the consultant to annualize the impact on overall revenue projected through the next year to present as program ROI. How should the optimization consultant proceed?
Inform the stakeholder that the projected revenue would increase by 10% as the order rate is directly proportional to revenue
Inform the stakeholder that the projected revenue would increase by 3% as the order size is directly proportional to revenue
Inform the stakeholder that the projected revenue cannot be determined as the test was designed to prove RPV
Inform the stakeholder that the test would need to run two times as long to prove difference in RPV
Inform the stakeholder that the projected revenue cannot be determined as the test was designed to prove RPV
An A/B test is live since a week now. One of the stake holders mentioned that he is unable to see a particular experience and wants the BP to address the scenario. What is the quickest way for BP to verify if a particular experience is actually getting delivered?
Verify the Activity Preview page to validate if that particular experience is getting delivered.
Validate the experience delivery using a browser incognito mode.
Validate the reports to check if that particular experience has any data against it
Use Adobe Debugger VEC setting for quick validation of the experience.
Validate the reports to check if that particular experience has any data against it
Mr. Singh has setup an A/B test on the home page of a leading e-Commerce site to validate two different versions of a page element. Also there is global test running across the site which is not a key test for the top management as compared to the test setup on home page. What needs to be done by the optimization consultant to ensure that there is no conflict in the delivery of the content of both the tests? Select all that applies
Disable the global test as this is not a key test for stakeholders
Validate selector (elements on the page) collision
Validate priority levels for the test & ensure the home page test has priority over global test
Validate audience criteria
Validate selector (elements on the page) collision
Validate priority levels for the test & ensure the home page test has priority over global test
Validate audience criteria
You configured a test and running this test for a week time. First weekly report was sent to stakeholders and they found that visitors number in the report are lower then the expected numbers and saying the configuration of test is not correct. what you will do to ensure that everything is correct? Check that all apply.
Review the activity url and template rules
Validate the Audience setup
Pause this activity and re-activate to resolve any backend issue
Will do a browser functionality testing
Validate data with Analytics for the same dimension/segment
Review the activity url and template rules
Validate the Audience setup
Will do a browser functionality testing
Validate data with Analytics for the same dimension/segment
What are the key parameters required/recommended to implement the order confirmation mbox on the confirmation page.
1) orderId, orderTotal, productPurchaseId
2) orderNumber, revenue, productId
3) purchaseId, orderId, totalRevenue
4) order, units, & revenue
1) orderId, orderTotal, productPurchaseId
Your client is very advance in testing cycle and have been running multiple tests/section which are receiving high traffic. He submitted a test request that to be configured for a section where 3 more tests are currently running. He wanted to show the newly configured test for only customers who have not been exposed to any other test. What you should do to show this new test for anybody who hasn’t seen the previous test?
You will setup an experience targeting activity
You will create an audience with mBox call is not triggered
You will create an audience with “not in other test”
You will create an audience with “not in other test”
Based on the calculations derived using sample size calculator, Mr. Singh figured out that to run an A/B test on the campaign landing page to validate two different versions of CTA text would take 21 days. The activity was configured and was set to live. After two weeks it was assessed that the test duration is actually increasing and it would take more time than initially estimated. What are the possible reasons for increase in the test duration?
Under estimation of traffic numbers
Over estimation of traffic numbers
Increased estimated lift
Due to high volume of traffic observed while promoting special offers during the last two weeks
Over estimation of traffic numbers
An AP test was setup by Mr. Singh on the home page of a leading financial institution. The test audience included users from geo location North America & the configuration included variations across five different elements i.e. CTA, Hero Banner, Header Link, Footer Link, & Banner Message. After setting up the test Mr. Singh had shared the Preview URL links with leading marketing folks across each region to get a sign-off before going live with the activity. One of the stakeholders intended to validate the activity to understand whether someone from North America was actually qualifying for the test. What needs to be done in this case to meet the stakeholder expectation?
Preview URL shared will allow you to validate audience qualification by default
Set the activity to live with actual audience to validate
Set the activity to live with QA audience(URL param=”target”) to validate
Set the activity to live & use multiple audiences which includes QA & actual audience to validate.
Set the activity to live & use multiple audiences which includes QA & actual audience to validate.
Mr. Singh has setup an experience targeting test which has four different experiences. The activity went live last week and based on the observation from one of the key marketing folks, there was an issue where he was qualifying incorrectly. Below is the audience criteria along with the experience. How should the order of the experience-audience pair be configured while setting up the test?
Experience A Users coming from “Gurgaon” location
Experience B Users coming from “Haryana”
Experience C Users coming from “India”
Exp. B | Exp. C | Exp. A
Exp. C | Exp. B | Exp. A
Exp. A | Exp. C | Exp. B
Exp. A | Exp. B | Exp. C
Exp. A | Exp. B | Exp. C
“Recently viewed content”, “Recently watched videos”, “Most viewed Items across the site” & “Top selling products from across the site” represent an example of which of the following?
Search & Promote Recommendations
Recommendations Criteria
Target Classic Product Rules
Recommendations Criteria
Mr. Adam is an optimization consultant for a leading financial institution, who had setup an A/B test two weeks back. The test has reached significance which was designed to prove up to a 10% difference in orders at 95% confidence. The sample size was 50,000 visitors per variation. Based on the below results, what should Adam recommend keeping the primary KPI in mind.
Experience Visitors Orders Order Rate Lift Confidence
Control 23,075 846 3.666%
Experience B 23,085 1000 4.331% 18.3% 96%
Experience B is confidently better than Control. Use Experience B moving forward.
Continue to monitor change in lift until the lift observed is closer to estimated lift 10%.
Continue running the activity to set sample size because the results are inconclusive.
Divert 100% to experience B as the it is 96% confident of delivering 18.3% lift.
Continue running the activity to set sample size because the results are inconclusive.
While using Adobe Target Sample Size calculator, the optimization consultant derived that the expected traffic would be 10,000 visitors per experience per day. But when observed in the ongoing activity this wasn’t the case and the traffic numbers were 50% less than the expected numbers. What is the first activity that should be performed by the consultant?
Re-validate the input data & derive a new conversion rate using the sample size calculator
End the activity immediately to avoid any further incorrect reporting data
Re-validate the activity setup, metrics & ensure that data is getting into reports
Create a duplicate test, make the required metric level changes based on new conversion rate derived & end the previous activity.
Re-validate the activity setup, metrics & ensure that data is getting into reports
Mr. Singh has setup an A/B test on the home page of a leading e-Commerce site to validate two different versions of a page element. Also there is global test running across the site which is not a key test for the top management as compared to the test setup on home page. What needs to be done by the optimization consultant to ensure that there is no conflict in the delivery of the content of both the tests? Select all that applies
Disable the global test as this is not a key test for stakeholders
Validate selector (elements on the page) collision
Validate priority levels for the test & ensure the home page test has priority over global test
Validate audience criteria
Validate selector (elements on the page) collision
Validate priority levels for the test & ensure the home page test has priority over global test
Validate audience criteria
Automated personlization activity is recommended only for the ecommerce websites as this is heavily dependent on conversion data.
True
False
False
Mr. Smith, an optimization consultant had setup an A/B auto-allocate test three weeks back, which was planned to be run for 2 weeks. Due to over estimation of traffic during the initial phase, an additional week was required to reach the test completion based on pre-defined significance and sample size. The test showed a 10% increase in RPV, which was set to prove up to a 20% difference in number of orders The following effects were observed:
10% increase in order rate
3% increase in page views per visit
20% increase in number of orders
3% increase in average order size
10% increase in product views
A stakeholder asks the consultant to annualize the impact on projected orders for year 2018, which is estimated to be 160000 . How should the consultant proceed?
Inform the stakeholder that the projected incremental orders for 2018 would be 192000
Inform the stakeholder that the projected orders cannot be determined as the increase in RPV is less than the estimated lift 20% for number of orders
Inform the stakeholder that the projected orders for 2018 would be 192000
Inform the stakeholder that the projected orders for 2018 would be 32000
Inform the stakeholder that the projected orders for 2018 would be 192000
P should circulate the preview experience URL’s, so that stakeholders can validateMr. Singh has setup and A/B test to validate two different versions of campaign landing page on a leading cruise lines site. The audience criteria to qualify for this test is if the user is returning visitor with a prior booking on the site. The activity is planned to be live next week on PROD site and the stakeholders want to validate if the activity actually delivers the expected experience to the booked users. What needs to be done by BP to address the requirement?
BP should circulate the preview experience URL’s, so that stakeholders can validate
BP should setup QA audience and validate the content delivery on PROD
BP should setup QA audience combined with AND returning booked guest audience to validate the content delivery on PROD
BP can validate the delivery on staging site & assume the content will be delivered on PROD
BP should setup QA audience combined with AND returning booked guest audience to validate the content delivery on PROD
You configured a test and running this test for a week time. First weekly report was sent to stakeholders and they found that visitors number in the report are lower then the expected numbers and saying the configuration of test is not correct. what you will do to ensure that everything is correct? Check that all apply.
Review the activity url and template rules
Validate the Audience setup
Pause this activity and re-activate to resolve any backend issue
Will do a browser functionality testing
Validate data with Analytics for the same dimension/segment
Review the activity url and template rules
Validate the Audience setup
Will do a browser functionality testing
Validate data with Analytics for the same dimension/segment
BP wants to setup an A/B test across all the product detail pages. Sample URL for a product detail page is www.abc.com/products/men/123.html. How should the test be setup so that the correct audience qualifies for the test & meet the configuration requirements?
Create an audience ->current page URL contains www.abc.com/products
Create an audience ->landing page URL contains www.abc.com/products
Configure-> Page Delivery-> Setup template rule & URL include www.abc.com/products/men/123.html
A/B test can be setup only on a single page.
Create an audience ->current page URL contains www.abc.com/products
BP has created an AP test and is setting up the required audience segment for the activity. Audience criteria is dependent on Analytics variable eVar66 which has the bookingStatus of the user(booked/Non-booked). BP has created the audience with the below configuration. The expected content is not getting delivered on the page. What are the possible concerns?
Mbox parameter is not firing with the required Target global mbox request.
EVar66 is not enabled in Analytics configuration
EVar values cannot be mapped into Target for defining audience criteria
Mbox parameter is not firing with the required Target global mbox request.
