Section 4 Flashcards
_______. _______ Is an incredibly valuable component of the design process, and it’s something that will likely come up more than once in various stages of the process?
Evaluative research
What will you want to run as you refined and iterate your designs?
Multiple usability test
Utility?
The features and functionality needed to complete important task
Usability?
How easy your project features are to use, as well as whether they bring satisfaction
Useful= what?
Useful= usability + utility. For something to be useful, it must address the functional and emotional requirements expressed by your target audience during research
The only way to find out if they design is useful for others is to?
Is to test it with valid evaluative of research methods
In addition to designing useful and usable products and services, they must also be?
They must also be desirable, accessible, credible, and findable to deliver real value to real people. Sound familiar?
With UX design what is the research method which is similar to the scientific method?
In design, we start by asking questions and identifying a problem, then we create a hypothesis often in the form of a prototype, and, finally, we conduct various iterations of evaluate of testing to analyze the usefulness of the thing we’ve designed.
Informed consent?
Informed consent is the process of helping research participants make an educated decision as to whether they want to take part in your research. Informed consent describes the nature, intent, and details of your study to participants allowing them to make a conscious decision on whether or not they want to participate
In addition to informed consent, you’re also want to tell your participant what?
Whether they will be recorded and how that recording will be used
When conducting a usability test, make sure your participants understand what?
Understand that you are Not testing them or their capabilities, but rather your design.
Assure the participants that there is a what?
Assure them that there is no way for them to sell, and that if they can’t complete a task, it’s simply the fault of the designer
What is the main point of performing usability test?
Highlighting and catching your own mistakes as a designer
Ideally, when outlining your research and recruiting participants, you want to find people who are what?
Who are different from you. In fact, testing edge cases of your design with participants who vary greatly from yourself/your typical target audience often creates incredibly insightful results, especially if there’s a known or unknown subset of users who might end up engaging with your design beyond your primary persona
While it is most important to test with your primary persona, ensuring that you run some usability test with who?
With those dissimilar to you or your persona is a good way to ensure your designs are useful to as broad and audience as possible. This will also help you avoid general research issues such as sampling bias, which causes errors in Results due to a non-random selection of test participants
Third party online services?
Third-party online services help recruit participants using a specific demographic information such as age, gender, and location. Test are often online and unmoderated, and results are delivered as a report or video. Usability testing, users zoom, and usability hub or a few
Amazons mechanical Turk?
Amazons mechanical Turk is useful if you need to recruit a high volume of participants at a low cost. It allows you to set up a test and pay anonymous people a small amount to complete quick tasks
Classified advertisements?
Search is Craig list or local classifieds might be a good place to find local participants. Panel agencies such as research now have large databases of potential participants available for unmoderated test. Cost range between $15 and $55 per response
When contacting potential participants you don’t know, it’s extra critical that you do what?
It’s extra critical that you introduce yourself and the project properly and explain the expectations and incentos for the test participant the circumstances of the project may vary, but in general, there are a few types of common templates/messages researchers used to contact potential participants. usability.gov is a great place to look for recruitment, confirmation, and reminder email templates
List five tips for writing effective templates/messages?
Keep your messages brief. Format your message for easy reading. Use simple language. Clearly explain the expectations of the study. Highlight the incentives. Make the Recipients desired action clear
What do we conduct interviews and card sorts for?
To explore user needs and decided on the features and functionality needed to accomplish specific goals
What do the features in a prototype provide?
These features provide the utility necessary for something to be useful. Assuming you have successfully determined and built the features you need through your generative research methods, we can now isolate the other important variable in the equation/usability
Usability?
His ability refers to the ease with which people can use your product or experience. In order to test a products use ability, we conduct useability test
Usability?
Usability refers to the ease with which people can use your product or experience. In order to test a products usability, we can ducks usability test.
Usability testing?
Usability testing refers to a collection of methods that design researchers use to measure and improve usability. Usability testing comes in all shapes and sizes.
List three things that all methods have in common?
Test participants that represent a subset of the audience you are designing for. A realistic set a task for participants to attempt. Users actions and thoughts recorded as data.
Utility?
Whether it provides the features you need
Usability?
How easy and pleasant these features are to use
Useful?
Usability + Utility
List two types of generative research methods?
Interviews. Card sorts.
Give the reason for conducting interviews and card sorts?
Now that you have a working hypothesis and something to evaluate your prototype, let’s take a look at the other half of the research spectrum which is what?
Evaluate of research methods
Quantitative data, for example, is incredibly useful win?
It is incredibly useful in determining the magnitude and degree of behaviors and attitudes, but it does not always give us insight into the why or how to fix the problem. Likewise there are stages when researching what people say is more important than researching what people do and vice versa. Everything depends on the situation at hand.
Context of use?
Is the third dimension of the graph, referring to the context in which we gather information from people. Context abuse can be incredibly important depending on the nature of the problem you are trying to solve. If you are designing technology to help engineers install satellites on top of skyscrapers, for example, the context of use might be critical as it’s a highly unique circumstance. In such cases, it might be useful to observe natural used to better understand the environment.
Eye tracking?
Org gazing tracking, is the process of measuring either the point of gays, where one is looking or the motion of an eye relative to the head. The image above shows how a user typically scans a website. And I tracker is a device for measuring I positions and I’m movement and can be configured to measure precisely where participants look as they perform task or interac naturally with websites, applications, physical products, or environments.
Pros of eye tracking?
Eye tracking can be useful in determining the location of specific events. It is possible to use remote versions to track mouse movement with the hypothesis that mouse movement closely correlates to I movement, but it can be difficult to glean accurate insights from large groups.
Cons of a tracking?
Eye tracking Equipment can be incredibly complex and difficult to calibrate. It is possible to use remote versions to track mass movement with the hypothesis that mouse movement closely correlates to IM movement, but it can be difficult to Glenn Acura insights from a large group
When to use eye tracking?
Sophisticated organizations with adequate funding and expertise can employ eye Tracking as additional data to inform their design decisions. Heat maps the aggregate a movement or mouse movement can provide a useful snapshot of activity to help inform design.
Ethnographic field studies?
Involve observing participants in their natural environment. You might notice a sound similar to gorilla testing, which we discussed in the previous exercise, however, gorilla testing tends to focus on the functionality of the system in question, well ethnographic field studies tend to focus on the test participants personal attitudes, behaviors, and environments
Pros of ethnographic and field studies?
The studies can yield incredible rich information about not only behavior and attitude with a product or service, but a participants general habits and environment, as well. Given the time and funding, it can yield valuable information about your customers that you would miss out on by focusing simply on the product and it’s usability
Cons of ethnographic field studies?
Test can be expensive from both a time and a financial standpoint
When to use ethnographic field studies?
Given sufficient time in funding, he studies can be a great step towards designing more accurately for highly specific context and use cases.
A/B testing?
Also known as live testing, Bucket testing, or split testing, is a method of scientifically testing different designs on a site by randomly assigning groups of users to interact with each of the different designs and measuring the affect of these assignments on user behavior. You could test, for example, multiple versions of a sign-up process for your site, multiple email layouts for your newsletter, or the success of text versus video in an online tutorial. When more than two choices are necessary, researchers my also use a similar process called Multivariate testing
Pros of a/B testing?
Quantitative results provide definitive direction so long is the test set up and results analysis are sound
Cons of a/B testing?
There must be significant traffic and usage of your product or service in order to garner useful data, and it can take a long time to gather enough data to reach statistically powered results. This means that you need a larger number of participants to be able to generate plausible test results. Expertise in data science is also required to make an accurate decision as to statistical significance and power
L When to use a/B testing?
For products or services with significant traffic in usage that also have teams with expertise in setting up a/B test and Downloading results
Five second tests?
Are used to determine whether a particular webpage or app screen does a good job of getting its core message across. For example, if you have a webpage of which the main purpose is to have visitors sign up for a newsletter, you could use a five second test to determine whether the users recognize that this page was asking them to sign up for a newsletter
Another name for five second test?
Memory test
Pros of five second test?
A five second test is quick and easy to run. You just need a representation of the website or app screen you’d like to test, which can be anything from a paper prototype to a high fidelity market, and a set of questions you would like to ask users about what they remember from looking at the screen. Users are then Shown the screen for five seconds and asked to prepare a set of questions before the screen is covered or switched to a different one
Cons of five second test?
Five second test are not well suited for screens that have multiple functions is they will be difficult for users to assess in such a short space of time, and different users are likely to focus on different functions features, leading to inconclusive results
When to use five second test?
Five second test our best Suited to testing screens that have a single primary purpose such as signing up for a service or downloading a piece of software
Usability testing refers to what?
Refers to a collection of methods that design researchers use to measure and improve usability. It’s a type of evaluate of research used to measure they use ability of your design by testing and interactive version of the design with users
What is usability testing?
It is a technique used by UX designers, design researchers, and interaction designers to evaluate the utility and use ability of a prototype or live product. Due to the flexible nature of usability testing, it is the most common method employed by UX designers, which is why we will be focusing on it for this course. As the name implies, usability testing involves testing the use ability of your product on a set of users. It is a great way to evaluate what people say and do when interacting directly with your product or service. Most often, users are given a specific set of task to complete, and efficiency, ease, and speed with which they can’t complete them are recorded. Keep in mind that it is not the participants themselves being tested but the effectiveness of the product or service you have designed
Why conduct a usability test?
And effective usability test reveals how a typical user would attempt to complete a task using your product. It can also grant insight into how to fix problems that may arise during the test. Researchers can observe where participants get confused or make wrong choices, take notes, and then implement steps to correct the issues. Usability testing doesn’t have to be expensive, and it can be a great way to quickly game insights that inform design decisions
A well structured and successfully executed usability test helps designers make better decisions by demonstrating what four items?
The ability of participants to complete task. How long it takes participants to complete task. Whether participants enjoy interacting with the product or service. Whether the product or prototype has any critical errors.
Conducting a usability test before rolling out a final product design will do what?
It saves time and money for a company and helps ensure the final product will be well received by it’s intented users. Rather than spin resources creating a final, polished product, designers can quickly iterate and course correct several times before investing in a final design to hand off to developers
Who is involved when conducting a usability test?
Ideally, you would have at least two researchers involved, one to conduct the usability test and another to take notes and record results
Where do you usability test take place?
Test environments vary according To the scalp and nature of your project. There is a common misconception that usability testing requires a formal use ability Lab and that recruiting participants is expensive. In fact, there are a variety of ways to conduct an effective usability test depending on the nature and constraints of the project. Ultimately, the test environment and setting will depend on the goals of your study, as well as the time and geographical constraints on the researcher and test participants
Try asking yourself the following questions about your usability test project for a better idea of what a proper usability test will require what two items?
Does the usability test require a moderator to facilitate the test? Will the test take place remotely or in person?
Gorilla testing?
??????
