6. Evaluation Flashcards
What kind of Variables are there?
Independent Variable IV: The manipulated aspect (Randomization)
Dependent Variable DV: The observed aspect (Categorical, Ordinal, Interval, Ratio)
What can cause a Variation of DV?
Systematic variation: due to experimental conditions, avoid with randomization
Unsystematic variation: Error due to random factors
Role of statistics: Discover how much variation is attributed to systematic or unsystematic variations
What are the different participant sample groups?
Between-Groups: independent-measures design: the participance are assigned to one condition only
Within-subjects: repeated-measures design: the participance are assigned to all condition (balance/randomize order)
Hybrid design
What is attributed to validity?
Internal Validity: Define tasks, manipulation, measures, control environment, repeatable
External Validity: Ability to generalize results
What is the Mode, Median, Mean? What are the advantages and disadvantages?
Mode: most frequent score/how most people behave,
+easy to calculate and understand/also for nominal data,
-can be more than one/can change dramatically by adding only one dataset/independent of all other data in the set
Median: Middle score of the distribution
+relatively unaffected by outliers and skewed distribution/for ordinal, interval and ration data
-doesn’t consider all scores of the dataset, not very stable
Mean: Average/Sum of all scores divided by #scores
+considers every score/resistant to sampling variation
-affected by extreme scores and skewed distribution/only for interval and ration data
What is required for an inferential statistic?
Statistical Significance (Student t-test, p-Hacking!, Analysis of Variance ANOVA, Bland-Alterman plot)
What is the Heuristic evaluation?
(systematic UI design) usability inspection method to finde usability problems
What are tools for usability evaluation?
System Usability Score SUS
Usability Lab
Eye-Gaze Tracking
