Chapter 5.2: True Score Model of Measurement and Alternatives Flashcards
(35 cards)
AKA the true score model or measurement
Regarded for its simplicity and it’s notion that everyone has a true score on a test. Ina-assume ng theory na ito na may true score kaya lang naaapektuhan siya ng mga ibang variance at ibat ibang errors
CLASSICAL TEST THEORY
value that according to classical test theory genuinely reflects an individual’s ability (or traits) level as measured by a particular test
True score
Observed score= True Score + Error Variance
What theory is this formula used?
Classical Test Theory
Explain the weakness of Classical Test Theory
It has an assumptions that all items contribute equally to the measurement of the construct—it doesn’t work that way parang group work lang, di equal ang contribution ng lahat.
It favors longer tests—–kaya yung mga classic na test ang hahaba
True or False. In Psychometrics, CTT assumptions are strong compared to IRT
False
Explain the problem/disadvantage of CTT
- its assumption that all items contributing equally to the total score
- very test dependent
- It favors the development of longer rather than shorter
According to this theory, a person’s true score would be obtained by having them respond to all items in the universe of items
Domain Sampling theory
This theory rebels against the concept of the true score existing with respect to the measurement of psychological construct
Domain Sampling Theory
What is the most compatible reliability estimates for Domain Sampling Theory?
internal consistency
This theory assumes that items that have been selected on a test are just sample of items from an infinite domain of a potential items
Domain Sampling Theory
True or false. According to Domain Sampling Theory, as a sample of test gets larger, it represents the domain lesser and lesser. The lower the items, the higher the reliability
false
According to Domain Sampling Theory, what should we do to represent the domain?
If we take random questions to domain para bumuo ng test, then it means narerepresent nito yung domain
According to this Theory, a person’s test scores vary from testing to testing because of variables in the testing situation
Generalizability Theory
According to ____ theory, a “universe score” replaces that of a “true score” based on the idea that a person’s test scores vary from testing to testing because of variables in the testing situation
Generalizability Theory
Explain the concept of universe in generalizability theory
instead of conceiving all variability in a person’s scores as error, test developers are
encouraged to describe the details of the particular test situation (universe) leading to a
specific test score
universe
described in terms of its facets:
number of items in the test
amount of training the test scorers have had
purpose of the test administration
according to the generalizability theory, given the exact same conditions of all the facets in the universe, the exact same test score should be obtained
universe score is analogous to a true score in the true score model
the person will ordinarily have a different universe score for each universe
in other words, ____is a specific score for a specific time or setting or
“universe”
true score
True or False. According generalizability theory, if the observed scores from a procedure agree closely with the universe score, we can
say that the observation is accurate, or reliable, or generalizable
True
This theory emphasis that tests’ reliability does not reside within the test itself
Generalizability theory
Who is the proponent of Generalizability theory
Lee Cronbach
It examines how generalizable scores from a particular test are if the test is administered in different situations and how much of an impact different facets of the universe have on the test score
Generalizability Study
____is the influence of particular facets on the tests scores
coefficient of generalizability
Explain the decision study
developers examines the usefulness of the test score in helping the test user in making decisions. It is also designed to tell test users how test score should be use and how dependable those scores as a basis for decisions
It focuses on how the test items can measure the latent (innate characteristic) trait of the test taker.
Item response Theory (IRT)
what are the different weights of items in ITR?
- Difficulty
- Discrimination
- Dichotomous test items
- Polychotomous test items
- Rasch Model