Unit 4 638 Flashcards
desired dimensions of defined characteristics
Measurement
analyzes the result obtained from measurement based on predetermined standards
Evaluation
give value judgment to assessment through the qualitative measure of the prevailing situation
Evaluation
Quantitative instruments are used: tests, aptitude tests, questionnaires, etc.
Assessment
essential characteristics in measurement include reliability, validity, and objectivity
Measurement
Assessment measures the _____ from a known objective
form of feedback on students’ learning
Performance of the individual
assist a teacher in determining what, how much and how well the students are learning
Assessment
Evaluation analyzes the result obtained from measurement based on ______
predetermined standards
The___ is a special form of assessment and can be given at the end of a lesson or unit, however, you can assess the progress of a students’ learning at the end of the term through _______
test; verbal and skills testing
What kind of amount of measurement is measurement?
Quantitative
Measurement is not making a ____ on the performance of the student
value judgement
Measurement or Evaluation: clear assumption formed.
Evaluation
Measurement or Evaluation: Content-oriented
Measurement
Measurement or Evaluation: It is a means, and not an end in itself
Measurement
Measurement or Evaluation: scope is wide
Evaluation
Measurement or Evaluation: Objective-oriented
Evaluation
Measurement or Evaluation: not clear assumption on students
Measurement
Measurement or Evaluation: End in itself
Evaluation
Measurement or Evaluation: Deduce inferences from the evidence
Evaluation
Measurement or Evaluation: to gather evidence
Measurement
Measurement or Evaluation: not be an essential part of education
Measurement
Measurement or Evaluation: ‘what value’
Evaluation
Measurement or Evaluation: prediction cannot be made meaningfully
Measurement
Measurement or Evaluation: quantitative and qualitative
Evaluation
Measurement or Evaluation: can be conducted anytime
Measurement
Measurement or Evaluation: Acquaints with a situation
Measurement
Measurement or Evaluation: can be predicted meaningfully
Evaluation
Measurement or Evaluation: continuous process
Evaluation
Measurement or Evaluation: necessary in education
Evaluation
Measurement or Evaluation: numerically displayed
Measurement
Measurement or Evaluation: acquaints about an entire situation
Evaluation
4 types of assessment?
Formal and Informal; Formative and Summative
Formal or Informal: Structured and systematic
Formal
Formal or Informal: content & performance driven
Informal
Formal or Informal: uses rubric
Informal
Formal or Informal: used for comparison against a certain standard
Formal
Formal or Informal: mathematically computed
Formal
Formal or Informal: knowledge testing
Formal
Formal or Informal: Progress of each student by using actual works
Informal
Formal or Informal: data based test
Formal
Formal or Informal: Spontaneous and flexible
Informal
Formal or Informal: overall achievement
Formal
Formal or Informal: Quantitative
Formal
Formal or Informal: Checklist, observation, portfolio, rating scale, records, interviews, journal writing
Informal
Formal or Informal: Exams, diagnostics tests, achievement tests, aptitude tests, intelligence tests, quizzes
Formal
Formal or Informal: normal classroom environment
Formal
Formal or Informal: Qualitative
Informal
Formal or Informal: Criterion references
Informal
Formal or Informal: Norm referenced
Formal
Formal or Informal: beyond the classroom environment
Informal
Formative or Summative: Concerned with purposes, progress and outcomes of the teaching-learning process
Summative
Formative or Summative: Provide feedback on how things are going
Formative
Formative or Summative: Determine if learning is sufficiently complete
Summative
Formative or Summative: Determine whether learning is taking place
Formative
Formative or Summative: helps students perform well at the end of the program
Formative
Formative or Summative: Determine how well things went
Summative
Formative or Summative: Gathering of detailed information and narrow in the scope of the content
Formative
Formative or Summative: Evaluate the effectiveness and improvement of teaching
Formative
Formative or Summative: Gathering information is less detailed but broader in the scope of content
Summative
Formative or Summative: Conducted during teaching or instruction
Formative
Formative or Summative: Provide information to the students, parents, and administrators on the level of accomplishment attained
Summative
Formative or Summative: Occurs at the end of instruction
Summative
Formative assessment is primarily ____
prospective
Summative assessment is primarily ___
retrospective
Formative or Summative: Observation, oral questioning, assignments, quizzes, discussions, reflection, research proposal, peer or self-assessment
Formative
Formative or Summative: Unit test, final examinations, comprehensive projects, research paper, presentations, project, portfolio
Summative
Norm-referenced or Criterion-referenced: Students compete against each other
Norm
Norm-referenced or Criterion-referenced: Relative ranking of students
Norm
Norm-referenced or Criterion-referenced: A student competes against himself or herself
Criterion
Norm-referenced or Criterion-referenced: Determine students’ placement on a normal distribution curve
Norm
Norm-referenced or Criterion-referenced: Measure how well students have mastered a particular body of knowledge
Criterion
Norm-referenced or Criterion-referenced: Interpret scores in terms of absolute standard
Criterion
Norm-referenced or Criterion-referenced: Examinee-centered
Norm
Norm-referenced or Criterion-referenced: emphasizes thinking and application of knowledge
Criterion
Norm-referenced or Criterion-referenced: Setting performance standards
Criterion
Norm-referenced or Criterion-referenced: Focuses on memorization and routine procedures
Norm
Norm-referenced or Criterion-referenced: Evaluate the effectiveness of the teaching program and student’s preparedness
Norm
Norm-referenced or Criterion-referenced: Assess higher-level thinking and writing skills
Criterion
Norm-referenced or Criterion-referenced: Content centered
Criterion
Norm-referenced or Criterion-referenced: Highlight achievement differences
Norm
Norm-referenced or Criterion-referenced: student performed for better or for worse
Norm
Norm-referenced or Criterion-referenced: Test item analysis
Criterion
Norm-referenced or Criterion-referenced: percentile rank, normal curve
Norm
Norm-referenced or Criterion-referenced: monitors students’ day to day activities
Criterion
Norm-referenced or Criterion-referenced: Domain-referenced tests, competency tests, basic skills tests, mastery tests, performance or assessments, objective-referenced tests, authentic assessments, standards-based tests
Criterion
Norm-referenced or Criterion-referenced: NSAT, College Entrance Examination, National Achievement Test, IQ test, Cognitive Ability Test
Norm
What are the qualities of a good measuring instrument?
Validity and Reliability
Validity is the degree of relation between?
between what the test measures and what is supposed to measure
Validity is the ___ or ____ with which the scores measure a particular cognitive ability of interest
consistency; accuracy
3 types of validity?
Content
Construct
Criterion-related
representation of the covered topics discussed or what has been taught
Content
test is compared to the accepted standards
Criterion-related
general description of student’s performance; provides the meaning of the scores from the test
Construct
2 types of criterion-related validity?
Predictive
Concurrent
Predictive or Concurrent: Two different tests (scholastic aptitude scores & criterion performance) is given at a different time (months).
Predictive
Predictive or Concurrent: Relates to the present standing on other valued measure called a criterion.
Concurrent
Predictive or Concurrent: Two different tests (scholastic aptitude scores & criterion performance) is given at the same time.
Concurrent
Predictive or Concurrent: Test performance predicts future performance.
Predictive
Predictive or Concurrent: Estimate present status or current skills in the actual setting.
Concurrent
Predictive or Concurrent: Determines who is likely to succeed or fail in a certain course, board examinations or occupation.
Predictive
In reliability, repeated results are?
consistent
T or F: A test may be reliable and valid but a valid test is always reliable
False; A test may be reliable but not valid but a valid test is always reliable
4 methods of reliability?
Test-retest
Inter-rater
Parellel-forms
Split-half
What type of method: consistency of tests across time
Test-retest
What type of method: consistency of tests across items
Split-half
What type of method: consistency of raters
Inter-rater
What type of method: consistency of test content
Parallel-forms
What formula is used in test reliability?
Cronbach’s alpha formula
Steps in constructing a test
Determine purpose
Identify learning outcomes
Outline topics
Prepare TOS
Determine type of test
Determine length of test
Purposes of TOS?
Guide for teachers
Guide for item construction
Improves validity of teacher evaluation
For teachers to support their proficient judgement
Framework
How to make a TOS?
Desired no. of items
Allocation of time for topics
Length of time spent in teaching a topic
Total no. of items per topic
Percentage allocation per domain
Guidelines for developing different types of items?
Objective
Sufficiency
Free from ambiguity
Difficulty
Novelty
Types of Achievement Tests?
True or false
Multiple Choice
Matching type
Essay
Performance-based assessment has?
Rubric
What is a rubric?
Feedback mechanism
Identifies strengths and weaknesses of topics
Varies for every activity/ task
2 types of rubrics?
Holistic/global
Analytical
Analytical or Global: does not separate the parts of the activity to be evaluated
Global
Analytical or Global: does not specify the components of the process
Global
Analytical or Global: clearly details the indicators of each activity
Analytical
What is item analysis?
statistical test
Item analysis determines?
ability of a students against a group of students
What is item analysis used as?
norm-referenced and criterion-referenced test
Purpose of Item Analysis?
Review and measure student knowledge
Assess question for its value
Guide for improving the test
Quality of the test item?
Effectiveness of distractors
Index of Discrimination (point biserial)
Index of Difficulty (p-value)
determines the effectiveness of the incorrect answers (distractors) to the quality of multiple-choice items.
Effectiveness of distractors
True or False: The higher the discrimination index the better the item. Since, positive discrimination index indicates that most of the high scoring students get the item correctly than the low scoring students
True
True or False: If the item has discrimination below 0.0, this also indicates that there is no problem.
False, it indicates that there is a problem
True or False: A negative discrimination index indicates that most of the high scoring students get the item correctly than the low scoring students.
False; A negative discrimination index indicates that most of the low scoring students get the item correctly than the high scoring students.
measures the relationship between students’ performance on a test item and the overall score of students
Index of Discrimination
measures the proportion of students that selects the options answers.
Effectiveness of Distractors
measures the percentage of students who get the item correctly
Index of Difficulty
determines if the students have learned the concept being tested
Index of Difficulty
Formula for difficulty?
(no. of students that for the item right / total no. of students) x 100
A ____ difficulty index indicates an easier item.
higher
A lower difficulty index indicates what?
a difficult item