Research and Evaluation Flashcards by Layla Ahlers

What is a needs assessment?

A needs assessment is a systematic process for determining and addressing gaps between current conditions and desired conditions or wants.

How well did you know this?

Not at all

Perfectly

True or False: Formative evaluation is conducted after a program has been implemented.

False

How well did you know this?

Not at all

Perfectly

Fill in the blank: Summative evaluation is used to assess the _____ of a program.

effectiveness

How well did you know this?

Not at all

Perfectly

What type of evaluation focuses on the implementation process of a program?

Process evaluation

How well did you know this?

Not at all

Perfectly

Multiple Choice: Which evaluation type measures the outcomes of a program after it has been completed? A) Formative B) Process C) Summative D) Needs Assessment

C) Summative

How well did you know this?

Not at all

Perfectly

What is the primary purpose of formative evaluation?

To provide feedback during the development and implementation phases of a program.

How well did you know this?

Not at all

Perfectly

True or False: Outcome evaluation assesses the long-term impacts of a program.

True

How well did you know this?

Not at all

Perfectly

What is one key difference between process evaluation and outcome evaluation?

Process evaluation focuses on how a program is implemented, while outcome evaluation focuses on the results and impacts of the program.

How well did you know this?

Not at all

Perfectly

Fill in the blank: A needs assessment often involves collecting _____ to understand the target population’s needs.

data

How well did you know this?

Not at all

Perfectly

What is the role of stakeholders in a needs assessment?

Stakeholders provide insights and perspectives that help identify the needs and priorities of the community or target population.

How well did you know this?

Not at all

Perfectly

What is the primary focus of experimental research methods?

To determine cause-and-effect relationships by manipulating independent variables.

How well did you know this?

Not at all

Perfectly

True or False: Survey research methods are primarily qualitative in nature.

False

How well did you know this?

Not at all

Perfectly

Fill in the blank: In case studies, researchers typically focus on __________ individuals or groups.

specific

How well did you know this?

Not at all

Perfectly

Which of the following is NOT a characteristic of qualitative research methods? A) Open-ended questions B) Statistical analysis C) Subjective interpretation D) Contextual understanding

B) Statistical analysis

How well did you know this?

Not at all

Perfectly

What is the main advantage of using surveys in research?

They can gather data from a large number of respondents quickly and efficiently.

How well did you know this?

Not at all

Perfectly

Name one limitation of experimental research methods.

They may lack ecological validity due to controlled settings.

How well did you know this?

Not at all

Perfectly

True or False: Qualitative research methods often use structured questionnaires.

False

How well did you know this?

Not at all

Perfectly

What type of data do case studies primarily rely on?

Detailed, contextual data from a single subject or group.

How well did you know this?

Not at all

Perfectly

In survey research, what is a common method for ensuring a representative sample?

Random sampling

How well did you know this?

Not at all

Perfectly

What is the role of the control group in experimental research?

To serve as a baseline for comparison against the experimental group.

How well did you know this?

Not at all

Perfectly

What type of data categorizes variables without a defined order?

Nominal data

How well did you know this?

Not at all

Perfectly

True or False: Ordinal data can be ranked but does not have a consistent interval between ranks.

True

How well did you know this?

Not at all

Perfectly

Fill in the blank: __________ data has both order and equal intervals but no true zero point.

Interval

How well did you know this?

Not at all

Perfectly

Which of the following is an example of ratio data? A) Temperature in Celsius B) Height C) Ranking of movies D) Gender

B) Height

How well did you know this?

Not at all

Perfectly

What is the main difference between interval data and ratio data?

Ratio data has a true zero point, while interval data does not.

True or False: Nominal data can be used for statistical calculations such as mean and median.

False

Which type of data can be used to represent categories like 'red', 'blue', and 'green'?

Nominal data

What type of data would you use to rank student performance as 'excellent', 'good', 'average', 'poor'?

Ordinal data

Identify the type of data: The temperature recorded in Fahrenheit.

Interval data

True or False: Ratio data can be subjected to all arithmetic operations.

True

What is an independent variable?

An independent variable is a variable that is manipulated or changed in an experiment to test its effects on the dependent variable.

What is a dependent variable?

A dependent variable is a variable that is measured or observed in an experiment to assess the impact of the independent variable.

True or False: The dependent variable is controlled by the researcher.

False

In an experiment studying the effect of sunlight on plant growth, what is the independent variable?

The amount of sunlight.

In an experiment studying the effect of a new drug on blood pressure, what is the dependent variable?

Blood pressure levels.

Fill in the blank: In a study examining the impact of study time on test scores, the study time is the __________ variable.

independent

What type of variable is often referred to as the 'response variable'?

Dependent variable.

Which of the following is an example of a dependent variable? A) Temperature B) Time C) Test score D) Age

C) Test score

In a clinical trial, if researchers vary the dosage of a medication, what is the independent variable?

The dosage of the medication.

Short answer: Why is it important to identify independent and dependent variables in research?

It helps clarify the relationship being tested and ensures accurate data interpretation.

____ research methods indicate whether 2 variables have a relationship or occur together, but it can not prove causal.

Correlational

T or F Experimental research methods are quantitative, systematic, and scientific in design but cannot prove causal relationships between variables.

F Experimental research methods include control group (no treatment) and experimental group (independent variable) They DO determine cause and effect

Major benefits to this type of research methods includes ease of distribution and the breadth and depth of data collected including attitudes, beliefs, behaviors, and character.

Survey research methods

This research method is described as an in-depth, detailed analysis of a particular instance, individual or event. Both qualitative and quantitative data may be collected, but data cannot be generalized.

Case study

This research method is exploratory and involves studying individuals in their natural environment. A benefit is its ability to capture data that other methods may not such as trends in thought and opinion. It also offers ways to understand the reasons behind statistics

Qualitative Research Methods - methods include control group life interviews, focus groups, and observation

____ outcome measures are tools or instruments used to measure counseling interventions’ outcomes systematically. Ex: BDI, GAD-7, PID-5

Standard

___-based evaluation focuses on whether the counseling program achieves its intended outcome per determined goals/ objectives

Outcome

______ evaluation focuses on “what” such as what was achieved, while___ focuses on “how” such as how the program was implemented .

Outcome-based; process

T or F A valid test is always reliable.

T A reliable test is NOT always valid

____ validity focuses on whether a test measures the full range of what it is attempting to measure such as IQ.

Content (logical or rational)

Assessments that measure concepts of theory or are complex/ have many parts that may not be visible must be high in ____ validity.

Construct

_____ validity measures a test in comparison to an existing test.

Concurrent

____ validity refers to an assessment’s ability to measure future behavior

Predictive (empirical)

Predictive validity and concurrent validity are types of ____ validity

Criterion validity

____ validity measures the social implications of a standardized tests.

Consequential

A reliability coefficient of 1.00 indicates A. A typical correlation on most psychological and counseling tests B. A perfect score which has no error C. A score with a high level of error D. A lot of variance in the test

B. A perfect score which has no error in reliability

Which of the following is considered excellent reliability? A. .5 B. 1.00 C. .70 D. .90

D. .90 is excellent .70 is typical/ acceptable 1.00 is perfect

A researcher working on a personality test discovers that the test has a reliability coefficient of .90. T or F True variance is 90%. Error variance is 10%

A career counselor would use tests with an acceptable reliability coefficient of ___% and psychotherapist may consider a test with __% reliability coefficient as acceptable.

80% 70%

____ variance is the percentage of shared variance or the level of the same thing measured in both.

TRUE

___ is a statistical measurement of how spread out numbers are in a data set. It shows how far each number is from the mean, and therefore from the other numbers in the set.

Variance

IQ stands for intelligence quotient. To determine IQ you must divide MA by CA which means:

Mental age v. Chronological age

Stanford-Binet is used from age 2 to adulthood. The IQ formula has been replaced by the … A. SUDS B. Entropy C. SAS D. Kr-20 formula

SAS - standard age score = a mean of 100 and standard deviation of 16.

The tendency of people to change their behavior when they are observed by researchers or supervisors is called the A) Halo effect B) Hawthorne effect C) Rosenthal effect D) bias

B) Hawthorne effect

The cognitive bias that influences our judgement based on one trait or impression is called A) Rosenthal effect B) Hawthorne effect C) Halo effect D) Type II Error

C) Halo effect

The psychological phenomenon where higher expectations lead to improved performance in others. Meaning, when others expect more of us, we perform better. A) Rosenthal effect B) Hawthorne effect C) Pygmalion effect D) both A and D

D, Rosenthal effect is also known as the pygmalion effect