Competence II: Ch 10 & 20

Question 1

The heart of descriptive designs:

Answer 1

the quality of observation is the heart of descriptive designs; Ex: Investigator can exercise considerable care in making observations so as to minimize measurement errors which can reduce considerable error variance.

Question 2

Exercising experimental control in descriptive designs

Answer 2

to reduce bias and extraneous variables by using random sampling.

Question 3

Author-made surveys:

Answer 3

instruments lacking reliability or inappropriate for variables being studied. Created but not lack knowledge about conducting sound survey research.

Question 4

Most frequent way of collecting survey research data:

Answer 4

self-report questionnaires either mailed or online
Advantage: ease of data collection
Disadvantage: difficulty of getting participants to respond and return completed questionnaires.

Question 5

The purpose of follow-up letters in survey research:

Answer 5

This acts to remind participants to complete the survey thus increasing response rate.
-Ex: 30%-40% response rate from initial mailing, 20% 1st follow-up, 10% second follow up (50% response rate is recommended minimum)

Question 6

Adequate return rates in survey research:

Answer 6

Recommend 50% minimum is adequate, others at least 80-90%.

Question 7

Challenges peculiar to survey research with diverse populations

Answer 7

1. How to tailor the survey to the particular group under study; 2. Catering to participants who do not speak standard English, translation process; 3. Distribution and collection of survey- some groups do not trust researchers connected with white middle class institutions.

Question 8

Construct of interest in scale construction:

Answer 8

The first step in scale construction; Before develop new scale researcher should consider 1. Assessing the necessity for a new scale for the construction and population of interest, 2. Conceptualizing the content of the construct and writing its operational definition, 3. Consulting with colleagues regarding the utility of the scale and appropriateness of the definition.
-In order for an item to be operationalized must be written in a statement that is measurable.

Question 9

Item generation:

Answer 9

Third step in scale construction; Poor items jeopardize the construct validity of the scale, misleads future researchers who wish to use the scale. Enhance quality of items by 1. Basing the items on solid lit review and conceptual models or theories 2. Using qualitative methods such as focus groups & interviews with relevant groups of people to id prototypical dimensions or indicators of the construct 3. Writing conceptually and linguistically clear items
-Kline has 9 rules for development of writing items p.502

Question 10

Content validity of test items:

Answer 10

Ensure respondents do not perceive an item differently from what the researchers intended. Therefore conducting a content analysis and consult with domain experts increases content validity of scale.

Question 11

Purpose of pilot testing test items:

Answer 11

identify potential problems with their wording; Involves asking participants not only to respond to the items as if they were a participant but also to identify unclear or ambiguous elements about the items. Provides powerful tool for researchers to identify items that may be misunderstood or unclear to respondents.

Question 12

Translation and back translation:

Answer 12

lack of care in translation/ back translation can result in measurement error in the scale and mislead readers about the generalizability of the construct across cultures.

Question 13

Classification or data reduction research designs

Answer 13

reduce data to only a few variables by developing categories, subgroups, or factors, can also have important theoretical implications; Two common strategies: Factor analysis and cluster analysis

Question 14

Exploratory factor analysis:

Answer 14

attempt to determine underlying dimensions without a priori specification of the number or content of the constructs (Ex: Enloe assessment ex: Perihan data set)

Question 15

Confirmatory factor analysis:

Answer 15

Based on theory or previous research there is an existing model of a factor structure to be examined to determine how well the existing model fits the actual relationship observed in a new set of data to be either confirmed or disconfirmed. Begin with identifying the number of dimensions one expects to find along with items in the dat set that will correlate with (or load on) each dimension.

Question 16

Correlation coefficient, or r

Answer 16

correlation answers a relationship question. Analysis for interval scales is pearson product correlation +1 to 0 to -1.

Question 17

r squared:

Answer 17

multiple regression coefficient. How well doe the predictor scores (x) correspond to the actual scores of the dependent (criterion) variable (y). The proportion of variance in the dependent variable explained by the independent variable is the square of the correlation coefficient or little r squared becoming big R squared.

Question 18

Amount of variance shared between two variables, that is x and y (a.k.a effect size):

Answer 18

effect size is determined by squaring R (proportion of the variance of the DV explained by the IV. Results arbitrary and not causal

Question 19

Predictor Variable

Answer 19

Independent Variable

Question 20

Criterion Variable

Answer 20

Dependent Variable

Question 21

R squared

Answer 21

The proportion of the variance in the dv or criterion variable explained by the iv or predictor variable

Question 22

Simultaneous Regression

Answer 22

All predictor variables are entered concurrently (simultaneously) into the regression equation

Question 23

Stepwise Regression

Answer 23

the regression model first enters the predictor variable with the highest correlation with the criterion variable . The next variable is the one that results in the largest increase in R2. This is repeated until adding variables does not result in statistically significant increase in R2. Thus it identifies which variables contribute the most variance in the equation.

Question 24

What is a scale in counseling research?

Answer 24

Collection of items the responses to which are scored and combined to yield a scale score

Question 25

Of what importance are literature reviews in scale construction?

Answer 25

Literature reviews very important because they determine if the scale you are trying to construct exists, if there has been research in this area, and can help identify possible items.

Question 26

How does factor analysis enhance the scale development process?

Answer 26

Identify themes in the instrument which are the themes hopefully you are trying to gain information about.

Question 27

In what ways are descriptive designs important to our profession?

Answer 27

a. Define the existence and delineate characteristics of certain phenomenon.
b. Descriptive studies allow us to know more about a phenomena before we can control and manipulate variables for experimental study

Question 28

What is the basic aim of survey research?

Answer 28

Define the existence and delineate characteristics of certain phenomenon

Question 29

What are the most frequent problems with survey research?

Answer 29

a. Absence of or unclear research question to guide data collection and analysis
b. Sample errors such as failure ot obtain a sample appropriate to the research question, inadequate sample or non-representative sample
c. Instruments frequently author-made, lacking reliability or inappropriate for the variables being studied
d. Other methodological problems that prohibited generalization of results for example data collection procedures

Question 30

What challenges to external validity exist in survey research?

Answer 30

a. Some reason majority of participants did not respond to self report questionnaire? Would their responses be different than those who ddi return the questionnaire? Cannot generalize 30% response rate to target population