Academic Selection Flashcards
What is the evidence for the effectiveness of field specific measures of knowledge and skill in academic admissions?
Kuncel & Hezlett meta-analysis found a stronger, positive correlation between student success and subject specific tests like GRE subject tests, in comparison with the general GRE.
Another study by Kuncel found that GREs had a stronger correlation with graduate GPA, comprehensive exams, faculty rating, degree attainments, research produced, and citation count.
These specific measures are better for admission because they show that the applicant is interested about the subject matter. They represent the motivation aspect of job performance and declarative knowledge (DK).
Why are the GRE Subject tests better predictors of academic performance in graduate school than the general test (verbal and quantitative).
Domain specific tests reflect a genuine interest in the subject area and are useful measures of specific knowledge, motivation and declarative knowledge. Its related to the motivation aspect of job performance, because students gather a lot of information on the topic, willing to put a lot of time and effort in mastering the material. This motivation will be reflected in graduate school performance. Also, GRE Subject tests measure knowledge that is directly related to the chosen study area and reflect relevant knowledge for the academic program relating to the DK aspect of job performance.
Does SES explain the relationship between admissions tests and college performance? Cite and describe evidence to support your conclusion.
SES does not explain the whole relationship. The finding shows that the relationship between test scores and college performance is almost entirely preserved when controlled for SES, family income and family education attainment.
Studies by Sacket and Kuncel show data from multiple sources and longitudinal studies, meta-analyses of existing literature. The evidence shows that controlling for SES doesn’t not eliminate the predictive power of tests. The idea is that social class may affect test scores because family education produces good grades improving scores. SES may influence test scores but it’s not the same as academic preparedness.
Letters of recommendation and personal statements are the 3rd and 4th most heavily used tools in academic admissions. Is this a good thing? Why?
This is not necessarily a good thing because personal statements predict GPA at .13 and recommendation letters only .28 (.13 in grad school). With regards to faculty rating, personal statement only correlated at .09 in college and letters of recommendation correlated at .25 in grad school.
Considering how they are weighted in admission processes, they don’t predict performance very well. There are better measures that have higher predictive power and would be more effective (aptitude tests, grades). People interpreting narratives into a score reduces validity; letters are also better than statements because they provide information on motivation.
Situational judgments tests are at the cutting edge of academic admissions. What is the evidence for their usefulness? Be specific for what purposes there is clear evidence.
A study found that SJT correlated with GPA at 0.16 and absenteeism at -.27. Sackett and colleagues found that the predictive power of SJT (empathy and social skills) increases as time goes by in medical school if the curriculum has a substantial interpersonal component – because social skills and interaction with patients become common the further you get in medical school. However, Peets and Lievens found that faking has a significant effect on SJT tests.
Do standardized tests predict performance in school? What evidence supports your argument?
Kuncel and Hezlet (2007) conducted a meta-analysis and found that a variety of post-secondary standardized tests are positively related to graduate GPA, qualification exams, degree completion, research productivity, citation count, and faculty ratings.
Patterson and Mattern (2013) found that higher standardized score –SAT score Band — positively correlated with grades of B or higher in first-year GPA.
Studies by Kuncel and Sackett, and Kuncel and Brothen found that students with higher test scores taker a larger number of advanced-level courses, take more difficult classes, and are less likely to switch to a less challenging major.
