Testing - AMT - Chapter 11

Question 1

Why was it taken for granted that

to construct reliable and valid test was:

• Easier: Speaking + Writing
• Harder: Listening + Reading

Answer 1

”- Scoring (objective/subjective)

• Speak + Write = Observable
• We want ““see”” listening & reading through reinvestment tasks
  “

Question 2

Problem of testing reading

Answer 2

• Uncertainty of skills involved
• Difficult to evaluate successful measurement

Question 3

Testing Reading Operations

(the two types of operations)

Answer 3

• Expeditious reading operations (quick and efficient)
• Careful reading operations (slow and careful)

Question 4

Expeditious reading operations

(Categories)

Answer 4

• Skimming
• Search Reading
• Scanning

Question 5

Careful reading operations

(key words + category)

Answer 5

• identify
• interpret
• outline
• distinguish
• recognize
• MAKE INFERENCES

Question 6

4 types of Reading ability

Answer 6

• Skimming
• Scanning
• Search Reading
• Careful Reading

Question 7

Skimming

Answer 7

General Idea (quickly & efficiently):

• main idea
• establish the structure
• decide relevance

Question 8

Search Reading

Answer 8

• Find info on predetermined topic

Question 9

Scanning

Answer 9

• Specific words/phrases
• Figures, percentages
• specific index item
• specific name, bib.ref.

Question 10

Propositional inference

Answer 10

• Do NOT depend on information from outside the text

Question 11

Factor favorised OVER VALIDITY

Answer 11

Practicality

Question 12

Pragmatic Inferences

Answer 12

Combines Outside Reading info + Into Reading info

Question 13

Propositional vs. Pragmatic inferences

Answer 13

• Propositional = Text Only
• Pragmatic = Knowledge + Text

Question 14

Careful Reading

Answer 14

• details
• inferences (analysis)
• b/w the lines

Question 15

Listening/Reading

vs

Writer

Answer 15

• Interact with Writer
• Not Passive

Question 16

When tested for Vocabulary+Grammar when Reading

Answer 16

= –validity

Question 17

A Text

Good for Reading = Good for Listening?

Answer 17

• Not necessary
• Listening text needs to be Real Life

Question 18

While Writing items (to test reading)

• DO:

Answer 18

• Present items in the Text Structure order
• Make items independant (do not answer other questions)

Question 19

Test Reading

1st Step

Answer 19

• Always Define Construct
• Question 1: Purpose of Reading

Question 20

Better Measurement of Reading

Answer 20

Directly

Question 21

When you test reading

• You Should NOT

Answer 21

• Test Writing

Question 22

A Good DIRECT method to test reading

Answer 22

• With all same background students:

TRANSLATION

Question 23

Best Method to test Reading+Writing Simultaneously

Answer 23

Summary Writing

Question 24

Specification of text types Expected for Candidates

• Parameters

Answer 24

• Types (text)
• Forms (text)
• Graphic features
• Topics
• Style
• Intended Readership
• Length
• Readability
• Range of Vocabulary
• Range of Grammar

Question 25

Text types/topic should be Adapted to Context

Answer 25

- Characteristics of Ss (not too much: they still have to read it, not know all about it)

Question 26

Text Forms - Choice

Answer 26

Text form = description, argumentation, narration, etc. - Choose from curriculum

Question 27

Define Topics

Answer 27

- General: non-technical or - Relation/Candidates: Familiar

Question 28

Why Specify so much Text to include in test

Answer 28

- Validity: Representative of Candidates Ability - Backwash: Narrow type tested, Narrow type practiced

Question 29

Testing Reading 3 Steps of Creation Process

Answer 29

- Specifying what the candidate should be able to do - Setting the Task - Scoring

Question 30

Specifying what the reader should be able to do - Testing Reading

Answer 30

- Operations - Text - Speed - Criterial Level of Performance

Question 31

Speed

Answer 31

- words/minutes - expeditious not expected to read all the words

Question 32

Criterial level of performance

Answer 32

- NOT w/ norm-referenced testing - Reading should be: - Criterion-Referenced Testing.

Question 33

Successful choice of text depends on practice

Answer 33

- experience - judgement - common sense

Question 34

Selecting texts - Tricks

Answer 34

- Keep Specifications in Mind - Length (appropriate) - Amap/passages (valid.+rel.) - interest of candidates - avoid text w/ info candidates' general knowledge

Question 35

Writing items - reading

Answer 35

- Measure ability in which we are interested - Elicit Reliable behaviour - Allows Reliable scoring

Question 36

(Reading) - Test Technique Identifying Order

Answer 36

Multiple Choice (need to understand Question + Text)

Question 37

(Reading) - Test Technique Identifying Referents

Answer 37

- Part of micro-skills (what does it stand for)

Question 38

(Reading) - Test Technique Guessing word meaning from context

Answer 38

Micro-skills (find a word in paragraph with same meaning) - not only to guess but understand context

Question 39

Testing Reading (which language for items + Responses)

Answer 39

- within candidates ability - minimal demand on writing ability

Question 40

Writing items for Reading - Procedures

Answer 40

- Specify Operations - Determine tasks reasonable for Candidates - Draft items (par.+lines #, collegues, modify text)