Teachers vs Tech - Daisy Christodoulou Flashcards

1
Q

Thomas Edison 1913 prediction?

A

Books will soon be obsolete in the public schools. Scholars will be instructed through the eye. It is possible to teach every branch of human knowledge with the motion picture. Our school system will be completely changed inside of ten years. Thomas Edison, quoted by Smith, F. J., 1913

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Most high profile tech failure? Where, when and company involved?

A

Tablets in Los Angeles In 2013, the Los Angeles Unified School District (LAUSD) announced a deal with Apple and Pearson (a leading educational publisher) to equip every student in the district with iPads that carried a Pearson curriculum.
The LAUSD is the second-largest school district in the US, educating over 700,000 students, and the contract would ultimately have cost $1.3 billion. Barely a year later, the deal collapsed. The iPads’ security software was easy to delete, the pre-installed curriculum was unfinished and riddled with errors, and teachers had been given little training in how to use the tablets and curriculum.
Perhaps the most chastening aspect of this failure was the stature of the organizations involved. As Wired magazine reported: If one of the country’s largest school districts, one of the world’s largest tech companies, and one of the most established brands in education can’t make it work, can anyone?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What does 2012 OECD data show about US and UK?

A

In 2012, the OECD carried out a new assessment designed to measure adult skills, and also to compare different generations across time. In Korea, adults in the 55–65 age range performed poorly, but those aged 16–24 did much better.25 But in England and the United States, ‘improvements between younger and older generations are barely apparent’.

It is this - not the Flynn effect - which is generational.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the Flynn effect and what’s happened to it?

A

Throughout the 20th Century, scores on IQ tests increased steadily, a phenomenon known as the ‘Flynn effect’ after the scientist who discovered it.27 In recent years, there have been signs that the Flynn effect has stalled or even gone into reverse.28

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Cognitive science is an interdisciplinary field which draws on research from different areas, including …

A

… psychology, neuroscience, linguistics and computer science.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

When / where / who … concept of AI?

A

a conference on artificial intelligence that was held in 1956 at Dartmouth University. The organizer, John McCarthy, coined the term ‘artificial intelligence’ (AI), and the conference is seen as the foundation of AI as a field of academic study.4 Attending the conference was Herbert Simon, who would win the Nobel Prize later in his career. Together with two colleagues, he presented the Logic Theorist, often called the first artificial intelligence program.5 It was able to find proofs for many fundamental mathematical theorems

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

The insight from the science of learning that perhaps has the most practical relevance for teachers is…

A

… the distinction between working and long-term memory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Why is this true?

Differences in prior knowledge is one of the most significant differences between learners, and in many ways can be more significant than differences in general intelligence or working memory capacity.

A

Because the prior knowledge is mental models for understanding.
Knowledge (like vocabulary) unlocks the ability to process or reveal meaning.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Summarise in four words:

Project-based learning, hands-on activities and authentic tasks aim to present students with the types of unstructured activities they will encounter in the real world. We can sum up all of these approaches as …

A

Minimally guided, discovery learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

A 2006 paper from the cognitive scientists Paul Kirschner, John Sweller and Richard Clark reviewed the evidence for minimally guided teaching and found that for novices, guided instruction is more effective because …

A

… it reduces the load on working memory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

The teacher decides the l…… i…….. and s…… c…….., makes them t………. to the students,d……….. them by m…….., e………. if they understand what they have been told by c…… for understanding, and r.-t….. -telling them what they have told by tying it all together with closure. Hattie, J. 2009, p.206

(Direct instruction)

A

The teacher decides the learning intentions and success criteria, makes them transparent to the students, demonstrates them by modelling, evaluates if they understand what they have been told by checking for understanding, and re-telling them what they have told by tying it all together with closure. Hattie, J. 2009, p.206

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

In J…. H…….’s 2008 educational meta-analysis, V……. L……., direct instruction was one of the most effective approaches.

A

In John Hattie’s 2008 educational meta-analysis, Visible Learning, direct instruction was one of the most effective approaches.

+ PISA 2015 science approaches

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What did the PISA 2015 study on science find with regard to ‘constructivist approaches’ (where pupils ‘construct’ their own meanings)?

A

Activities related to experiments and laboratory work show the strongest negative relationship with science performance. While this correlational evidence should be interpreted with caution – for instance, teachers may be using handson activities to make science more attractive to disengaged students – it does suggest that some of the arguments against using hands-on activities in science class should not be completely disregarded. OECD, 2016, p.71

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the ‘knowing / doing gap’?

A

… the frustrating phenomenon where we know a rule, but fail to apply it reliably, like when students know that they should use a capital letter for proper nouns and at the start of sentence, but don’t do so.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Give an example of a ‘biologically secondary’ skill? Unlike?

A

Reading and writing are similar to speaking and listening, but they are not natural: they are inventions of late civilization.28–29

Unlike speaking.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the limitation on our working memory?

Summarise chapter 1: the science of learning.

A

Our working memories are limited to about 4–7 new items of information. Long-term memory is vast: it’s made of elaborate and well-organised knowledge structures that provide us with a way of making sense of the everyday information we encounter. We need knowledge in our long-term memory to get around the limitations of working memory. Direct instruction is an effective way to gain this knowledge. so There is a science of learning that can be applied to education. Our working memories are limited to about 4–7 new items of information. Long-term memory is vast: it’s made of elaborate and well-organised knowledge structures that provide us with a way of making sense of the everyday information

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is Mark Zuckerberg’s vision for personalised learning?

A

“You’ll have technology that understands how you learn best and where you need to focus. You’ll advance quickly in subjects that interest you most, and get as much help as you need in your most challenging areas. You’ll explore topics that aren’t even offered in schools today. Your teachers will also have better tools and data to help you achieve your goals. “

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Who coined the phrase ‘personalised learning’ and when?

A

Educational psychologist Benjamin Bloom, his 1984 research paper challenged academics to replicate the effectiveness of one-to-one or small-group tutoring to a much bigger scale to enhance student learning.

In his initial findings, Bloom claimed that students who received “personalised instruction” outperformed 98 percent of those who did not.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

‘When we are learning, what matters most is not our p……

or best l……. s…., but the best l……. s…. for the c…….’

A

‘When we are learning, what matters most is not our preferred or best learning style, but the best learning style for the content.’

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Two biggest problems with learning styles theory?

A
  1. Limits the type of concepts some students are encouraged to learn by focusing on preferences.
  2. Encourages educators to stereotype and may limit achievement entrench inequality.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Paradoxical effect / problem with ‘self-pacing’?

to make good decisions about our own competence in a particular area, we need to a…… p…… a degree of c……… in that area. If we don’t have this b……. of c………, we often don’t realize our w……..

D……-K…..

A

to make good decisions about our own competence in a particular area, we need to already possess a degree of competence in that area. If we don’t have this baseline of competence, we often don’t realize our weaknesses.

Dunning-Kruger

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What does ‘overlearning’ build?

A

Fluency and automaticity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

How can students feel when required to take control of their learning?

A

Overwhelmed by additional mental load

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Dunning and Kruger conclude that the way to improve judgement of your competence in an area is to i…… y…. c……….

A

Dunning and Kruger conclude that the way to improve judgement of your competence in an area is to improve your competence.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is the method of ‘personalised education’ that generally shows small positive gains due to its similarity to tutoring? And what does it do?

A

Adaptive learning tools collect specific information about individual students’ behaviors by tracking how they answer questions. The tool then responds to each student by changing the learning experience to better suit that person’s needs, based on their unique and specific behaviors and answers. Edsurge, 2016

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

An alternative often suggested to learning facts / information?

A

Learning to be a ‘critical thinker’ … problem solve and evaluate information you encounter.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What are the three reasons why it is wrong to say now we have Google, we no longer need to memorise facts?

A
  1. We need facts in long-term memory because we use them to think, and without them our working memories would quickly get overwhelmed.
  2. Even when we are using reliable online sources, we need facts in long-term memory to be able to look something up and make sense of what we find.
  3. When we do encounter unreliable online sources, relying on generic evaluation skills will not help us to identify them.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

L…-t… m….. is now viewed as the c……, d…….. s……… of h….. c……… Everything we see, hear, and think about is critically dependent on and influenced by our l…-t… m……

Kirschner P. A., et al., 2006

A

Long-term memory is now viewed as the central, dominant structure of human cognition. Everything we see, hear, and think about is critically dependent on and influenced by our long-term memory.

Kirschner P. A., et al., 2006

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What was the memory experiment that proves that we think by using our long-term memories? (1970s - not ADG)

S…. & C….

A

CHUNKING THEORY 1970s

Show chess board.

Grandmasters reproduce 25 pieces after just a few seconds exposure.

Once randomised, just 3/4 (as everyone else).

Simon & Chase

(Reason and recall ‘bound up’)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

I believed him when he said he had a lake house, until he said it’s only forty feet from the water at high tide. Willingham, D. T., 2009, p.24

This brain scan is fuzzy. Probably, the patient was wearing makeup. Amplify, Center for Early Reading, 2018, p.13

A

To make sense, a reader must KNOW lakes don’t have tides, make-up has trace metal elements.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Looking up things is a …?

A

… high-level cognitive task.

The more you already know, the more useful a reference source becomes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

The Pacific Northwest Tree Octopus The hoax website contains detailed and often amusing descriptions of an entirely fictitious creature.

What do we learn about Google from this?

A

It isn’t enough to apply ‘reliability criteria’ like authorship … you need basic (adult) information (like octopuses don’t live in trees).
‘Critical thinking’ ineffective here, actual science effective.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Which ‘research’ site might lead to ‘misconception reinforcement’ (and what is that)?

A

YouTube. Increasingly sensationalist videos (learn more about why Earth is flat).

Guided (teacher) vs unguided learning.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

What is R….. M….’s Multimedia Principle?

A

presenting text and images together can enhance learning.

Richard Mayer proved with bicycle pump experiment

… he has another 29 principles

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

What does the split attention effect show?

A

The split-attention effect shows that (if textual materials must be presented in written form) closely integrating text and images leads to better learning than providing the text and image separately.

(Block of text and image vs closely integrated image and annotations)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

What is the ‘redundancy effect’?

Part of..?

A

Giving students irrelevant information whilst they are learning something will clog up their working memory.

This means students may remember the wrong stuff, not the parts of the information you actually want them to
… don’t talk over your slides.

Cognitive load theory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

What can we learn about creativity from Johannes Gutenberg?

A

Johannes Gutenberg developed his printing press using his skills as a goldsmith and his knowledge of how wine presses worked. He succeeded not by ‘conceiving an entirely new technology from scratch, but instead [by] borrowing a mature technology from an entirely different field, and putting it to work to solve an unrelated problem.’49

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

Summarise chapter 3: why can’t we just look it up?

A

We need knowledge in long-term memory to make sense of the world.

We need knowledge in long-term memory to use search engines effectively and identify misinformation.

We’ll still need knowedge in the future!

We need technology to help build memory, not to replace it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

What is the problem with project based learning?

A

The real world is not always a brilliant learning environment. The many elements of a typical authentic task can overwhelm working memory, meaning that even if students do manage to complete the project, they may not have learned anything from the process.

40
Q

What does DC say about using apps to promote engagement?

A

Distractions from intended learning outcome (learning about apps instead)

41
Q

What kind of project work can better support learning?

A

Narrowly defined (measuring heights project)

42
Q

Who invented the ‘forgetting curve’? After 9 hours? Month?

A

Herman Ebbinghaus in the late 19th Century, who also developed the idea of the ‘forgetting curve’. Ebbinghaus’s tests on his own memory showed that after learning something perfectly, he would start forgetting it almost immediately. After 9 hours, he forgot 60% of what he had learned, and after a month, 75%.26

43
Q

Bjork’s cramming warning?

A

Performance is not the same as learning.

44
Q

What did world’s foremost researcher on human expertise show in 2005? Name?

A

In a 2005 paper, K Anders Ericsson and colleagues show that it is possible to play tennis regularly for 20 or 30 years and still not improve, because a typical game situation often doesn’t provide great learning opportunities.

Skills must be broken down into smaller parts for practice.

45
Q

What is most significant use of multiple choice beyond retrieval practice?

A

Exploring misconceptions linked to wrong answers.

46
Q

What is the pupils’ response to the feedback?
“You need to be more systematic in planning your scientific inquiries.” I asked the student what that meant to him, and he said…

A

“… If I knew how to be more systematic, I would have been more systematic the first time.”

Dylan Wiliams example of accurate but not helpful feedback.

47
Q

What’s the problem with ‘flipped learning’?

A

A 2018 meta-review of 71 flipped-learning papers found the most commonly reported problems were students not engaging with or understanding the task they had to do before the class.46

48
Q

Summarise ‘how can we use technology to make learning active?’
(Complex / authentic tasks … quizzes / working memory)

Chapter 4

A

In order to learn, our minds need to be active

Complex and authentic tasks seem like they will promote mental activity, but in fact they can overwhelm our limited working memories.
COMPLEX TASKS ARE END GOAL, NOT STEPS ON THE WAY

Breaking complex tasks down into smaller chunks makes it easier for us to learn.
QUIZZES ARE A GREAT WAY TO LEARN BECAUSE THEY FORCE US TO BE MENTALLY ACTIVE BUT THEY DON’T OVERWHELM WORKING MEMORY.

We need digital quizzes that build up to a complex skill, making it easier for students to learn and helping us to learn the most effective ways of organising

49
Q

A 2017 meta-analysis of a variety of different technology access programmes, including some from OLPC, concluded that…

(One Laptop Per Child)

A

…they did not ‘measurably improve academic achievement’.

50
Q

BJ Fogg, director of the Persuasive Technology Lab at Stanford University, has developed a model of behaviour change that has become widely used by developers who want to make their product habit-forming.19

Examples…

A

… streaks

… likes

… removal of ‘friction’

… AI based ‘recommendations’

… swipe down refreshes

51
Q

2015, the OECD (Organisation for Economic Co-operation and Development) found that, in its member countries: ..% of 15-year-olds have access to a smartphone at home, and on average they spend about .. hours per week online at home

A

2015, the OECD (Organisation for Economic Co-operation and Development) found that, in its member countries: 91% of 15-year-olds have access to a smartphone at home, and on average they spend about 19 hours per week online at home

52
Q

Another study from 2017 showed that in their general daily use of their laptops, undergraduates on average switch from one window to another in their browsers every .. seconds.

A…….. s…….. (not m………..)

Yeykelis, L., Cummings, J. J. and Reeves, B., 2017. The Fragmentation of Work, Entertainment, E-Mail, and News on a Personal Computer: Motivational Predictors of Switching Between Media Content. Media Psychology, 21(3), pp.1–26

A

Another study from 2017 showed that in their general daily use of their laptops, undergraduates on average switch from one window to another in their browsers every 19 seconds.33

Attention switching (not multitasking)

Yeykelis, L., Cummings, J. J. and Reeves, B., 2017. The Fragmentation of Work, Entertainment, E-Mail, and News on a Personal Computer: Motivational Predictors of Switching Between Media Content. Media Psychology, 21(3), pp.1–26

53
Q

What do undergraduates do in lectures?

A

only 1.5% of undergraduate students reported not engaging in any multitasking:
63% reported using Facebook, and 69% reported sending text
94% of them used email during the lecture, and
61% used instant messaging
in a 100-minute lecture, on average, students spend 37 minutes on non-course-related websites.

54
Q

What does Marc Prensky claim in 2001?

A

Digital Natives are used to receiving information really fast. They like to parallel process and multi-task… They function best when networked. They thrive on instant gratification and frequent rewards. Digital Immigrants don’t believe their students can learn successfully while watching TV or listening to music, because they (the Immigrants) can’t. Of course not – they didn’t practice this skill constantly for all of their formative years…Today’s learners are different… Today’s teachers have to learn to communicate in the language and style of their students. Prensky, M., 2001, pp.2–3

55
Q

What does research show about multi-tasking ‘digital natives’?

A

Paul Kirschner and Pedro De Bruyckere found no evidence to support the existence of a generation of digital natives who think in fundamentally different ways from their predecessors.42 A 2017 meta-review found a negative relationship between academic performance and social network use among young people.43 Extensive evidence shows that nobody is that good at multitasking.44 Even a simple task like walking can be compromised by listening to music or texting.45 Attempting to combine more complex tasks causes even more problems, even for experts: doctors make more mistakes when they multitask as opposed to when they focus on one task at a time.46

56
Q

What did Glass and Kang find in 2018?

A

In a 2018 study by Glass and Kang, students were randomly split into two lecture groups.52 One group were allowed to bring devices to their lectures and use them if they wanted. The others received exactly the same lecture at a different time, but they could not bring a device to the lecture. The students in the ‘nodevice’ class did better on the final assessment. Fascinatingly, students in the ‘device’ class who chose not to use devices still did worse on the final assessment, which suggests that just seeing other students multitask is distracting. The same pattern has been found in another study.53

57
Q

What is the problem with distractions (such as Internet access)?

A

… distraction is bad for learning, as it promotes multitasking (or ‘task-switching’) and reduces the working memory resources going towards the topic being studied.

58
Q

What kind of smart device might help prevent problems with distraction in class?

A

The best kind of learning device might be a tablet or laptop that has no notifications as a default and that has easy-to-set lock modes that block the Internet. Learning apps could also automatically block the Internet and notifications when you are using them.

59
Q

Common refrain when pupils get distracted by tech..?

A

It’s a ‘classroom management problem’ (or activity not engaging enough)l

60
Q

Summarise chapter 5: ‘ how should we use smart devices?’

A

Connected devices are designed to distract us, and distraction is bad for learning. We need to ban or adapt.

Devices aren’t neutral: they change the way we think.

We need to ban or adapt connected devices to maximise learning.

61
Q

How are expert teachers like expert chess players?

A

They have large bodies of knowledge about typical classroom situations stored in their long-term memory which helps free up space in working memory to notice aspects of the new situation they are facing.

62
Q

What do ‘KK’ say is necessary do develop expertise?

A

Klein and Kahneman say you need high validity domains (complex environments that still behave (or about which judgements can be made) reliably and predictably) and focused practice.

63
Q

What is ‘the problem of expertise-induced blindness’?

A

When you know something so well you can’t think easily about it as a novice would.

64
Q

What is the advantage of algorithms over teacher decision making? For example with predictions?

A

Lack of bias. Consistency. Computers don’t have bad moods.

Makes me think about check lists of processes

65
Q

Why do we need human teachers?

A

To model, inspire and connect with.

66
Q

Why does handwriting matter?

A

there is compelling evidence that writing by hand has important cognitive benefits for both children and adults; learning to handwrite helps children learn to read, and for adults, taking notes by hand builds stronger memories than typing notes.34–35 If we moved everything in school on-screen, we’d miss out on these benefits.

67
Q

Why hiring more teachers and reducing class sizes isn’t effective?

A

It’s easy to hire more teachers, but harder to hire more good teachers. The number of bodies in a school doesn’t lead to direct increases in quality. Scaling-up quality is hard.

68
Q

Adaptive systems, quizzes and well-designed digital content have the advantage that they are r……… at s….. Indeed, the more people use them, the more powerful and useful they become as they gather data from more and more users, more than even the most experienced teacher can gather in a lifetime.

A

Adaptive systems, quizzes and well-designed digital content have the advantage that they are replicable at scale. Indeed, the more people use them, the more powerful and useful they become as they gather data from more and more users, more than even the most experienced teacher can gather in a lifetime.

69
Q

It would be possible to combine many of these different approaches and create a digital learning system that would include …

clc q ae att damd tafuc

A

curriculum-linked content, quizzes, an adaptive engine, and authoring tools for teachers to add their own content. Students could access this content through devices that have been adapted to minimize distractions from the Internet, and teachers could also access it for use in class.

70
Q

Summarise chapter 6: can tech help?

expertise / blindspots

adaptive / nudges

Social / tacit

Combine

Algorithms

Consistency / scale

A

Teachers have real expertise-and they have blindspots.

In some ways, technology can mimic this expertise, e.g. through adaptive systems that give hints and nudges the way a teacher would.

In other ways, technology can’t replicate this expertise, e.g. the social aspects of learning, teaching tacit knowledge, providing motivation and support.

We need to combine the expertise of teachers and technology.

It’s hard for teachers to know if a student has learned something for the long-term. Spaced repetition algorithms and long-term data collection can give teachers new insights.

All human experts find it hard to be consistent. Technology can help provide consistency and scale.

71
Q

What happens when teachers mark the same essay years apart? ( .. …… ……………….. )

A

One American study carried out exactly this experiment, by giving trained examiners the same essay to mark two years in row without their knowledge. The examiners had to grade the essays on a 6-point scale; only 20% of them gave the same mark both times.

72
Q

What is ‘margin of error’? ( …………………………………. ….. )

A

Ofqual showed that on a typical 40-mark exam essay question, there is a margin of error of +/–5 marks on average.

73
Q

What is ‘fractionated expertise’?

A

… when someone can be an expert in one area but not in another closely allied area.

(Being good at teaching, doesn’t necessarily follow that you’re good at assessment.)

74
Q

Four categories under marked by teachers?

A

ethnic minorities, from lower-income backgrounds, with special educational needs, and with behavioural problems.3–7

75
Q

What is the ‘anchoring effect’?

A

For example, if you mark a set of 20 essays, changing the essay you begin with can often influence all of your later judgements; this is known as the anchoring effect.8

76
Q

What is interesting about multiple choice marks?

A

They can be designed to assess quite sophisticated skills and often correlate quite well with scores on extended writing tasks.

77
Q

What is the weirdest thing about comparative judgement?

A

There is no mark scheme (comparative not absolute judgement)

78
Q

Which bias effect does comparative judgement eliminate?

A

Anchoring effect

79
Q

How many judgements required for comparative judgement? ( …. . ….. .. )

A

To get reliable scores, you need to make a lot of judgements. In 2018, the English exam regulator, Ofqual, carried out a research project into AS-level History which found that carrying out four judgements per script provided reliability equivalent to traditional single marking.26 Five judgements per script provided reliability equivalent to traditional double marking. The reliability kept improving as more judgements were added.

80
Q

Average judgement time for comparative judgement?

A

20 seconds

81
Q

Name a two problems with assessing with rubrics (one linked to rewards and the other to terms).

A

Being specific can reward mediocrity and gaming (‘spell most words correctly’).

We can disagree over subjective terms like ‘fluent’ or ‘confident’.

82
Q

Advice to pupils on ensuring use of advanced punctuation..?

A

Main character called Mary-Jane aged twenty-two. Hyphens!

83
Q

Weird philosophical point about nature of assessment and ‘tacit knowledge’?

A

We can know how to do something (‘tacit knowledge’) but be poor at explaining or defining the process … our ‘maxims’ or rules attempt to replace the ‘art’ but can’t do so.

84
Q

Summarise chapter 7: the expertise of assessment: can technology help?

open tasks

Algorithms / gaming

Algorithms + human judgement =?

A

Assessing open tasks like essays is necessary but hard to do reliably.

On their own, algorithms aren’t good at asssessing open tasks: it’s too easy to game their rules.

We need to combine the consistency of algorithms with the depth of human judgement. This is what comparative judgement does.

85
Q

Henry Ford is often quoted as saying, ‘….?’

A

‘… if I had asked people what they wanted, they would have said faster horses.’

86
Q

Daisy’s final negative thought?

A

(Biggest threat is) “the power of bad ideas. If we assume that learning styles exist, that cognitive overload doesn’t exist, that students can pick up knowledge as they go, and that attention is an infinite resource, we will never improve education…“

87
Q

Daisy’s final positive thought?

A

“Adaptive learning systems can provide more personalized teaching, spaced-repetition algorithms can make it easier for us to build long-term memories, and sophisticated uses of data can make assessment more precise and meaningful. “

88
Q

Average judgement time for comparative judgement?

A

20 seconds

89
Q

Name a problem with assessing with rubrics.

A

Being specific can reward mediocrity and gaming (‘spell most words correctly’).

We can disagree over subjective terms like ‘fluent’ or ‘confident’.

90
Q

Advice to pupils on ensuring use of advanced punctuation..?

A

Main character called Mary-Jane aged twenty-two. Hyphens!

91
Q

Weird philosophical point about nature of assessment and ‘tacit knowledge’?

A

We can know how to do something (‘tacit knowledge’) but be poor at explaining or defining the process … our ‘maxims’ or rules attempt to replace the ‘art’ but can’t do so.

92
Q

Summarise chapter 7: the expertise of assessment: can technology help?

Assessing open tasks is…?

Algorithms aren’t good at…?

We need to combine..?

A

Assessing open tasks like essays is necessary but hard to do reliably.

On their own, algorithms aren’t good at asssessing open tasks: it’s too easy to game their rules.

We need to combine the consistency of algorithms with the depth of human judgement. This is what comparative judgement does.

93
Q

Henry Ford is often quoted as saying, ‘….?’

A

‘… if I had asked people what they wanted, they would have said faster horses.’

94
Q

Daisy’s final negative thought? (Ls/ co / a)

A

(Biggest threat is) “the power of bad ideas. If we assume that learning styles exist, that cognitive overload doesn’t exist, that students can pick up knowledge as they go, and that attention is an infinite resource, we will never improve education…“

95
Q

Daisy’s final positive thought?

A

“Adaptive learning systems can provide more personalized teaching, spaced-repetition algorithms can make it easier for us to build long-term memories, and sophisticated uses of data can make assessment more precise and meaningful. “

96
Q

What is the name of the famous hoax that helps us think about reliability on the internet / critical thinking vs scientific knowledge?

A

The Pacific Northwest Tree Octopus