Topic 7 - Bias Flashcards

Question

Categories of cognitive bias | Effects

Answer 1

* Contexttual bias * Role effects * Motivational bias * Reconstructive effects

Answer 2

Where someone has other information aside from that being considered, which influences (either consciously or subconsciously) the outcome of the consideration.

Answer 3

* Are where scientists identify themselves within adversarial judicial systems as part of either the prosecution or defence teams. * This may introduce subconscious bias that can influence decisions, especially where some ambiguity exists.

Answer 4

Occurs where, for example, motivational influence on decision making, results in information consistent with a favoured conclusion tending to be subject to a lower level of scrutiny than information that may support a less favoured outcome.

Answer 5

* Can occur when people rely on memory rather than taking contemporaneous notes. * In this case people tend subsequently to fill in gaps with what they believe should have happened. * And so may be influenced by protocol requirements when recalling events some time later from memory.

Answer 6

Risks are bias are lower when results are clear and unambigous.

Answer 7

Risks of bias are greater when results are: * Complex * Poor quality * Increased reliance on subjective opinion

Answer 8

Risks are lower when there is a methodical approach with defined standards built on principles that have been tested and validated.

Answer 9

When the approach is unresearched and personal to the practitioner.

Answer 10

When practitioners and checkers are: * well trained * Experienced * Continuously meet acceptable standards of competence

Answer 11

When practitioners and checkers are: * inexperienced * Unmonitored * Left to adopt their own approach

Answer 12

* When interpretation is checked by a competent peer. * who conducts a separate interpretation fully independent and without influence from the reporting scientist.

Answer 13

When checking is less rigorous and or conducted collaboratively.

Answer 14

The reduction or elimination of the impact of bias in decision making and problem solving.

Answer 15

The practice of obtaining reliable information about physical objects through the processes of recording measuring and interpreting photographic images.

Answer 16

Exposure to other information that is irrelevant to the assessment but that introduces sub conscious bias into the findings.

Answer 17

The tendency when people rely on memory to fill in gaps on recall with what they believe should have happened.

Answer 18

* Being the sole reviewer of their critical findings * Being over-familiar with or trusting another person instead of relying on objective evidence * Having organisational and management structures that could be perceived to reward, encourage or support bias where - A culture of performance measurement - And time pressures could potentially pressurise examiners into biasing decisions.

Answer 19

* Important for constructing and testing relevant hypotheses and propositions. * However, if the whole case file is handed over to an analyst with all the detail, there is the perception that bias could have occurred and may be open to challenge in court

Answer 20

* This may be achieved through a proficiency-testing programme * Utilising mocked up casework samples for which the expected outcomes of testing and evaluation are known. * Whilst blind trials are the gold standard in providing the most reliable indicator of real-life performance, in reality they can be very time-consuming. * Good practice adopted by many laboratories is to undertake a mixed programme of both declared and undeclared trials, with the proficiency of all individuals tested on a regular basis

Answer 21

* Practitioners need training in how the evaluation procedures assist in overcoming some of these risks in their respective roles, as well as what residual risk may remain. * Given that susceptibility to psychological and cognitive influences varies between individuals, there may be merit in assessing these susceptibilities as part of the recruitment or selection procedures for new staff.

Answer 22

* The taking of contemporaneous notes or technical records is another stipulation in the Codes (section 15.2.3) * Adherence with this requirement wherever it is practicable to do so at all stages in the collection and processing of forensic evidence provides the best safeguard against potential reconstructive effects .

Answer 23

* This is where scientists are subconsciously influenced by acting on behalf of the defence or prosecution. * Difficult to demonstrably eliminate given the adversarial nature of the CJS within the UK. * These pressures can also apply in the case of police laboratories in providing services to an internal customer.

Answer 24

* Define the requirement * Develop an examination strategy * Agree the examination strategy with the client * Lead scientist instructs analyst to carry out forensic examinations and analyses * Review the quality and content of examination results * Compare the results with the reference samples and marks. * Evaluate and interpret the scientific findings and analytical tests * Second expert verifies the findings * Communicate the scientific findings and analytical tests

Answer 25

It is the responsibility of the expert to: * Reveal their work (disclose) * Record all information received * Record details of interpretation

Answer 26

When working in the evaluative mode, the expert goes through: * A formal process of pre-assessing the expected probabilities * For a realistic range of possible outcomes * In as many or as few categories as is sensible for the examination * Recording their opinions

Answer 27

* At source level, and certainly at activity level, it may be that each category in the realistic list of outcomes is considered firstly under the assumption that the prosecution hypothesis is true, and secondly under the assumption that the defence hypothesis is true. * These are used to provide an expected outcome that may be either qualitative or quantitative with the latter expressed as a likelihood ratio.

Answer 28

* Identify whether the scientist’s role in the case is investigative (for example, intelligence) or evaluative (judicial) * Seek clarity on what are the issues, the purpose and how this fits into the hierarchy of sub-source (for example, touch DNA), source, activity and offence level propositions.

Answer 29

* Formulate relevant prosecution and defence alternatives based on the case circumstances and information provided. * Consider any agreed assumptions that are used in formulating these alternatives. * Use assessment of possible outcomes to determine which tests are most informative and discriminating. * Use this pre-assessment to assign a weight to an exhaustive list of possible outcomes, giving the expected outcome for each, expressed as a LR where these are quantitative. * This approach provides clarity on the alternatives being considered, and the pre-assessment of weight for all outcomes avoids the potential bias of using the observed results to assign weight of evidence.

Answer 30

* Review the quality and content of examination results. * Decisions on the suitability of the results and marks for later comparison are made at this stage, to avoid post-comparison rationalisation of opinion on quality. * Compare the results with the reference samples and marks. * The quality and suitability of the questioned result has already been assessed so this is not influenced by the reference result.

Answer 31

* Mitigate the confirmation bias by using the LR or qualitative expectation that was assigned to each outcome before the examinations and tests were performed * Pre-assessment enables the scientist to explain how the weight of the evidence has been assigned * Provide details of the assumptions that have been made * Give the basis of the expert opinion and specify the propositions considered, with the reasoning for these, based on the case context * Include any limitation of the opinion * Where there is a range of opinion on the matters dealt with in the report, the expert’s report must summarise the range of opinion and give reasons for the expert’s own opinion as required by the Criminal Procedure Rules

Answer 32

* Verification by a second expert - Independent review at this stage in advance of communicating the result to the client * Communicate the scientific findings and analytical tests

Answer 33

The police response to a reported crime requires many factors to be taken into consideration: * Preserving the scene * Securing evidence * The speed of response * The proportionate use of resources based on the seriousness of the crime * All are overridden by the most pressing priority -the preservation of life

Answer 34

The potential impact may be significant, for example: * It could result in failure to secure the required evidence if a crime scene. * An investigation could be closed prematurely, resulting in crucial evidence being lost. * It could mislead an investigation by investigators focusing too early and incorrectly on a false lead, and other evidence is potentially overlooked. * If undertaken incorrectly activities could result in ‘psychological contamination’ of evidence downstream in the forensic analysis and interpretation processes.

Answer 35

Gathering information prior to scene attendance. * Prior to scene attendance information is gathered from any available source regarding the incident to be investigated. * This may include witness or victim accounts as to what is alleged to have happened and by their nature these may.

Answer 36

The cognitive processess entail: * Determining locations and boundaries of the scene * The entry/exit points of the offender * Information received and inferences

Answer 37

* The past experiences of an individual on which they may base their decisions are subjective. * Convenience may be more relevant and have more impact in real life. - For example, establishing the boundary by taping from lamp post to lamp post is commonplace simply because they are already there.

Answer 38

* Selection of equipment * Decisions on which images to capture * An assessment of the current case needs plus some anticipation of future needs. * Depending on how the written record is crafted, there is a risk that contextual or confirmation bias may be introduced. downstream in the investigative process.

Answer 39

* Requires an understanding of the investigative needs of the case to observe, discover and recover evidence to meet both present needs and those anticipated for the future. * If guidance for these decision-making processes is not explicitly documented then actions taken at this stage are largely reliant on the examiners intuition and tacit knowledge which in turn are susceptible to bias.

Answer 40

* Whilst slower, is preferable as the former provides less risk of introducing bias into the transfer of information. * Is more transparent about the decision making process.

Answer 41

* Items are received along with case information and questions to be addressed by the scientific work. * The case information is used to direct the DNA recovery and analysis strategy, ideally within a framework of appropriate propositions. * Findings are checked by a competent colleague/peer * A statement or report is issued * The scientist may be called to court to give oral testimony

Answer 42

If non-complex DNA results are obtained that match a suspect, an appropriate random match probability or likelihood ratio (LR) estimate is assigned.

Answer 43

If complex mixed DNA results are obtained that can be numerically evaluated the probability of the mixed result is calculated under appropriate prosecution and defence hypotheses and a LR is assigned

Answer 44

If complex DNA results are obtained that do not lend themselves to statistical evaluation, in some circumstances, a qualitative assessment is made and an opinion about the significance of the DNA results can be put forward.

Answer 45

* In 2012, Pickering was convicted at the Crown Court on one count of sexual assault on a girl under the age of 13 * He was sentenced to 30 months imprisonment

Answer 46

* Pickering's partner had an arrangement that they would babysit for each other * On 9 September 2011 she left her children, P (a girl of 12), D (a boy of 8) and M (a girl of 8) with Pickering and his partner for them to babysit with their own child, C aged six * Between 2230 and 2330, Pickering's partner went to bed leaving him with the children. He had consumed a quantity of beer

Answer 47

* ‘P’s evidence is that Pickering touched her vagina over her clothes * Afterwards he asked to go into the kitchen with him * He lifted up her top and touched and sucked her breasts and gave her a love bite * He then pulled her top down and removed her lower clothing and began licking or sucking her vagina

Answer 48

* She denied that Pickering had given her a wedgie and denied making the allegation up * The following morning the victim showed her father the red mark on her neck and told her parents that Pickering had sucked her breasts and vagina * Victims evidence was that he had tickled his son and given him a wedgie * Pickering denied touching ‘P’ inappropriately

Answer 49

Four swabs were taken from P 1. Left breast swab 2. Vulva swab 3. Knickers 4. Vest top

Answer 50

* Visible cream-coloured staining was visible in the gusset. * Amylase was found to be present in a high concentration. * A mixed DNA profile contributed to by at least three people * All the components of the DNA profiles of ‘P’ and all but one of the components of the DNA profile of Pickering were present * There were two components definitely present and three other components possibly present that could not have come from P or Pickering

Answer 51

Amylase is a main constituents of saliva where it is usually present in high, though variable concentrations although it is present in other body fluids, a high concentration is indicative of the fluid being saliva

Answer 52

* Not possible to determine if saliva was present * DNA analysis showed the possible presence of DNA from more than one person * All of the confirmed components corresponded with the components in Pickering's DNA profile * The other components found matched the components of P's DNA profile

Answer 53

* Not possible to determine if saliva was present * DNA analysis showed the presence of DNA from more than one person * All of the components could have originated from either ‘P’ or Pickering

Answer 54

* Not possible to determine if saliva was present * DNA analysis indicates the presence of DNA from at least three people * All of the corresponding components from ‘P’ and Pickering were present * There were components which could not have originated from ‘P’ or Pickering

Answer 55

* None of the DNA results were suitable for statistical analysis as there must have been at least one other unknown person who contributed to the mixed profile * Based on the scenario that Pickering had licked P’s left breast and vagina the findings could entirely be explained by her account. * On Pickering's account findings were unlikely * He concluded that the results were more likely to be consistent with P’s account than Pickering's account but he could not express a view on the strength of support is no statistical evaluation could be carried out

Answer 56

The DNA evidence relating to the knickers should not be admitted in terms of either: * Amylase * DNA The inability to provide an objective strength of support skill opinion demonstrated that the conclusions were not scientific. Pickerings defense appealed the conclusions of the DNA evidence

Answer 57

* If all of the DNA evidence did was to show that the findings were consistent with ‘P’s’ account and that Pickering could not be excluded then its relevance was peripheral * It was however prejudicial and confusing and should not have been admitted * The case is solely on whether or not Pickering was a possible contributor and could not be excluded thus the contention that there was no statistical evidence or no evaluative evidence in the form of a hierarchy was not relevant

Answer 58

The quality of being acceptable or valid, especially as evidence in a court of law.

Answer 59

Unable to be accepted in the court of law

Answer 60

* That the presence of amylase in the knickers was strong supportive evidence of ‘P’s’ account. * That account was also supported by evidence of recent complaint * The and the evidence was relevant and it was properly admitted and correctly summed up to the jury * The conviction is safe

Answer 61

* In addition to the routine application of enhanced sensitivity techniques, multiplexes in 2015 frequently achieve results from low quantities of DNA * The incidence of complex mixtures and of low template profiles exhibiting stochastic effects is increasing and so the conditions in which subjective opinion tends to be relied on are more commonly encountered * As a consequence, there is an increasing risk of cognitive contamination affecting DNA evidence.

Answer 62

* Convicted of burglary robbery and manslaughter & sentenced to imprisonment for public protection for seven years * Subsequently retried and convicted of manslaughter & robbery and sentenced to 9 years in prison

Answer 63

* On 27th November 2008 an elderly lady's house in North London was burgled * On 1 January 2009 the victim was found dead in her house * She had been tied up and being unable to free herself had died from hypothermia * Her ankles and wrists had been bound with silver tape and her mouth had been gagged with the same tape to stop her screaming * The house had been ransacked

Answer 64

* Kuba Dlugosz, 33, of no fixed address, was wanted on a European arrest warrant for skipping prison in Poland when he attacked the 83-year-old at her £1million house in Leweston Place, where she had lived since childhood. * The convicted robber fled to the UK in 2007

Answer 65

* No fingerprints were found * It was assumed the offenders had worn gloves * The only forensic evidence was a very small quantity of DNA on two of the three chisels left at the premises * The amounts were less than 200 pg. * The results showed a mixed profile * When arrested in July 2010 he answered no comment to all questions.

Answer 66

* Whilst on remand his telephone calls were recorded. * In September 2010 his co-offender Wyrostek was arrested for the same offence. * He had admitted his part in the burglary and admitted they put masking tape on the victims face.

Answer 67

* Applied to exclude the DNA evidence * His previous convictions were put before the jury * He did not give evidence

Answer 68

* The quantity of DNA recovered from chisels was very low * The largest yielded 119 pg. * The trial focused on two samples from the chisels all found at the house * Chisel two, the handle BRW/1/3 * Chisel two, the blade BRW/1/3

Answer 69

* The crime sample was revealed it was a male and contained mixed profiles. * Although the results could not be separated out to individual contributors, several of the alleles in the appellant's DNA were represented as prominent components. * The experts will also agreed that it was impossible to provide statistical/numerical assessment of the likelihood ratio

Answer 70

* The Defence accepted that Dlugosz could have made a contribution to these samples. * However the number of contributors to the DNA profiles could not be determined. * It was impossible to resolve these mixed DNA profiles into individual profiles of the contributors. * It was therefore not possible to calculate a robust statistic indicating the strength of the link between Dlugosz and DNA in the two samples. * Although they provided an investigative lead they did not provide cogent evidence.

Answer 71

The prosecution scientist, in an effort to be helpful expressed the view: * “…To evaluate these results I have considered the following two propositions” * DNA from Dlugosz was present on the swabs * Or DNA from Dlugosz was not present on the swabs * In my opinion, the DNA profile results provide support for the presence of DNA from Dlugosz on the swab but I am unable to quantify the level of this support

Answer 72

The defence sought to exclude the evidence of DNA: * Because without statistical evaluation * Its significance could not be evaluated * It should not be placed before the jury

Answer 73

* The jury heard the evidence of the two experts and were in a position to use that evidence in accordance with a clear and careful summing up bearing in mind the difference between the two experts was not that great. * One saying it was rare and the other saying it was somewhat unusual

Answer 74

* It was argued but there was a real danger that (a) the jury had taken weak DNA evidence and then been (b) prejudiced by the previous convictions of Dlugosz, particularly those that were 8½ years old. * It seemed to the appeal that considering the totality of the evidence that the view of the experts on DNA that finding all of the individual’s alleles in a mixed sample of the kind analysed in the case was either “rare” or “somewhat unusual” was of real assistance. * Taking the evidence of the telephone conversations there was, in the appeals judgement sufficient evidence of previous convictions to be properly open to consideration in determining the guilt. Taking all that evidence together and the judges careful, clear and fair summing up they saw no reason to consider the conviction unsafe

Answer 75

* Within of England and Wales no prior disclosure of the defendant’s account is required * This often means that the DNA scientist is required to make their own, suppositions about appropriate defence hypotheses.

Answer 76

Currently deployed in the UK and overseas: * Prior interpretation of the case sample result before the reference result is revealed * Formally noting the following from the DNA result, prior to comparison with the reference profile a. Suitability to include or exclude b. Assessment of the number of contributors c. Level of representation of contributors d. Potential for stochastic effects e. Identification of likely/unlikely genotype combinations that might explain the mixture

Answer 77

* Full checking via repeat interpretation by an experienced and competent colleague - Including prior interpretation of the case sample result before the reference result is known * The check should be conducted independent of and uninfluenced. - The reporting scientist should use original unmodified hard copy or electronic results that are free from annotation.

Answer 78

* Of case stains/samples for testing to minimise the occurrence of mixtures and low template issues. * The selection should be informed by case information. * Duplicate analyses to assess stochastic effects in low template samples * Replication should be applied whenever a poor quality profile is to be relied on to progress an investigation or provide evidence against a suspect. * It improves the scientist’s ability to gauge accurately whether or not the sample is suitable for any form of comparison or statistical evaluation.

Answer 79

* Is carried out blind, in the complete absence of any information about the case * This approach is practised in some jurisdictions and eliminates the risk of some types of bias * It does present the practical challenge of separating - Case strategy - Hypotheses testing - Stain selection, etc. * From result interpretation and reporting in the context of the case

Answer 80

* When a numerical evaluation is not possible, it remains of crucial importance that qualitative & subjective judgements of pertinent profile features and their combined likelihood are assessed under the hypotheses framed by both the prosecution hypothesis and defence hypothesis separately. * The final opinion of evidential weight must be based on how much, if any, comparison of separate assessments favours one hypothesis over the other, as with a likelihood ratio (LR).

Answer 81

* Repeats the full interpretation described in previous tests but in the absence of any contextual information relating to the case. * This may present practical challenges, particularly within small organisations. * But may provides assurance for the courts that the interpretation is free from contextual bias.

Answer 82

If there is no suitable option for objective evaluation, only employ qualitative and subjective-based approaches that: * Have been validated * And therefore have demonstrated robustness of resultant conclusions and opinions Such procedures should include system performance data indicating when the approach breaks down and is no longer valid ## Footnote All supported by training and education

Answer 83

* Improved note taking, including a demonstration of features used in identification. * A complex marks process to manage variance in opinion between examiners. * Those involved in the technical review process have no prior knowledge or access to case-related information or the technical findings of any other examiners. * A blind verification process for lead identifications in which verifying examiners have no knowledge of the technical findings of any previous examiners. * The removal of any case context information or related communication documentation from the verification process in any circumstances. * Regular dip-sampling of all completed casework. * Training programmes for examiners exploring cognitive bias and its impact on the human decision-making process.

Answer 84

* ACE-V is the most commonly accepted approach to fingerprint comparison in the UK and the USA. * An examiner analyses a mark. * The examiner than compares the mark with a known print. * Having compared the images, the examiner evaluates what they have seen and reaches a decision and the results are then subject to vertification by one or more addtional examiners.

Answer 85

* Contextual * Confirmation * Cultural

Answer 86

* Nature and details of the crime including background information * Association with or personal knowledge of the victim or their circumstances * Status of suspects or person(s) already in custody for the crime * Previous criminal activity of suspects or persons of interest * Location of the crime (an area close to their home) * Media or public interest associated with the crime * Personal moral codes or behaviours * Time pressure from investigating officers or office managers

Answer 87

* Police Officers or prosecution services, with both hoping that the examination outcomes will help to ‘solve the case’ or ‘secure a conviction’. * Contributing to the detection of crime is considered a fundamental aspect of fingerprint bureau service delivery * Personal identification or ‘hit’ rates are used as key performance indicators at both organisational and individual level. * A personal moral code to ‘do the right thing * Having prior knowledge of the previous examiner’s findings and conclusions may also expose fingerprint examiners to the risk of confirmation bias. * Having found a number of features from an unknown impression to agree with features in an impression from a known source, the examiner will then begin to reason backward, finding features in the unknown impression that are suggested by those in the known print.

Answer 88

Cultural influence that can impact on the decision-making process include: - Strict hierarchical structures based on time served rather than competence - Over confidence in individual or organisational competence - Lack of interaction with peers or exposure to alternative methods of working - Lack of acceptance of the potential for errors or effective root cause analysis of errors.

Answer 89

1. Brandon Myafield 2006 2. Shirley Mckie 1999

Answer 90

* Following the procedure review instigated as a result of the Brandon Mayfield case, the FBI introduced a system of blind verification * The independent application of Analysis, Comparison, and Evaluation (ACE) by another qualified examiner who does not know the conclusions of the primary examiner

Answer 91

* Those with a single mark conclusion * Circumstances where there are conflicts between examiners * Circumstances where there are conflicts on decisions of ‘value’ or ‘no value’

Answer 92

* Introduce control mechanisms for consideration with regard to fingerprint examination. * Survey and breakdown the extent of current contextual information available to examiners and assess the added value that each piece of information brings to the examination process. * Remove or limit contextual information that adds no tangible value to the fingerprint examination process. * Remove or limit contextual information made available to verifying or subsequent examiners.

Answer 93

* Introduce a blind verification process for identified casework assessed as at greatest risk Introduce a blind element to a technical review process for analyses, comparisons and/or evaluations that are considered complex or cause a variance in opinion between examiners * As part of a technical review process for complex marks or circumstances where examiners have a variance in opinion, introduce an appropriate and proportionate note-taking strategy, which requires examiners to provide written and visual accounts of their reasoning and findings

Answer 94

* Develop bespoke training programmes to raise awareness of the cognitive issues * As part of an established quality management system, instigate an effective review and monitoring process to provide assurance that the risk treatment and control measures continue to provide effective risk management.

Answer 95

a. Examine the item/mark recovered from the crime scene b. Use recovery and enhancement techniques as required c. Generate/examine the ‘control’ item d. Make test marks if required in the appropriate manner e. Undertake a comparison using appropriate methods and equipment. f. Interpret and evaluate findings g. Verify the result h. Describe findings in a statement or report i. The scientist may be called to court to give oral testimony

Answer 96

* If a ‘mark’ (the unknown) * Has been made by the submitted exhibit (the known) * Or has been made by the same item, for example, a revolver that has not been recovered could be responsible for discharging multiple bullets.

Answer 97

- The comparison of detail and is therefore observational. - Any examination is dependent on the visual quality and clarity of the detail that is observed by the examiner. - Process of pattern recognition.

Answer 98

* Determine if the detail present in the mark * Matches characteristic detail on the item * Or in a test mark * Or is significantly different * An assessment of what the detail is and how it has been produced must consider general characteristics common to a set of items.

Answer 99

* The final assessor of the level of significance of any agreement between the marks is the human operator; there is no significant instrumental analysis. * In footwear mark comparisons, the methods are normally side-by-side comparisons or overlay. * In this way the footwear expert assesses the level of agreement in terms of the pattern, pattern configuration, mould/moulding detail, wear and damage. * The assessment is subjective, although reference material and data can be used to support the evaluation of the findings.

Answer 100

The detail in the marks is clear, well defined and unambiguous.

Answer 101

Marks are confused and complex, of poor wuality and the detail present is poorly defined

Answer 102

Optimum visualisation of the detail in a mark using appropriate equipment and enhancement techniques.

Answer 103

Poor or inappropriate equipment and enhancement techniques.

Answer 104

* There is a methodical approach with defined standards built on principles that have been tested and validated. * Possible confirmation bias may reduce as a consequence of the comparison reviewer having less contextual information.

Answer 105

* When the approach is unresearched and personal to the operator. * When the expectation of an ipen case file hit is very low.

Answer 106

Scientists/examiners are well trained, expereinced and continuously meet acceptable standards of competence.

Answer 107

Scientist/examiner are inexperienceed, unmonitored and left to adopt their own approach.

Answer 108

* Comparison of expected, pre-assessed outcomes of appropriate hypotheses with actual results. * Full disclosure of all data used in the evaluation. * In all firearms classification cases, the reviewer should clearly set out what is official guidance and what is statute, ensuring that alternative classification hypotheses are addressed to counter any confirmation bias * Use a completely ‘blind’ checker who repeats the full interpretation, but in the absence of any contextual information relating to the case. * An acceptable alternative is that the result will be subject to a critical findings check by a second authorised examiner. The checker then undertakes a detailed independent review wherever possible without knowledge of the previous practitioner’s conclusion.

Answer 109

* Validation testing of qualitative and subjective-based approaches to demonstrate the robustness of conclusions and opinions * Development of standards and quality managed procedures for qualitative and subjective-based methods, including system performance data indicating when the approach breaks down and is no longer valid * Practitioner training in the specific method used, together with initial and ongoing competency assessment. * Training and education in relation to the risks of cognitive bias in firearms classification and marks’ comparison generally. * An approach to quality that includes the assessment and ongoing monitoring of the competence of practitioners including the use of proficiency tests, declared and undeclared trials. * Providers should ensure that a validated form of context management is applied. * The use of blind trials should be introduced to increase the ‘success’ rate of cold hits.

Answer 110

* Contact trace evidence includes a wide range of materials. * Including particulate material such as glass, paint, hairs and fibres. * However, whilst the range of particulate trace materials is wide, the analysis of such material essentially follows the same process, which involves the comparison of crime (unknown - recovered) material with one or more known/reference samples.

Answer 111

* The examiner is often presented with a large amount of debris that potentially contains some of the target material and other materials which have no relevance to the case. * The material can then be compared with the relevant reference sample(s) using the appropriate microscopy and instrumental/analytical techniques. * It is necessary to review the reference sample (s) and use features to enable an initial search of the recovered material to locate that which is of potential interest. * This material can be recovered for more detailed comparison. using the appropriate microscopy & instrumental - analytical techniques. * Scientific findings are evaluated and interpreted within the context of the case-specific information available (may be at source and/or activity level as appropriate). * A report or statement describing the findings and providing an opinion on their significance is then provided.

Answer 112

* The examination of car seat tapings for a transfer of fibres from the clothing of an individual who is alleged to have stolen and driven the car for some hours results in no matching fibres being found. * The defendant has made no comment * In this situation, it is tempting to conclude that the absence of matching fibres is neutral and does not assist in addressing whether or not the individual had been in the car. * However, if the information available provides no explanation for the absence of matching fibres (for example, the defendant might have had time to change clothing before arrest) and the scientist had a high expectation of finding matching fibres if the contact had occurred as alleged, the absence of matching fibres may well support the view that the defendant had not been in the car.

Answer 113

* A fibre examiner faces considerable difficulty in dealing with cases where clothing has been altered at a chemical level in the period between the offence and seizure of the clothing * For example, where the body of a victim has been submerged in a river or at sea for some time, causing the dye in the clothing to fade * In this situation, the challenge for a fibre. examiner is firstly searching for fibres without a reference sample that is representative of the fabric at the time of the offence.

Answer 114

* Independent checking – where only subjective observational assessments of a match are possible. * Independent checking of analytical results – where instrumental techniques are used. * Use of statistical approach to evaluation – A statistical approach can be applied rather than relying on the experience of the practitioner. * Case assessment and interpretation – a robust and documented comparison of expected, pre-assessed outcomes with actual results under appropriate competing hypotheses. * Training – appropriate training of practitioners in the methods employed can demonstrate initial and ongoing competence. * Quality assurance trials

Answer 115

* Recovery of video, photo or audio material related to the crime scene. * Items are received by the analyst along with relevant case information and the questions to be addressed by the scientific work * Generation of an exact copy of the original, then use of techniques as required to clarify or clean up the copy of the image or audio signal. * Examination of the copied material recovered from the crime scene and notation of features determined to be reliable * Examination of the ‘control’ item. * Undertaking a comparison using appropriate methods and equipment. * Interpreting and evaluating findings * Verification of the result. * Findings are described in a statement or report. * The scientist may be called to court to give oral testimony.

Answer 116

Level 1 - The trace evidence Level 2 - Reference materials Level 3 - The case information Level 4 - Base rate expectations that arise from their experience (e.g., when the examiner expects a particular result. Level 5 - Organizational and cultural factors.

Answer 117

* A straightforward tool for dealing with bias from case information (Level 3) * Designed to prevent contextual bias by protecting the examiner from exposure to task-irrelevant information.

Answer 118

* Some types of information, while potentially biasing, may also be task relevant (5). * For example, in some instances, evidence that analysts must examine, to perform their duties may contain information that is potentially biasing. * For example, cases in which Level 1 information, the trace evidence being evaluated, contains contextual information (e.g., blood spatter patterns that contain information about the nature of the crime, or handwriting and voice samples in which the meaning of the words is potentially biasing)

Answer 119

* Another example of relevant material that is also potentially biasing * These samples are clearly relevant because the analyst must compare them to trace evidence samples to determine whether they are similar enough to conclude that they come from the same source. * But it is possible that an analysts interpretation of the trace evidence might inadvertently be influenced by knowing the characteristics of the reference samples.

Answer 120

This approach is linear in the sense that one must begin with the trace evidence before being exposed to and working with the reference material, thus working from the evidence to the suspect, rather than from the suspect to the evidence.

Answer 121

* This approach does not prevent exposure to biasing relevant information. * However, it does mandate that this information be presented as late as possible in the examination process and only when it is necessary.

Answer 122

A critical element of sequential unmasking is that the forensic examiner must first examine and document the trace evidence from the crime scene (Level 1), before being exposed to the known reference material (Level 2).

Answer 123

* The trace evidence should be interpreted the same in this initial step, regardless of any suspect who is considered as a possible (or even likely) source of the trace evidence. * However, according to sequential unmasking examiners are permitted to revisit, as well as change, their initial analysis of the trace evidence once they have reviewed the reference material, provided that they document these changes.

Answer 124

* Cogntive architecture and the brain * Training and motivation * Organizational factors * Base rate expectations * Irrelevant case information * Reference materials * Case evidence

Answer 125

* Human nature * Environmental culture & Experience * Case specific

Answer 126

When irrelevant context information about an event or the way in which the information is presented influences reasoning

Answer 127

Interpreting information or looking for new evidence in a way which conforms to pre-existing beliefs or assumptions.

Answer 128

Being accustomed to a particular result occurring at a certain rate and then expecting it to keep occurring at the same rate.

Answer 129

As far back as 2009, NAS report criticized forensic scientists for making insufficient efforts to reduce their vulnerability to cognitive and contextual bias.

Answer 130

The Organization of Scientific Area Committees (OSAC),as well as the National Commission on Forensic Science, have created committees on human factors that are specifically charged with examining this issue of bias.