When ‘neutral’ evidence still has probative value (with implications from the Barry George Case)

Article


Fenton, Norman, Berger, D., Lagnado, David, Neil, Martin and Hsu, Anne 2013. When ‘neutral’ evidence still has probative value (with implications from the Barry George Case). Science & Justice. 54 (4), pp. 274-287.
AuthorsFenton, Norman, Berger, D., Lagnado, David, Neil, Martin and Hsu, Anne
Abstract

The likelihood ratio (LR) is a probabilistic method that has been championed as a ‘simple rule’ for evaluating the probative value of forensic evidence in court. Intuitively, if the LR is greater than one then the evidence supports the prosecution hypothesis; if the LR is less than one it supports the defence hypothesis, and if the LR is equal to one then the evidence favours neither (and so is considered ‘neutral’—having no probative value). It can be shown by Bayes' theorem that this simple relationship only applies to pairs of hypotheses for which one is the negation of the other (i.e. to mutually exclusive and exhaustive hypotheses) and is not applicable otherwise. We show how easy it can be – even for evidence experts – to use pairs of hypotheses that they assume are mutually exclusive and exhaustive but are not, and hence to arrive at erroneous conclusions about the value of evidence using the LR. Furthermore, even when mutually exclusive and exhaustive hypotheses are used there are extreme restrictions as to what can be concluded about the probative value of evidence just from a LR. Most importantly, while the distinction between source-level hypotheses (such as defendant was/was not at the crime scene) and offence-level hypotheses (defendant is/is not guilty) is well known, it is not widely understood that a LR for evidence about the former generally has no bearing on the LR of the latter. We show for the first time (using Bayesian networks) the full impact of this problem, and conclude that it is only the LR of the offence level hypotheses that genuinely determines the probative value of the evidence. We investigate common scenarios in which evidence has a LR of one but still has significant probative value (i.e. is not neutral as is commonly assumed). As illustration we consider the ramifications of these points for the case of Barry George. The successful appeal against his conviction for the murder of Jill Dando was based primarily on the argument that the firearm discharge residue (FDR) evidence, assumed to support the prosecution hypothesis at the original trial, actually had a LR equal to one and hence was ‘neutral’. However, our review of the appeal transcript shows numerous examples of the problems with the use of hypotheses identified above. We show that if one were to follow the arguments recorded in the Appeal judgement verbatim, then contrary to the Appeal conclusion, the probative value of the FDR evidence may not have been neutral as was concluded.

KeywordsLikelihood ratio; Evidence evaluation; Bayesian networks
JournalScience & Justice
Journal citation54 (4), pp. 274-287
ISSN1355-0306
1876-4452
Year2013
PublisherElsevier
Digital Object Identifier (DOI)doi:10.1016/j.scijus.2013.07.002
Publication dates
Print16 Aug 2013
Publication process dates
Deposited25 Jan 2017
Accepted17 Jul 2013
Copyright information© 2013 Elsevier
Permalink -

https://repository.uel.ac.uk/item/85w7y

  • 7
    total views
  • 0
    total downloads
  • 1
    views this month
  • 0
    downloads this month

Related outputs

‘Forgotten Lore’: Can the Socratic method of teaching be used to reduce the attainment gap of black, Asian and minority ethnic students?
Berger, D. and Wild, Charles 2017. ‘Forgotten Lore’: Can the Socratic method of teaching be used to reduce the attainment gap of black, Asian and minority ethnic students? Higher Education Review. 49 (2), pp. 29-55.
The central importance of co-curricular activities as an authentic assessment mechanism within modern legal education
Berger, D. and Wild, Charles 2015. The central importance of co-curricular activities as an authentic assessment mechanism within modern legal education. The UH Annual Learning and Teaching Conference. Hatfield, United Kingdom 07 May 2015 University of Hertfordshire.
Social Media and the Student Experience
Berger, D. and Wild, Charles 2015. Social Media and the Student Experience. in: Jefferies, Amanda and Cubric, Marija (ed.) Proceedings of the 14th European Conference on e-Learning Hatfield UK Academic Conferences and Publishing International Limited. pp. 639-646
The Real Deal: Using formative assessment techniques in authentic assessment delivery, to improve law degree academic performance
Berger, D. and Wild, Charles 2015. The Real Deal: Using formative assessment techniques in authentic assessment delivery, to improve law degree academic performance. in: Proceedings of IAC-TLEl 2015 in Vienna Czech Institute of Academic Education z.s.. pp. 113-119
Getting The Job Done: Using Authentic Assessment Techniques In Extra And Co-Curricular Activities (Eccas) To Improve Law Students’ Employability Prospects
Berger, D. and Wild, Charles 2016. Getting The Job Done: Using Authentic Assessment Techniques In Extra And Co-Curricular Activities (Eccas) To Improve Law Students’ Employability Prospects. in: Proceedings of 23rd ISERD International Conference, Barcelona, Spain International Society for Engineering Research and Development (ISERD). pp. 53-59
Practice Makes Perfect: Using authentic assessment techniques in Extra and Co-curricular course (ECCAs) delivery to reflect the Solicitor’s Regulation Authority’s (SRA) change towards legal vocational stage delivery
Berger, D. and Wild, Charles 2016. Practice Makes Perfect: Using authentic assessment techniques in Extra and Co-curricular course (ECCAs) delivery to reflect the Solicitor’s Regulation Authority’s (SRA) change towards legal vocational stage delivery. International Journal of Arts & Sciences (IJAS).
The Teaching Excellence Framework: would you tell me, please, which way I ought to go from here
Berger, D. and Wild, Charles 2016. The Teaching Excellence Framework: would you tell me, please, which way I ought to go from here. Higher Education Review.
Enhancing student performance and employability through the use of authentic assessment techniques in extra and co-curricular activities (ECCAs)
Berger, D. and Wild, Charles 2016. Enhancing student performance and employability through the use of authentic assessment techniques in extra and co-curricular activities (ECCAs). The Law Teacher. 51 (4), pp. 428-439.
Response to “On the use of the likelihood ratio for forensic evaluation: Response to Fenton et al.”
Fenton, Norman, Lagnado, David, Hsu, Anne, Berger, D. and Neil, Martin 2014. Response to “On the use of the likelihood ratio for forensic evaluation: Response to Fenton et al.”. Science & Justice. 54 (4), pp. 319-320.
Using Authentic Assessment Techniques in Extra & Co-Curricular Activities (ECCAs) to Improve Teaching Standards on Academic Law Programmes
Berger, D. and Wild, Charles 2015. Using Authentic Assessment Techniques in Extra & Co-Curricular Activities (ECCAs) to Improve Teaching Standards on Academic Law Programmes. Journal of Commonwealth Law and Legal Education. 10 (1), pp. 70-83.
The proposed Teaching Excellence Framework (TEF) for UK Universities
Berger, D. and Wild, Charles 2016. The proposed Teaching Excellence Framework (TEF) for UK Universities. in: Rotschedl, Jiri and Cermakova, Klara (ed.) Proceedings of the 22nd International Academic Conference Prague, Czech Republic International Institute of Social and Economic Sciences (IISES). pp. 311
Bayes and the Law
Fenton, Norman, Neil, Martin and Berger, D. 2016. Bayes and the Law. Annual Review of Statistics and Its Application. 3 (1), pp. 51-77.
Get Real: Using authentic assessment techniques to improve law degree academic performance
Wild, Charles and Berger, D. 2015. Get Real: Using authentic assessment techniques to improve law degree academic performance. in: Cermakova, Klara and Rotschedl, Jiri (ed.) Proceedings of the 2nd Teaching & Education Conference, Florence Prague, Czech Republic International Institute of Social and Economic Sciences (IISES). pp. 129-140
Giving Students the Third Degree: Using Authentic Assessment Techniques in Extra & Co-Curricular Activities (ECCAs) to Improve Teaching Standards on Academic Law Programmes
Wild, Charles and Berger, D. 2015. Giving Students the Third Degree: Using Authentic Assessment Techniques in Extra & Co-Curricular Activities (ECCAs) to Improve Teaching Standards on Academic Law Programmes. in: Rotschedl, Jiri and Cermakova, Klara (ed.) Proceedings of the 20th International Academic Conference, Madrid Prague, Czech Republic International Institute of Social and Economic Sciences (IISES). pp. 510-522
Refining the traditional flipped classroom model: Teaching students HOW to think not WHAT to think
Berger, D. and Wild, Charles 2016. Refining the traditional flipped classroom model: Teaching students HOW to think not WHAT to think. 31st Annual BILETA Conference, BILETA 2016 CFP. Law School, University of Hertfordshire, Hatfield. UK 11 - 12 Apr 2016
Turned on, tuned in, but not dropped out: Enhancing the student experience using popular social media platforms
Berger, D. and Wild, Charles 2015. Turned on, tuned in, but not dropped out: Enhancing the student experience using popular social media platforms. BILETA 30th Annual Conference 2015, Conference Theme: Sustainability: Securing Regulation, Education and Technology for the Future. University of the West of England, Bristol 08 - 10 Apr 2015 British and Irish Law, Education and Technology Association.
Turned on, tuned in, but not dropped out: Enhancing the student experience with popular social media platforms
Berger, D. and Wild, Charles 2016. Turned on, tuned in, but not dropped out: Enhancing the student experience with popular social media platforms. European Journal of Law and Technology. 7 (1).
Refining the traditional flipped-classroom model to optimise student performance on undergraduate degree programmes
Berger, D. and Wild, Charles 2016. Refining the traditional flipped-classroom model to optimise student performance on undergraduate degree programmes. Journal of Commonwealth Law and Legal Education. 11 (1), pp. 57-70.