Clean language interviewing

Clean language interviewing (CLI), sometimes shortened to clean interviewing, aims to maximise the reliability that information collected during an interview derives from the interviewee. CLI seeks to address some of the "threats to validity and reliability"[1] that can occur during an interview and to increase the "trustworthiness" of the data collected.[2] It does this by employing a technique that minimises the unintended introduction of interviewer content, assumption, leading question structure, presupposition, framing, priming, tacit metaphor and nonverbal aspects such as paralanguage and gesture that may compromise the authenticity of the data collected.[3]

At the same time clean language interviewing seeks to minimise common interviewee biases, such as the consistency effect, acquiescence bias and the friendliness effect which may mean an interviewee (unconsciously) looks for cues from the interviewer about how to answer.[4]

Furthermore, a systematic application of a 'cleanness rating' protocol provides a quantitive measure of adherence to interview guidelines and by extension the "confirmability" of the data collected.[5][6]

CLI can be considered a phenomenologically-based interview method, similar in intent to neuro- and micro-phenomenology,[7] psycho-phenomenology,[8] phenomenography,[9] and Interpersonal Process Recall.[10] Clean interviewing can be seen as a method of operationalising the phenomenological aim of bracketing (epoché).[3]

CLI has the flexibility to be applied at four progressive levels of practice and principles:[11]: 10 
          A questioning technique
          A method of eliciting interviewee-generated metaphors
          A method of studying how people do things
          A coherent research strategy based on ‘clean’ principles.

CLI is also an integral part of a new action research methodology, Modelling Shared Reality which suggests that by paying careful attention to the language they use, qualitative researchers can reduce undesired influence and unintended bias during all stages of research—design, data gathering, analysis and reporting.[12]

History edit

Clean interviewing derived from clean language, the language model of therapeutic processes devised by David Grove[13] which has since found application in education, business, organisational change, health and academic research.[14]

Grove devised the principles of clean language in the 1980s and continued to develop a specific question set until his death in 2008. Although Owen first suggested applying clean language to phenomenological research in 1996,[15] it was not until 2010 that the first systematic research into the veracity of the method was conducted and published in the British Journal of Management.[16]

Another milestone is the publication of Clean Language Interviewing: Principles and Applications for Researchers and Practitioners.[17] It consists of four chapters introducing the method and eleven chapters detailing the application of CLI to fields such as: journalism in Malaysia; the experience of neurodifferent job applicants in the UK; parents of children diagnosed with encephalopathy in France; modelling an excellent case manager of neurodiverse offenders in the UK; conflict resolution with gang leaders in Haiti; management systems auditing in Japan; serious injury or fatality investigations in the US, among others.

Features edit

The features of clean interviewing include: the specificity of the technique; minimising unintended influence; data collection from the perspective of the interviewee; its applicability to in-depth interviews; elicitation of autogenic metaphors; investigating tacit knowledge; modelling mental models; and the verifiability of the adherence to the method.[16][18][19][20]

CLI seeks to address the issues raised by research that demonstrates responses can materially be affected by: question construction;[21][22] framing;[23] changing a single word;[24][25] introduced metaphors;[26][27] presupposition;[28] and the nonverbal behaviour of the interviewer such as paralanguage[29] and gesture.[30] Furthermore, in these studies, not only did the subjects show little or no awareness of being subtly and systematically influenced, many reported their answers with a high degree of confidence.[31]

The amount of training required to become a proficient interviewer is commonly underestimated[32][33] and because of the rigour of the CLI technique, training and practice are required to become a competent clean language interviewer.[20][16]

Cleanness rating edit

Roulston maintains "researchers must demonstrate the quality of their work in ways that are commensurate with their assumptions about their use of interviews"[34]: 193  yet systematic methods for assessing the reliability and validity of the data collected during an interview are noticeably absent from published research.[35]

A "cleanness rating" can be used to measure the proportion of 'clean' to 'leading' interviewer interventions and hence the authenticity or trustworthiness of the data collected (i.e. how much is sourced in the interviewee's lexicon and logic). “The principal benefit of the rating is to enhance reflexivity” and contribute to “methodological transparency by enabling researchers to report on confirmability”.[36]: 19 

The rating was created in 2011[16] and subsequently extended and formalised. An independent examination of interview transcripts allocates one of six categories (Classically clean; Clean repeat; Contextually clean; Mildly leading; Strongly leading; Other) to every question or statement made by the interviewer. The tabulated results are used to arrive at a summary assessment for each interview.[36]

Interviewers experienced in CLI can consistently achieve over 85% of 'clean' interventions.[18][5] Whereas as many as two-thirds of the questions asked by an untrained interviewer may be 'leading'.[20] An inter-rater reliability analysis of 19 interviews from five research studies demonstrated substantial agreement among raters with an average intraclass correlation coefficient of 0.72 (95% CI).[5]

Critique edit

The assumption that interviewers can minimise their influence on the collection of data has been questioned for several decades[37] and the social constructivist school claims all knowledge is co-constructed.[38] Practitioners of CLI do not claim it does not influence nor that it is "non-directive".[39] They acknowledge that the interviewer's role is to set the overall purpose and direct the general flow of the interview[1] and they emphasise that all questions, including clean questions, set frames, contain presuppositions and invite the interviewee to attend to certain aspects of his or her experience.[14] Clean questions aim to stay within the lexicon and inherent logic expressed by the interviewee and leave them maximally free to answer from within his or her frames of reference. Tosey maintains that, "accounts are co-constructed through the process of selecting and asking questions. At the same time, Clean Language [Interviewing] aims to minimise the co-construction of the content."[3]: 205 

In inexperienced hands the questions may “feel scripted, mechanical and inappropriately therapeutic”[40] and the "guidelines may be quite hard to follow, and rub up against a tension between sustaining neutrality and developing rapport” yet still “invite interviewees to talk about their inner world in their own way which could ideally create openness”.[41]

As yet there has been no comprehensive test of the premise that interviews with a high cleanness rating result in higher quality data. Rather, an interview with a low cleanness rating may raise questions about compliance with research protocols and doubts about the authorship of the data collected.

Other forms of interviewing would be more appropriate where the researcher intentionally aims for the 'co-construction of meaning' or to challenge and change the understandings of participants, as in 'transformative interviews'.[34]

Some critics have maintained that the metaphor 'clean' is pejorative to other methods. Grove settled on the metaphor after discovering how others – including Carl Rogers the originator of "non-directive therapy"[42] – (unwittingly) 'contaminate' another person's perceptions with introduced content and presupposition

Applications edit

While clean interviewing is ideally suited to research, it has also been used by police interviewers, critical incident investigators and in commercial projects such as requirements gathering, market research and organisational change. There is scope for it to be applied in fields such as cognitive task analysis[43] and Naturalistic decision-making.

Examples of published research include:

  • Tacit and explicit knowledge acquisition among student teachers in Czech Republic.[20][44]
  • Comparison of the evidence of coach competency from three perspectives.[45]
  • Elicitation of 30 European business leaders' metaphors and mental models of leadership and its development.[46]
  • Coachees' experience and outcomes from a single coaching session.[19]
  • Managers' metaphors of work-life balance.[16]
  • A Dutch case study into the role of knowledge in greening flood protection.[47]
  • Iranian students' metaphors for their teachers.[48]
  • A mid-term review of the Dutch Living with Water project.[12]
  • Professional development planning at a UK university.[49]
  • Legacy of war experiences of members of the Ulster Defence Regiment.[50]
  • An investigation into how midwifery students approach sensitive decisions of pregnant women in The Netherlands.[51]
  • A linguistic study of the (inter)subjectivity in people with a schizophrenia diagnosis.[52]
  • An Interpretative Phenomenological Analysis of looking up at the sky.[53]
  • An exploration of the sea’s positive effect on wellbeing.[54]

In addition clean interviewing has been used in a range of PhD research topics:

  • Modelling curriculum design in higher education.[55]
  • A phenomenological multi-case study exploring the transformative potential of coaching conversations.[56]
  • Ways in which pervasive media can contribute to a multimodal holistic user experience of the ambulant landscape.[57]
  • Factors that influence employment choices amongst older employees in Denmark.[58]
  • An exploration of leadership and its development through the inner worlds of leaders using metaphor.[59]
  • A model of spiritual leadership and self-development in a Spiritual Order in Malaysia.[60]
  • How older workers in the fire and rescue service deal with work-life balance issues as they approach retirement.[61]
  • Whether senior partners in legal services firms possess the core characteristics of identity to work in alignment within the firm.[62]

Notes edit

  1. ^ a b Seidman, 2006
  2. ^ Lincoln & Guba, 1985
  3. ^ a b c Tosey, 2015
  4. ^ Podsakoff et al., 2003
  5. ^ a b c Nehyba & Lawley, 2020
  6. ^ Jensen, 2008
  7. ^ Petitmengin, 2017
  8. ^ Mathison & Tosey, 2010
  9. ^ Reid & Solomonides, 2007
  10. ^ Larson et al., 2008
  11. ^ Tosey, Cairns-Lee & Lawley, 2022
  12. ^ a b van Helsdingen & Lawley, 2012
  13. ^ Grove & Panzer, 1989
  14. ^ a b Lawley & Tompkins, 2000
  15. ^ Owen, 1996
  16. ^ a b c d e Tosey, Lawley & Meese, 2014
  17. ^ Cairns-Lee, Lawley & Tosey, 2022
  18. ^ a b Lawley, 2017
  19. ^ a b Linder-Pelz & Lawley, 2015
  20. ^ a b c d Nehyba & Svojanovsky, 2017
  21. ^ Loftus & Palmer, 1974
  22. ^ Harris, 1973
  23. ^ Tversky & Kahneman, 1981
  24. ^ Loftus & Zanni, 1975
  25. ^ Heritage et al., 2007
  26. ^ Thibodeau & Boroditsky, 2011
  27. ^ Thibideau & Boroditsky, 2013
  28. ^ Loftus, 1975
  29. ^ Duncan et al., 1969
  30. ^ Gurney et al., 2013
  31. ^ Loftus & Hoffman, 1989
  32. ^ Cho, 2014
  33. ^ Kvale & Brinkmann, 2014
  34. ^ a b Roulston, 2010
  35. ^ Mann, 2010
  36. ^ a b Cairns-Lee, Lawley & Tosey, 2021
  37. ^ Mishler, 1986
  38. ^ Silverman, 2006
  39. ^ Rogers, 1945
  40. ^ Buetow, 2013, p.53
  41. ^ Langley & Meziani, 2020, p.11
  42. ^ Tompkins & Lawley, 1996
  43. ^ Clark et al., 2007
  44. ^ Cáscová, 2015
  45. ^ Lawley & Linder-Pelz, 2016
  46. ^ Cairns-Lee, 2015
  47. ^ Janssen et al., 2014
  48. ^ Akbari, 2013
  49. ^ Nixon & Walker, 2009
  50. ^ Snoddon, 2005
  51. ^ Sanders et al., 2018
  52. ^ van Schuppen, 2021
  53. ^ Conway, 2019
  54. ^ Sinclair, 2019
  55. ^ Walker, 2021
  56. ^ Philmon, 2019
  57. ^ Calderwood, 2017
  58. ^ Hanley, 2018
  59. ^ Cairns-Lee, 2017
  60. ^ Munsoor, 2018
  61. ^ Pickerden, 2013
  62. ^ Vanson, 2011

References edit

  • Akbari, M. (2013). Metaphors about EFL Teachers' Roles: A Case of Iranian Non-English-Major Students, International Journal of English Language & Translation Studies, 1(2):73–82. ISSN 2308-5460
  • Buetow, S. (2013). The traveller, miner, cleaner and conductor: Idealized roles of the qualitative interviewer. Journal of Health Services Research & Policy, 18(1):51-54. doi:10.1258/jhsrp.2012.012085
  • Cairns-Lee, H. (2015). Images of Leadership Development From the Inside Out. Advances in Developing Human Resources, 17(3):321–336. doi:10.1177/1523422315587897
  • Cairns-Lee, H. (2017) An Exploration of Leadership And Its Development Through The Inner Worlds of Leaders Using Metaphor. (Doctoral dissertation) Surrey Business School, University of Surrey. http://epubs.surrey.ac.uk/845188/
  • Cairns-Lee, H., Lawley, J., & Tosey, P. (2021). Enhancing researcher reflexivity about the influence of leading questions in interviews. The Journal of Applied Behavioral Science. doi:10.1177/00218863211037446
  • Cairns-Lee, H., Lawley, J. & Tosey, P. (2022), Clean Language Interviewing: Principles and Applications for Researchers and Practitioners, Emerald Publishing Limited. doi:10.1108/9781801173308
  • Calderwood, J. (2017) Pervasive Media and Eudaimonia: Transdisciplinary Research by Practice. (Doctoral dissertation) Leicester: De Montfort University.
  • Cásková, K. (2015). Sharing tacit knowledge of students with their training teacher. Pragmatism and Education 2015. https://muni.cz/research/publications/1301031
  • Cho, Y. (2014). Critiquing Research Interviews from a CA Perspective: Treating Interview as Social Practice. ARECLS 11:35–54.
  • Clark, R.E., Feldon, D.F., van Merriënboer, J.J.G., Yates, K,A. & Early, S. (2007). Cognitive task analysis. In Handbook of Research on Educational Communications and Technology. (Eds: J. Michael Spector et al.). 577-593.
  • Conway, P. (2019). The Extraordinary in the Ordinary: SKYchology – An Interpretative Phenomenological Analysis of Looking Up at the Sky. Chapter 5, Proceedings of Presented Papers 5th Annual Applied Positive Psychology Symposium (Ed. G. M. Cseh). https://bucks.repository.guildhe.ac.uk/id/eprint/17819/
  • Duncan, S., Rosenberg, M., & Finkelstein, J. (1969). The Paralanguage of Experimenter Bias. Sociometry, 32(2):207–219. doi:10.2307/2786264
  • Grove, D.J. & Panzer, B.I. (1989) Resolving Traumatic Memories: Metaphors and Symbols in Psychotherapy. Irvington, New York ISBN 0829024077
  • Gurney, D., Pine, K., & Wiseman, R. (2013). The gestural misinformation effect: skewing eyewitness testimony through gesture. American Journal of Psychology, 126(3), 301–14. doi:10.5406/amerjpsyc.126.3.0301. JSTOR 10.5406/amerjpsyc.126.3.0301
  • Hanley, K. G. (2018) To work or not to work? That is the dilemma for older workers in Denmark, age 60+. (Doctoral dissertation) University of Brighton.
  • Harris, R. J. (1973). Answering questions containing marked and unmarked adjectives and adverbs. Journal of Experimental Psychology, 97:399–401 doi:10.1037/h0034165
  • Heritage, J., Robinson, J. D., Elliott, M. N., Beckett, M., & Wilkes, M. (2007). Reducing Patients' Unmet Concerns in Primary Care: the Difference One Word Can Make. Journal of General Internal Medicine, 22(10):1429–1433. PMC 2305862. PMID 17674111. doi:10.1007/s11606-007-0279-0
  • Janssen S.K.H., Mol A.P.J., van Tatenhove J.P.M., & Otter H.S. (2014). The role of knowledge in greening flood protection. Lessons from the Dutch case study future Afsluitdijk, Ocean & Coastal Management, Vol 95, pp.219–232. doi:10.1016/j.ocecoaman.2014.04.015
  • Jensen, D. (2008). Confirmability. In L. Given (Ed.), The SAGE encyclopedia of qualitative research methods. (p.112) Sage Publications.
  • Kvale, S., & Brinkmann, S. (2014). InterViews: Learning the craft of qualitative research interviewing (3rd ed.). Los Angeles: Sage Publications. ISBN 978-1452275727
  • Langley, A. & Meziani, N. (2020). Making interviews meaningful. Journal of Applied Behavioral Science, 1-22. doi:10.1177/0021886320937818
  • Larsen, D. Flesaker, K. & Rachel Stege, R.(2008). Qualitative Interviewing Using Interpersonal Process Recall: Investigating Internal Experiences during Professional-Client Conversations, International Journal of Qualitative Methods, 7(1) doi:10.1177/160940690800700102
  • Lawley, J (2017). Clean Language Interviewing: Making qualitative research interviews verifiable. Chapter 3 in V. Švec, et al., Becoming a Teacher: The dance between tacit and explicit knowledge. Brno: Masaryk University, pp. 115–122. https://www.researchgate.net/publication/318598187
  • Lawley, J. & Linder-Pelz, S. (2016). Evidence of competency: exploring coach, coachee and expert evaluations of coaching, Coaching: An International Journal of Theory, Research and Practice. doi:10.1080/17521882.2016.1186706
  • Lawley, J., & Tompkins, P. (2000). Metaphors in Mind: Transformation through symbolic modelling. London: The Developing Company Press. ISBN 9780953875108
  • Lincoln, Y.S. & Guba, E.G. (1985). Naturalistic Inquiry. Newbury Park, CA: Sage Publications.
  • Linder-Pelz, S. & Lawley, J. (2015). Using Clean Language to explore the subjectivity of coachees' experience and outcomes. International Coaching Psychology Review, 10(2):161–174. ISSN 1750-2764
  • Loftus, E.F. (1975). Leading questions and the eyewitness report. Cognitive Psychology, 7(4): 560–572. doi:10.1016/0010-0285(75)90023-7
  • Loftus, E. F., & Hoffman, H. G. (1989). Misinformation and memory: The creation of new memories. Journal of Experimental Psychology: General, 118(1), 100–104. doi:10.1037/0096-3445.118.1.100
  • Loftus, E. F., & Palmer, J. C. (1974). Reconstruction of automobile destruction: An example of the interaction between language and memory. Journal of verbal learning and verbal behavior, 13(5): 585–589. doi:10.1016/S0022-5371(74)80011-3
  • Loftus, E. F., & Zanni, G. (1975). Eyewitness testimony: The influence of the wording of a question. Bulletin of the Psychonomic Society, 5, 86–88. doi:10.3758/BF03336715
  • Mann, (2010). A Critical Review of Qualitative Interviews in Applied Linguistics. Applied Linguistics 32(1):6–24. doi:10.1093/applin/amq043
  • Mathison, J., & Tosey, P. (2010). Exploring Inner Landscapes: NLP and Psycho-phenomenology as innovations in researching first-person experience. Qualitative Research in Organizations and Management, 5(1):63–82. doi:10.1108/17465641011042035
  • Mishler, E. G. (1986) Research Interviewing – Context and Narrative, Cambridge MA: Harvard University Press. ISBN 9780674764613
  • Munsoor, M.S. (2018) Knowing Thyself: A Causal Model of Spiritual Leadership and Self-Development: A Case Study of the Naqshbandiyah Khalidiyah Spiritual Order in Malaysia. (Doctoral thesis) Dept. of Aqida and Islamic Thought, Academy of Islamic Studies, University of Malaysia.
  • Nehyba, J. & Lawley, J. (2020) Clean Language Interviewing as a second-person method in the Science of Consciousness, Journal of Consciousness Studies, 27(1–2):94–119 https://www.ingentaconnect.com/contentone/imp/jcs/2020/00000027/f0020001/art00005
  • Nehyba, J., & Svojanovský, P. (2017). Clean language as a data collection tool. Chapter 5 in Becoming a teacher: The dance between tacit and explicit knowledge, Švec, V. et al., pp.130–147. https://www.researchgate.net/publication/318724048
  • Nixon, S., & Walker, C. (2009). Personal Development Planning – Inspiring Capability, chapter 11 in Enhancing Student Centred Learning in Business and Management, Hospitality, Leisure, Sport and Tourism, Buswell, J. & Becket, N. (eds), HLST, Oxford Brookes University, Threshold Press.
  • Owen, R. I. (1996) Clean language: A linguistic-experiential phenomenology. Life in the glory of its radiating manifestations, 25th anniversary publication, Book I, Analecta Husserliana, A.-T. Tymieniecka (Ed.) Vol. 48. pp. 271–297. Dordrecht: Kluwer Academic.
  • Petitmengin C. (2017) Enaction as a lived experience: Towards a radical neurophenomenology. Constructivist Foundations 12(2):139–147. https://constructivist.info/12/2/139
  • Philmon, J. N. (2019) Pushing toward pushback: A phenomenological multi-case study exploring the transformative potential of coaching conversations. Doctoral dissertation, Mercer University, Atlanta, GA. https://ursa.mercer.edu/handle/10898/12322
  • Pickerden, A. M. (2013) How do older workers in the fire & Rescue service deal with work life balance issues as they plan for, approach and transition through retirement? (Doctoral dissertation) University of Leicester.
  • Podsakoff, P.M., MacKenzie, S. B., Lee, J. Y., & Podsakoff, N. P. (2003). Common Method Biases in Behavioral Research: A Critical Review of the Literature and Recommended Remedies. Journal of Applied Psychology, 88(5):879–903.
  • Reid, A., & Solomonides, I. (2007) Design students' experience of engagement and creativity Art, Design & Communication, Higher Education 6(1):27–39. doi:10.1386/adch.6.1.27_1
  • Rogers, C. R. (1945). The nondirective method as a technique for social research. American Journal of Sociology, 50(4):279–283. doi:10.1086/219619
  • Roulston, K. (2010). Considering quality in qualitative interviewing, Qualitative Research, 10(2):193–207. doi:10.1177/1468794109356739
  • Sanders, J., de Vries, R., Besseling, S., & Nieuwenhuijze, M. (2018) 'Such a waste'–Conflicting communicative roles of Dutch midwifery students in childbirth decision making - Midwifery 64:115-121. doi:10.1016/j.midw.2018.06.007
  • Seidman, I. (2006) Interviewing as qualitative research: A guide for researchers in education and the social sciences. New York, NY: Teachers College Press.
  • Silverman, D. (2006) Interpreting Qualitative Data: Methods for Analysing Talk, Text, and Interaction (3rd Edition). London: Sage. ISBN 9781446295434
  • Sinclair, J. (2019). The Wave Model: A Holistic Exploration of the sea's positive effect on wellbeing. Chapter 6, Proceedings of Presented Papers 5th Annual Applied Positive Psychology Symposium (Ed. G. M. Cseh). https://bucks.repository.guildhe.ac.uk/id/eprint/17819/
  • Snoddon, M. (2005). Legacy of War: Experiences of members of the Ulster Defence Regiment, Conflict Trauma Resource Centre, Belfast.
  • Thibodeau, P.H., & Boroditsky, L. (2011). Metaphors We Think With: The Role of Metaphor in Reasoning. PLOS One 6(2):e16782. doi:10.1371/journal.pone.0016782
  • Thibodeau P.H., & Boroditsky L. (2013). Natural Language Metaphors Covertly Influence Reasoning. PLOS One 8(1):e52961. doi:10.1371/journal.pone.0052961
  • Tompkins, P., & Lawley, J. (1996) Interview: And, what kind of a man is David Grove? Rapport, Issue 33, August. https://cleanlanguage.co.uk/articles/articles/37/
  • Tosey, P. (2015). And what kind of question is that? Thinking about the function of questions in qualitative interviewing. Chapter 14 in Handbook of Research Methods on Human Resource Development, Saunders, M. N.K. & Tosey, P. (eds), Cheltenham: Edward Elgar. pp. 200–216. ISBN 9781785367946
  • Tosey, P., Cairns-Lee, H. & Lawley, J. (2022), "An Introduction to Clean Language Interviewing for Research", In Cairns-Lee, H., Lawley, J. and Tosey, P. (Ed.) Clean Language Interviewing: Principles and Applications for Researchers and Practitioners, Emerald Publishing Limited, pp.3-16. doi:10.1108/978-1-80117-330-820221001
  • Tosey, P., Lawley, J., & Meese, R. (2014). Eliciting Metaphor through Clean Language: An Innovation in Qualitative Research. British Journal of Management, 25:629–646. doi:10.1111/1467-8551.12042
  • Tversky, A., & Kahneman, D. (1981). Framing of Decisions. Science, 211(4481): 453–458. JSTOR 1685855
  • van Helsdingen, A., & Lawley, J. (2012). Modelling Shared Reality: avoiding unintended influence in qualitative research, Kwalon: Journal of the Netherlands Association for Qualitative Research. Vol 3, October. doi:10.5117/2012.017.003.043 English translation http://academia.edu/attachments/30371322/download_file
  • van Schuppen, L., Sanders, J. & van Krieken, K. (2021) Navigating Narrative Subjectivity in Schizophrenia: A Deictic Network Analysis of Narrative Viewpoints of Self and Other Inquiries. In Macagno, Fabrizio, Capone, Alessandro (Eds.) Inquiries in Philosophical Pragmatics: Issues in Linguistics. Springer. doi:10.1007/978-3-030-56696-8_10
  • Vanson, S. (2011). Aligning identity in legal services firms: Do senior partners in legal services firms possess the core characteristics of identity to work in alignment within the firm? (Doctoral dissertation) University of Portsmouth.
  • Walker, C. (2021). Using clean language interviewing to model curriculum design in higher education: Curriculum design is like what? Doctoral thesis, Liverpool John Moores University, UK. https://researchonline.ljmu.ac.uk/id/eprint/15690/