References

Bergman MM. Advances in mixed methods research.London: Sage Publications; 2008

Bhat N. Research in medicine: perspective of a medical student. J Family Med Prim Care. 2020; 9:(12)6293-6294 https://doi.org/10.4103/jfmpc.jfmpc_1868_20

Boaz A, Hanney S, Borst R, O'Shea A, Kok M. How to engage stakeholders in research: design principles to support improvement. Health Res Policy Syst. 2018; 16:(1) https://doi.org/10.1186/s12961-018-0337-6

Bowling A. Research methods in health: investigating health and health services, 4th edn. Maidenhead: Open University Press; 2014

Clark KR. Ethics in research. Radiol Technol. 2019; 90:(4)394-397

Concannon TW, Grant S, Welch V Practical guidance for involving stakeholders in health research. J Gen Intern Med. 2019; 34:(3)458-463 https://doi.org/10.1007/s11606-018-4738-6

Creswell JW, Creswell JD. Research design qualitative, quantitative, and mixed methods approaches, 5th edn. London: Sage; 2018

Davies M, Hughes N. Doing a successful research project: using qualitative or quantitative methods, 2nd edn. Basingstoke: Palgrave Macmillan; 2014

Deane JA, Clunie G. Healthcare professionals in research (HPiR) Facebook community: a survey of UK doctoral and postdoctoral healthcare professionals outside of medicine. BMC Med Educ. 2021; 21 https://doi.org/10.1186/s12909-021-02672-1

de Gooyert V, Rouwette E, Van Kranenburg H, Freeman E. Reviewing the role of stakeholders in operational research: a stakeholder theory perspective. Eur J Oper Res. 2017; 262:(2)402-410 https://doi.org/10.1016/j.ejor.2017.03.079

Eaton G, Mahtani K, Catterall M. The evolving role of paramedics—a NICE problem to have?. J Health Serv Res Policy. 2018; 23:(3)193-195 https://doi.org/10.1177/1355819618768357

Ellis P. Evidence-based practice in nursing, 5th edn. Thousand Oaks (CA): Sage; 2022

El-Masri MM. Non-probability sampling. Can Nurse. 2017; 113:(3)

Evans D. Hierarchy of evidence: a framework for ranking evidence evaluating healthcare interventions. J Clin Nurs. 2003; 12:(1)77-84 https://doi.org/10.1046/j.1365-2702.2003.00662.x

Flynn LR, Goldsmith RE. Case studies for ethics in academic research in the social sciences.Los Angeles (CA): Sage; 2016

Frandsen TF, Bruun Nielsen MF, Lindhardt CL, Eriksen MB. Using the full PICO model as a search tool for systematic reviews resulted in lower recall for some PICO elements. J Clin Epidemiol. 2020; 127:69-75 https://doi.org/10.1016/j.jclinepi.2020.07.005

Galdas P. Revisiting bias in qualitative research: reflections on its relationship with funding and impact. Int J Qual Methods. 2017; 16:(1) https://doi.org/10.1177/1609406917748992

Greenhalgh T, Howick J, Maskrey N Evidence based medicine: a movement in crisis?. BMJ. 2014; 348 https://doi.org/10.1136/bmj.g3725

Griffiths PM, Mooney GP. The paramedic's guide to research: an introduction.Maidenhead: McGraw-Hill; 2012

Health and Care Professions Council. The standards of proficiency for paramedics. 2023. https//tinyurl.com/rmj2yxn (accessed 19 October 2023)

Hedges C, Williams B. Anatomy of research for nurses.Indianapolis (IN): Sigma Theta Tau International; 2015

Hoogeboom TJ, Jette AM. Using evidence hierarchies to find the best evidence: a Procrustean bed?. Phys Ther. 2021; 101:(11) https://doi.org/10.1093/ptj/pzab235

Israel M, Hay I. Research ethics for social scientists: Between ethical conduct and regulatory compliance.London: Sage; 2006

Jones C, Jones P. Paramedic research methods: importance and implications. J Paramed Pract. 2013; 1:(11)465-469 https://doi.org/10.12968/jpar.2009.1.11.43741

Joosten YA, Israel TL, Williams NA Community engagement studios: a structured approach to obtaining meaningful input from stakeholders to inform research. Acad Med. 2015; 90:(12)1646-1650 https://doi.org/10.1097/ACM.0000000000000794

Krimsky S. Do financial conflicts of interest bias research?: an inquiry into the ‘funding effect’ hypothesis. Sci Technol Human Values. 2013; 38:(4)566-587 https://doi.org/10.1177/0162243912456271

Long H, French D, Brooks J. Optimising the value of the Critical Appraisal Skills Programme (CASP) tool for quality appraisal in qualitative evidence synthesis. Res Methods Med Health Sci. 2020; 1:(1)31-42 https://doi.org/10.1177/2632084320947559

Long T, Johnson M. Research ethics in the real world: issues and solutions for health and social care professionals.London: Churchill Livingstone, Elsevier; 2007

McClelland G. The research paramedic: a new role. J Paramed Pract. 2013; 5:(10)582-586 https://doi.org/10.12968/jpar.2013.5.10.582

McKim CA. The value of mixed methods research: a mixed methods study. Journal of Mixed Methods Research. 2017; 11:(2)202-222 https://doi.org/10.1177/1558689815607096

Mendes A. Critical thinking in paramedic practice. J Paramed Pract. 2019; 11:(8)327-327 https://doi.org/10.12968/jpar.2019.11.8.327

Methley AM, Campbell S, Chew-Graham C, McNally R, Cheraghi-Sohi S. PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews. BMC Health Serv Res. 2014; 14 https://doi.org/10.1186/s12913-014-0579-0

Miller PG, Johnston J, Dunn M, Fry CL, Degenhardt L. Comparing probability and non-probability sampling methods in Ecstasy research: implications for the internet as a research tool. Subst Use Misuse. 2010; 45:(3)437-450 https://doi.org/10.3109/10826080903452470

Nadelson S, Nadelson LS. Evidence-based practice article reviews using CASP tools: a method for teaching EBP. Worldviews Evid Based Nurs. 2014; 11:(5)344-346 https://doi.org/10.1111/wvn.12059

Neuman W. Social research methods: qualitative and quantitative approaches.Boston (MA): Pearson; 2014

Nordenström J. Evidence-based medicine in Sherlock Holmes' footsteps.Malden (MA): Blackwell; 2007 https://doi.org/10.1002/9780470750957

Olaussen A, Bowles K-A, Lord B, Williams B. Introducing, designing and conducting research for paramedics.Chatswood (NSW): Elsevier; 2022

Parahoo K. Politics and ethics in nursing research. Nurs Stand. 1991; 6:(6)35-39 https://doi.org/10.7748/ns.6.6.35.s38

Perry M. Evidence based practice from the ashes of clinical freedom. J Paramed Pract. 2016; https://doi.org/10.12968/jpar.2016.8.12.576

Polit DF, Beck CT. Nursing research: generating and assessing evidence for nursing practice, 9th edn. Philadelphia (PA): Wolters Kluwer; 2012

Rahman MS. The advantages and disadvantages of using qualitative and quantitative approaches and methods in language ‘testing and assessment’ research: a literature review. Journal of Education and Learning. 2016; 6102-6112 https://doi.org/10.5539/jel.v6n1p102

Rathbone J, Albarqouni L, Bakhit M Expediting citation screening using PICo-based title-only screening for identifying studies in scoping searches and rapid reviews. Syst Rev. 2017; 6:(1) https://doi.org/10.1186/s13643-017-0629-x

Evaluating the effectiveness of keyword, phrase, Boolean operator [AND] in bibliographic data access and retrieval for the subject chemistry. 2020. https//tinyurl.com/yujecnf4 (accessed 18 October 2023)

Silverman D. Interpreting qualitative data, 6th edn. Thousand Oaks (CA): Sage; 2021

Siriwardena AN, Whitely A. Prehospital research methods and practice, 1st edn. Bridgwater: Class Publishing; 2022

Tod D, Booth A, Smith B. Critical appraisal. Int Rev Sport Exerc Psychol. 2022; 15:(1)52-72 https://doi.org/10.1080/1750984X.2021.1952471

Carrying out research, critical appraisal, ethics and stakeholder involvement

02 November 2023
Volume 15 · Issue 11

Abstract

Research skills are a requirement under the Health and Care Professions Council (HCPC) standards for paramedic registration. Paramedics must ‘recognise the value of research to the critical evaluation of practice’. Research in the medical field is important in order to improve the knowledge of clinicians and inform evidence-based practice. The purpose of this article is to demonstrate the key components of the research process, use of a PICO [population, intervention, comparison, outcome] tool to search relevant databases and explain the critical appraisal of research in order to establish if research is valid before implementing results into paramedic practice.

The aim of this article is to describe the research methods process by explaining how to develop a research question, how to search recognised databases for relevant literature and what is involved in critically appraising an article.

Research skills are a requirement under the Health and Care Professions Council (HCPC) (2023) standards for paramedic registration; paramedics must ‘recognise the value of research to the critical evaluation of practice’.

Research in medicine is important to improve clinician knowledge by sharing data across the globe (Bhat, 2020). Because of their rapidly changing roles (Eaton et al, 2018), paramedics are required to critically analyse research to develop both clinically and professionally. Ellis (2022) expands on this, adding clinical governance; a crucial component of contemporary healthcare is understanding what you are doing and why you are doing it.

Mendes (2019) highlights that paramedics are expected to apply strong evidence-based practice (EBP) and are required to be autonomous, questioning themselves in a given situation whether an intervention is the right one based upon their clinical assessment and gut instinct. However, Olaussen et al (2022) notes that EBP has developed at a slow pace in paramedicine, and research with more paramedic involvement is required.

Griffiths and Mooney (2012) emphasise the advantage of EBP is that less time is wasted carrying out unnecessary and ineffective therapies, and care is provided with far greater consistency.

Healthcare is changing at a rapid pace as is the role of the paramedic so, to ensure they provide EBP, paramedics must have proficient research skills.

What is research?

Establishing a hypothesis—a clear, verifiable assertion—that a researcher will make in their investigations is the first step in conducting research (Olaussen et al, 2022).

Research is divided into qualitative and quantitative categories. Qualitative research focuses on a person's experiences and perceptions. Quantitative research focuses on numbers and statistics (Griffiths and Mooney, 2012). However, Neuman (2014) states that, despite the obvious differences in qualitative and quantitative research, they overlap a great deal.

A mixed method can also be used. Siriwardena and Whitely (2022) explain that a mixed-methods approach is when at least one qualitative method and one quantitative method are used to collect data within the same study. McKim (2017) notes that, by enhancing the findings' validity, guiding the collection of data and aiding in knowledge development, mixed approaches bring value to research.

There are also differences in the way data are collected. Qualitative data are generated by the researcher using techniques such as focus groups and interviews (Silverman, 2021). In contrast, quantitative data are obtained by carrying out observations, tests and reviewing retrospective data such as medical documents (Bergman, 2008).

Both methods have shortcomings. Galdas (2017) states that it is not uncommon to find bias in qualitative research. Bias is typically regarded as any factor that causes a study's findings to be distorted (Polit and Beck, 2012). Rahman (2016) recognises that quantitative research tends to look at variables only at a specific moment in time. Creswell and Creswell (2018) dispute this, claiming that if the question proposed by a researcher is to look into the usefulness of an intervention, then quantitative research would be the best methodology.

A sampling strategy should be created after deciding on the participants, their characteristics and the location of the study. It should include the selection process, the measurements and other details to be obtained, who will collect the data and how many participants there should be (Hedges and Williams, 2015).

Different sampling types are used to determine the population of a study; the main ones used are simple random, cluster, stratified random, convenience, quota, snowball and purposive samples (Davies and Hughes, 2014). Sampling types are split into two categories: probability sampling (El-Masri, 2017) and non-probability sampling (Miller et al, 2010). Probability sampling is a technique for selecting a representative sample of an entire population. When is it not possible to obtain population lists, however, non-probability sampling is employed (Hedges and Williams, 2015). Each technique has its pros and cons.

Database search method

To develop a research question, a PICO [population, intervention, comparison and outcome] (Methley et al, 2014) tool should be used to ensure a robust search strategy for a systematic review (Frandsen et al, 2020). Nordenström (2007) notes that the research question must be clear and concise to be searchable in databases and to allow an answer following a careful evaluation of the facts generated.

Rathbone et al (2017) recognises that integrating the C into the I of the PICO framework, resulting in ‘PIO’, can considerably increase the efficacy of data filtering; this combination of C and I categories is widely used.

With the use of a research question and a PIO framework, a search strategy can be constructed to explore databases identifying singular, peer-reviewed primary studies for critical appraisal. The MEDLINE and CINAHL databases are typically used in medical research. Siriwardena and Whitely (2022) emphasise these are fundamental and specialised bibliographic databases that are pertinent to the medical profession.

When conducting a primary search using basic terminology, focusing on the first two PIO items (population and intervention) is the favoured method. Frandsen et al (2020) recognise that the P and I elements should be included in a search strategy at a minimum, and that the C and O elements have a lower recall across databases.

A search strategy should be balanced, incorporating sensitivity and specificity (Siriwardena and Whitely, 2022). To increase sensitivity, Boolean operators can be incorporated. The Boolean search technique allows users to combine words with operators—namely ‘and’, ‘not’ and ‘or’—to exclude less relevant data and increase specificity (Saravanan, 2020). Truncations are used to include plurals and alternative spelling of words in a database search. The initial search may produce a large volume of results.

Critical appraisal and the hierarchy of evidence

A critical appraisal of research papers should be carried out. This helps determine how confident individuals can be in the results of a body of research by carefully and methodically evaluating studies' reliability or methodological rigour (Tod et al, 2022).

Critical appraisal plays an important role in allowing paramedics to integrate EBP into their work. A Critical Appraisal Skills Programme (CASP) tool, which is a general tool for evaluating the benefits and drawbacks of any research approach, can be used (Long et al, 2020). Areas required for critical appraisal are efficiently covered by CASP tools (Nadelson and Nadelson, 2014).

It has long been understood that not every research strategy has the same risk of bias and error in its findings. Some research approaches offer stronger evidence than others when seeking solutions to particular topics, so the research methodologies used will have an impact on how valid the results are (Evans, 2003).

The relative potency of findings from scientific study is ranked using a hierarchy of evidence, a heuristic approach. The evidence pyramid is a well-known example of an evidence hierarchy (Hoogeboom and Jette, 2021). Because of their lower possibility of bias, randomised controlled trials are at the summit of the evidence pyramid (Greenhalgh et al, 2014). However, Bowling (2014) disagrees with having a hierarchy of evidence, arguing that different research methods should be used for different types of inquiry. The hierarchy of evidence is still extensively used to classify the possibility of validity, despite criticisms of this approach (Greenhalgh et al, 2014).

Ethics in research

Ethics are important in research as they define what behaviour is appropriate and inappropriate (Clark, 2019). Researchers must safeguard research participants, build trust with them, promote research integrity and prevent misbehaviour and improper behaviour that could reflect negatively on their organisation or institution (Israel and Hay, 2006).

Creswell and Creswell (2018) claim the ethical issues applied to research are extensive and need to be addressed throughout a study. The Nuremberg trials, which investigated the systematic mistreatment of underprivileged people during research experiments placed research ethics into sharp focus after the Second World War (Olaussen et al, 2022).

Paramedics have responsibilities when conducting research, and researchers must ensure participants are aware they are involved in a research study and understand the benefits and risks involved (Griffiths and Mooney, 2012). However, if consent cannot be gained at the point of data collection, it can be gained retrospectively when the patient has regained mental or physical capacity (Long and Johnson, 2007).

Siriwardena and Whitely (2022) stress that when researchers are choosing participants for studies, paramedics should be carefully considered in order to guarantee that the ethical requirements of confidentiality and informed consent are upheld. Griffiths and Mooney (2012) elaborate on this, stating as paramedics are in a position of authority and the patient could feel as though they have no choice but to comply, paramedics should ensure that great care is taken while obtaining consent to gather data while also treating the patient.

There are ethical concerns when conducting research. As Krimsky (2013) highlights, ethics can be affected by funding. Krimsky (2013) reported that study results could be statistically correlated with funding sources, mostly in drug safety and efficacy trials, and the term ‘funding impact’ was developed to describe this. Funding impact, also seen in studies on chemical toxicity and cigarette use, is frequently linked, implicitly or explicitly, to research bias Krimsky (2013).

Researchers must refrain from placing someone in a situation where there is a conflict of interest, and must never exploit their status as academics to divert funds for their own personal or outside enterprise (Flynn and Goldsmith, 2016).

What are stakeholders?

Stakeholders are organisations, groups of people or other entities with an interest in how a piece of research develops (Boaz et al, 2018). Within research, the significance of stakeholders is increasingly being recognised (de Gooyert et al, 2017). To ensure a research question has practical relevance, a broad range of stakeholders should be consulted (Siriwardena and Whitely, 2022).

Stakeholders are involved in study-related tasks including question preparation, selection criteria, participant recruitment, data collecting, analysis and the identification and interpretation of findings (Concannon et al, 2019). The relevance of research is increased when communities are involved, and this may hasten the conversion of discoveries into better health outcomes (Joosten et al, 2015).

Health professionals such as paramedics, midwives and nurses are being more frequently involved in research because of their insight and as they are in a position to find solutions to clinical problems for the patients' benefit, while positively changing disciplines across the NHS (Deane and Clunie, 2021).

Health professionals should inform stakeholders of all relevant information including risks and benefits to gain full informed consent (Parahoo, 1991). More specifically, the role of the research paramedic builds bridges between theory and practice, closing the gap between clinical and academic components (McClelland, 2013).

Jones and Jones (2013) add that the modern paramedic role now includes specialised components, such as research into their roles, in addition to their specialised clinical training. In their role as researchers, paramedics have a duty to conduct high-quality prehospital research to enhance EBP for patients and to better serve other stakeholders (Perry, 2016).

Conclusion

At a time where rapid, widespread change is occurring throughout the healthcare sector, research skills are becoming increasingly essential for individuals in the paramedic profession.

Paramedics must ensure they can critically analyse information in research studies before implementing changes in their practice (Griffiths and Mooney, 2012). Ensuring clinical practice is based on high-quality research is paramount to optimum patient-centred care and gaining the most advantageous outcomes for patients.

Key Points

  • Paramedics have to be able to critically analyse research to develop clinically and professionally
  • PICO helps to form a question that identifies the key issues for a population
  • Selecting a good sampling strategy is important in order to gain richer and more accurate data
  • Researchers must follow ethical guidelines to protect vulnerable populations when conducting a study
  • A consultation of a broad range of stakeholders should be conducted to ensure that a research question has practical relevance
  • CPD Reflection Questions

  • How confident would you feel searching for and identifying peer reviewed studies?
  • How would you implement research into your own practice?
  • Taking into account the ethical considerations when conducting research, how would you ensure ethical guidelines are adhered to during the research process?