Evaluating Quantitative Research Designs
Evaluating Quantitative Research Designs
Guidelines for Quantitative Nursing Research Critique
- State the purpose of the study, and identify the problem.
- Critique the literature review within your selected article. In your analysis, discuss the following:
- Are articles relevant to the topic being studies?
- Are the references current? How many sources are from the last 10 years?
- How many sources are from the last 5 years?
- Describe the current state of knowledge—what is known and unknown—about the research problem.
- Critique the study framework or theoretical perspective. A theoretical framework is a nursing theory or similar used to support the overall design of a research study. In your critique , discuss the following:
- Is the framework explicitly expressed, or must the reviewer extract the framework from implicit statements in the literature review?
- Is the framework based on a specific theory?
- Does the framework support the concepts of interest in the article?
- Critique the research question or study hypothesis/aim. If more than one include all of them. If there are none, suggest how those might be stated.
- Identify and define, both conceptually (dictionary definition) and operationally (how the variable is used in this study) each study variable including:
- Independent variables
- Dependent variables
- Research variables
- Identify and critique attributes and demographic variables.
- Describe and critique the research design. Address the following criteria in the analysis:
- Identify the specific design of the study.
- Identify the treatment or intervention if appropriate for the type of study conducted.
- Were pilot-study findings used to design this study? If yes, briefly discuss the pilot and the changes made in this study based on the pilot.
- Critique the sample and setting. Include the following elements in your analysis:
- Identify inclusion and exclusion sample criteria.
- Indicate the method used to obtain the sample.
- State the sample size. Indicate if a power analysis was conducted to determine the sample size. Identify the refusal to participate number and percentage.
- Identify the characteristics of the sample.
- Identify the sample mortality (or attrition) number and percentage.
- Indicate the type of consent obtained and institutional review board approval.
- Identify the study setting and indicate if it was appropriate for the study purpose.
- Describe and critique the measurement instrument used in the study with the following guidelines:
- Identify the type of each measurement strategy, such as the Likert scale, visual analog scale, physiological measure, questionnaire, observation, or interview.
- Identify the level of measurement (nominal, ordinal, interval/ratio) achieved by each measurement strategy.
- Discuss how the instrument was developed and its intended purpose.
- Report the reliability of each instrument from previous studies and the current study.
- Report the validity of each instrument from previous studies and the current study.
- Critique the procedures for data collection.
- Identify the intervention protocol, if appropriate.
- Detail how the data were collected.
- Critique the statistical analyses used.
- Discuss the statistical procedures used in the study findings.
- Provide the level of significance (p value) and the statistical value the (t-statistic; F statistic) for the study outcomes.
- Critique the researcher’s interpretation of findings.
- Were there any limitations identified in the study?
- How did the researcher generalize the findings?
- What were the implications of the findings for nursing?
- Can you apply the study findings to your own evidence based practice project? Why or why not?
|1. State the purpose of the study and identify the problem.|
|2. Analyze the literature review.|
|3. Analyze the study framework or theoretical perspective.|
|4. Identify, describe, and critique for appropriateness any research objectives, questions, or hypothesis.|
|5. Identify, describe, and critique—conceptually and operationally—the major study variables.|
|6. Identify and critique the attributes and demographic variables.|
|7. Describe and critique the research design.|
|8. Describe and critique the sample and setting.|
|9. Describe and critique the measurement instrument used in the study.|
|10. Describe and critique the procedures for data collection|
|11. Describe and critique the statistical analysis.|
|12. Describe and critique the researcher’s interpretation.|
The Effect of Perioperative Music Listening on Patient Satisfaction, Anxiety, and Depression: A Quasiexperimental Study
Background. The effect of perioperative music listening has been proven to relieve preoperative anxiety and depression, while improving patient satisfaction. However, music listening has not been extensively studied in Singapore. Therefore, the primary aim of our study is to investigate the patient satisfaction towards perioperative music listening in the local setting. The secondary aim is to investigate the effect of perioperative music listening in reducing patient surgery-related anxiety and depression. Methods. After obtaining ethics board approval, we conducted a quasiexperimental study on a cohort of female patients who were undergoing elective minor gynaecological surgeries. Apple iPod Touch™ devices containing playlists of selected music genres and noise-cancelling earphones were given to patients to listen during the preoperative and postoperative periods. Hospital Anxiety and Depression Scale (HADS), EQ-5D-3L questionnaire, music listening preferences, and patient satisfaction surveys were administered. Wilcoxon signed-rank and McNemar’s tests for paired data were used for analysis. Results. 83 patients were analysed with 97.6% of patients in the preoperative period and 98.8% of patients in the postoperative period were satisfied with music listening. The median (IQR [range]) score for preintervention HADS anxiety was 7.0 (6.0 [0–17]), significantly higher than that in postintervention at 2.0 (4.0 [0–12]) (). Similarly, there was a significant reduction in preintervention HADS depression as compared to postintervention (). These results were corroborated by similar findings from the EQ-5D-3L questionnaire. Conclusion. Perioperative music listening improved patient satisfaction and can reduce patient anxiety and depression. We hope to further investigate on how wider implementation of perioperative music listening could improve patient care.
The use of music listening in the perioperative setting has been validated in numerous studies . Compared to the conventional use of pharmacological drugs to reduce postoperative pain and anxiety, music listening has been shown to be safer and more cost-effective , reduce perioperative pain , and improve overall patient satisfaction [, ]. Additionally, music listening can modulate the patient’s inflammatory response and reduce perioperative anxiety [–].
In Singapore, the implementation of music listening as a noninvasive intervention in the perioperative setting is limited. Given the potential clinical benefits of music listening as justified by the aforementioned studies, the primary aim is to investigate the patient satisfaction towards perioperative music listening in the local setting. The secondary aim of our study is to investigate the effect of perioperative music listening in reducing patient surgery-related anxiety and depression in the local setting. The instruments used to address the secondary aim include the Hospital Anxiety and Depression Scale (HADS) and EQ-5D-3L questionnaires. The HADS comprises fourteen questions with individual scores from 0 to 3, to produce a final score for the assessment of anxiety and depression on a continuum scale. Similarly, the EQ-5D-3L assesses the general health status through questions exploring five dimensions: mobility, self-care, usual activities, pain/discomfort, and anxiety/depression. Evaluating Quantitative Research Designs
2. Materials and Methods
After obtaining approval from Singhealth Centralized Institutional Review Board (CIRB Ref: 2017/2292) and trial registration from clinicaltrials.gov (Ref: NCT03226028), we conducted a quasiexperimental study on a cohort of patients to investigate the effect of perioperative music listening in KK Women’s and Children’s Hospital, Singapore. This study adhered to the CONSORT guidelines. We recruited female patients who were not hearing impaired, of American Society of Anesthesiologists (ASA) physical statuses 1 and 2, and were undergoing elective minor gynaecological surgeries, mainly dilation and curettage procedures and hysteroscopies. Obstetric patients and patients who were unable to read and understand the questionnaires of this study were excluded from this study.
Upon obtaining written informed consent, patients’ demographic data and music listening preferences were collected. The Hospital Anxiety and Depression Scale (HADS) and EQ-5D-3L questionnaire were administered to the patients to determine the patient’s baseline anxiety and depression levels. Thereafter, the patients were given an iPod Touch™ device (Apple; Cupertino, CA, USA) along with noise cancellation earphones, which contained 1,441 songs across 34 presaved playlists spanning different music genres. These playlists were compiled by the institution’s music therapist to ensure adequate coverage of the various music genres. Patients were able to listen to any playlist of their choice during the preoperative period in a quiet environment until their elective surgeries. Thirty minutes prior to their scheduled surgeries, all patients were asked to listen to a mandatory music playlist, compiled by the institution’s music therapist, which promoted relaxation and serenity. The preoperative music listening was discontinued when the patient entered the operating theatre for her scheduled surgery. The duration of music listening, patient’s preferred music playlists, and patient satisfaction were collated. The time between when the patient stopped listening to music and the start of anesthesia administration was also noted.
Intraoperative vital signs, analgesic usage, and duration of surgery were recorded. All patients received routine anesthesia and surgical protocols and were sent to the recovery unit after surgery. Patients resumed listening to music once they were ready and comfortable to do so and would continue until their discharge from the recovery unit. Thereafter, patients were administered a second set of HADS and EQ-5D-3L questionnaire and interviewed on their satisfaction, preferred music playlists, and their overall experience with the music listening study. Postoperative vital signs, analgesic usage, pain scores, and duration of stay in the recovery unit were also recorded. The iPod Touch™ devices and noise-cancelling earphones were disinfected in accordance with the institution’s infection control guidelines, replacing the earbuds with fresh ones. Evaluating Quantitative Research Designs
Patient satisfaction was assessed by asking patients to rate their satisfaction with their overall experience using a 4-point verbal rating scale (1 = excellent, 2 = good, 3 = fair, and 4 = poor). In assessing anxiety and depression, the HADS and EQ-5D-3L self-reported questionnaires were administered. Out of the five dimensions in the EQ-5D-3L questionnaire exploring questions relating to mobility, self-care, usual activities, pain/discomfort, and anxiety/depression, only pain/discomfort and anxiety/depression dimensions were analysed as the former three dimensions would be confounded by the surgery itself. Similarly, the visual analog scale examining the patient’s self-rated health in the EQ-5D-3L questionnaire was not applicable and therefore excluded from this study.
2.1. Statistical Analysis
Statistical analysis was performed using SAS version 9.3 software (SAS Institute; Cary, NC, USA). The collated data were summarized as mean and standard deviation (SD) for normally distributed numerical data, median, and interquartile range (IQR) for nonnormally distributed numerical data, and frequency and proportion for categorical data. Normality assessments were performed, and the results of this study do not follow a normal distribution. Wilcoxon signed-rank test and McNemar’s test for paired data were used for analysis, and significance was taken to be .
Ninety-five patients were assessed for eligibility for the study, but only 83 of them were included in the study data analysis. Two patients were excluded from the study: one patient had surgery postponed and another patient did not wish to continue with the study due to abdominal pain. After surgery, 12 patients declined to listen to music, with 7 (58.3%) patients reported drowsiness and 4 (33.3%) patients reported pain being the most common reasons for refusal. These were excluded from the data analysis to preserve paired data analysis. The flowchart of the study is represented in Figure .
Table reflects the baseline and demographic data of the recruited patients. The mean ± SD duration of music listening in the preoperative period was 128.6 ± 60.88 minutes and 43.4 ± 19.41 minutes in the postoperative period. The mean ± SD duration between the cessation of music listening in the preoperative period to the induction of general anesthesia was 5.1 ± 2.33 minutes. Table represents the results from the questionnaires obtained from patients before the initiation of music listening and after the conclusion of the study. In terms of patient satisfaction, 81 (97.6%) patients in the preoperative period and 82 (98.8%) patients in the postoperative period were satisfied (rated “excellent” and “good”) with music listening.Evaluating Quantitative Research Designs
Values are represented as mean ± SD or number (proportion). ASA: American Society of Anesthesiologists.
Values are represented as median (IQR [range]) or number (proportion). HADS: Hospital Anxiety and Depression Scale; EQ-5D-3L: three-level version of the EuroQol five-dimensional questionnaire.
The median (IQR [range]) score for preintervention HADS anxiety was 7.0 (6.0 [0–17]), significantly higher than that in postintervention at 2.0 (4.0 [0–12]) (). Similarly, there was a significant reduction in preintervention HADS depression as compared to postintervention (). Figure illustrates the box-and-whisker plots for both HADS anxiety and depression scores. These results were corroborated by similar findings from the EQ-5D-3L anxiety/depression dimension (). 94.0% of patients in the preoperative period reported experiencing no pain at rest as compared to 79.5% of patients in the postoperative period ().
Table represents the patient preferences of song genres in the preoperative and postoperative periods. The ambient genre (22.9%) was most favoured in the preoperative period, followed by modern (19.3%) and religious (18.1%) genres. However, the mandatory playlist prior to surgery (19.3%), ambient (16.9%), and religious (14.5%) genres were most popular amongst patients in the postoperative period.
Values are represented as number (proportion).
This study examined the efficacy of perioperative music listening in reducing patient surgery-related anxiety and depression in the local setting. Majority of patients participated in both preoperative and postoperative music listening. Patients preferred to have their own choice of music, although a recommended mandatory playlist was offered. There is a wide spectrum of music genres chosen by Asian patients in this study. Majority of patients in both preoperative and postoperative periods were satisfied with perioperative music listening. We found that patients who listened to music in the perioperative setting reported feeling less anxiety and depression scores.
The therapeutic benefits of music have been well expounded in the current research literature. It is widely proposed that listening to music helps to distract patients from focusing on negative thoughts of the impending surgery, a major source of anxiety [, ]. Listening to music provides a source of serenity and calmness that patients can divert their attention to, and focus less on feelings of anxiety and fear . However, the influence of perioperative music listening has not been far-reaching in Singapore, with only one other study investigating the effect of music listening on postoperative pain and anxiety in orthopaedic surgical patients . We hope that our study can generate more interest in considering perioperative music listening as a possible nonpharmacological approach to alleviating psychological distress in patients undergoing surgery in the local and regional setting.
From our study, perioperative music listening significantly reduces psychological distress of anxiety and depression in patients. Our findings are consistent with those made in previous studies [, , , ]. To many people, surgery is a daunting experience that comes with emotional vulnerabilities . These emotions are often intensified moments before surgery causing overwhelming anxiety and even depressive moods. Preoperative anxiety and depression has extensive consequences if left unattended. Increased preoperative anxiety can lead to postponement or even cancellation of planned surgeries, and increase in dose requirements of anesthetic drugs to ensure unconsciousness intraoperatively prolonged hospital stay and poorer overall patient satisfaction [, ]. Similarly, preoperative depression has been shown to increase the risk of postoperative delirium in selected patient groups [, ]. Therefore, there is great justification in addressing preoperative psychological distress. Music listening is affordable and safe and can be easily used by healthcare professionals in the hospital . It counteracts psychological distress efficiently with a very low risk profile. Evaluating Quantitative Research Designs
We acknowledge several limitations of our study. As most of our findings were gathered from questionnaires, our results could have been affected by patients’ willingness to take part in this study protocol and this could be different during routine clinical practice. Moreover, the ability to read and understand English and Chinese in the questionnaires resulted in a selected patient population. We also did not investigate factors that may have affected patient’s anxiety and mood such as interactions between the study team investigator and patient, as well as the responsiveness to patients’ needs. Lastly, postintervention results may have been confounded by the patient’s knowledge that the surgery itself, the main source of anxiety, had been successful. Nevertheless, it is noteworthy that the efficacy of perioperative music listening is well established from studies conducted abroad, as a safe, inexpensive, and effective option. We hope that our study can provide fresh perspectives into the use of perioperative music listening for this purpose in the local and regional perioperative setting.
In conclusion, the findings of our study are in congruence with those made in previous studies that perioperative music listening is an effective approach in reducing psychological distress. We believe that this study outlining our experiences with the implementation of perioperative music listening in Singapore can be used for future research in the local healthcare settings, further improving patient outcomes with lower cost, greater convenience, and safety. Evaluating Quantitative Research Designs
|ASA:||American Society of Anesthesiologists|
|CIRB:||Centralized Institutional Review Board|
|EQ-5D-3L:||Three-level version of the EuroQol five-dimensional questionnaire|
|HADS:||Hospital Anxiety and Depression Scale|
All data generated or analysed during this study are included in this manuscript. The data used to support the findings of this study are available from the corresponding author upon request.
This study was approved by the Singhealth Centralized Institutional Review Board (Singhealth CIRB Ref: 2017/2292) and registered on Clinicaltrials.gov on May 4, 2017 (Ref: NCT03226028).
This study was presented as a poster at the Association of Anaesthetists of Great Britain & Ireland (AAGBI)’s Annual Congress, Dublin, Ireland, on September 26, 2018.
Conflicts of Interest
The authors declare that there are no conflicts of interest regarding the publication of this article.
The authors would like to thank Ms. Agnes Teo (Clinical Research Coordinator) for her administrative support during this study. The authors acknowledged the institutional funding from the Singhealth Duke-NUS Anaesthesiology and Perioperative Sciences Academic Clinical Programme Clinical Innovation Support Programme (Grant no. 12/FY2017/P2/10-54). Evaluating Quantitative Research Designs
- J. Hole, M. Hirsch, E. Ball, and C. Meads, “Music as an aid for postoperative recovery in adults: a systematic review and meta-analysis,” The Lancet, vol. 386, no. 10004, pp. 1659–1671, 2015.View at: |
- D. Evans, “The effectiveness of music as an intervention for hospital patients: a systematic review,” Journal of Advanced Nursing, vol. 37, no. 1, pp. 8–18, 2002.View at: |
- M. Good, M. Stanton-Hicks, J. A. Grass et al., “Relaxation and music to reduce postsurgical pain,” Journal of Advanced Nursing, vol. 33, no. 2, pp. 208–215, 2001.View at: |
- J. B. Palmer, D. Lane, and D. Mayo, “Collaborating with music therapists to improve patient care,” AORN Journal, vol. 104, no. 3, pp. 192–197, 2016.View at: |
- Y. Liu and M. A. Petrini, “Effects of music therapy on pain, anxiety, and vital signs in patients after thoracic surgery,” Complementary Therapies in Medicine, vol. 23, no. 5, pp. 714–718, 2015.View at: |
- S. Leardi, R. Pietroletti, G. Angeloni, S. Necozione, G. Ranalletta, and B. Del Gusto, “Randomized clinical trial examining the effect of music therapy in stress response to day surgery,” British Journal of Surgery, vol. 94, no. 8, pp. 943–947, 2007.View at: |
- K.-C. Lee, Y.-H. Chao, J.-J. Yiin, H.-Y. Hsieh, W.-J. Dai, and Y.-F. Chao, “Evidence that music listening reduces preoperative patients’ anxiety,” Biological Research for Nursing, vol. 14, no. 1, pp. 78–84, 2012.View at: |
- M. Thompson, K. Moe, and C. P. Lewis, “The effects of music on diminishing anxiety among preoperative patients,” Journal of Radiology Nursing, vol. 33, no. 4, pp. 199–202, 2014.View at: |
- A. Y. R. Kühlmann, A. de Rooij, L. F. Kroese, M. van Dijk, M. G. M. Hunink, and J. Jeekel, “Meta-analysis evaluating music interventions for anxiety and pain in surgery,” British Journal of Surgery, vol. 105, no. 7, pp. 773–783, 2018.View at: |
- K. B. Gaberson, “The effect of humorous and musical distraction on preoperative anxiety,” AORN Journal, vol. 62, no. 5, pp. 784–791, 1995.View at: |
- M. Cooke, W. Chaboyer, P. Schluter, and M. Hiratos, “The effect of music on preoperative anxiety in day surgery,” Journal of Advanced Nursing, vol. 52, no. 1, pp. 47–55, 2005.View at: |
- J. J. Ignacio, M. F. Chan, S. H. Teo, L. M. Tsen, and R. Goy, “Research in brief-the effect of music on pain, anxiety, and analgesic use on adults undergoing an orthopaedic surgery: a pilot study,” Singapore Nursing Journal, vol. 39, no. 4, pp. 49–51, 2012.View at:
- E. Twiss, J. Seaver, and R. McCaffrey, “The effect of music listening on older adults undergoing cardiovascular surgery,” Nursing in Critical Care, vol. 11, no. 5, pp. 224–231, 2006.View at: |
- M. Jawaid, A. Mushtaq, S. Mukhtar, and Z. Khan, “Preoperative anxiety before elective surgery,” Neurosciences, vol. 12, no. 2, pp. 145–148, 2007.View at:
- D. J. Tan and M. M. Chan, “Do obstetric patients opt to undergo general anaesthesia to avoid being conscious despite safer alternatives?” Annals of the Academy of Medicine, Singapore, vol. 46, no. 6, pp. 248–251, 2017.View at:
- H. A. Jlala, J. L. French, G. L. Foxall, J. G. Hardman, and N. M. Bedforth, “Effect of preoperative multimedia information on perioperative anxiety in patients undergoing procedures under regional anaesthesia,” British Journal of Anaesthesia, vol. 104, no. 3, pp. 369–374, 2010.View at: |
- Y. Kadoi, C. Kawauchi, M. Ide et al., “Preoperative depression is a risk factor for postoperative short-term and long-term cognitive dysfunction in patients with diabetes mellitus,” Journal of Anesthesia, vol. 25, no. 1, pp. 10–17, 2011.View at: |
- J. M. Leung, L. P. Sands, E. A. Mullen, Y. Wang, and L. Vaurio, “Are preoperative depressive symptoms associated with postoperative delirium in geriatric surgical patients?” The Journals of Gerontology Series A: Biological Sciences and Medical Sciences, vol. 60, no. 12, pp. 1563–1568, 2005.View at: |
- R. McCaffrey, “Music listening: its effects in creating a healing environment,” Journal of Psychosocial Nursing and Mental Health Services, vol. 46, no. 10, pp. 39–44, 2008. Evaluating Quantitative Research Designs