Technological Challenges and Solutions in Emergency Remote Teaching for Nursing: An International Cross-Sectional Survey

Article information

Healthc Inform Res. 2024;30(1):49-59
Publication date (electronic) : 2024 January 31
doi : https://doi.org/10.4258/hir.2024.30.1.49
1Technology Research, Samsung SDS, Seoul, Korea
2Department of Nursing Science, University of Turku, Turku, Finland
3School of Nursing, University of British Columbia, Vancouver, Canada
4School of Nursing, University of British Columbia Okanagan, Okanagan Valley, Canada
5College of Nursing, Benguet State University, La Trinidad, Philippines
6Cancer Care, Fraser Health Authority, British Columbia, Canada
7College of Nursing, University of Florida, Gainesville, FL, USA
8Nursing Faculty, Benemérita Universidad Autónoma de Puebla, Puebla, Mexico
9Health Informatics Department, Hospital Italiano de Buenos Aires, Buenos Aires, Argentina
10School of Nursing, Columbia University Data Science Institution, New York, NY, USA
11Collegiate of Nursing, Federal Institute of Paraná, Paranavaí, Brazil
12Department of Computing, Federal University of Technology–Paraná, Curitiba, Brazil
13School of Nursing, Universitas Muhammadiyah Yogyakarta, Kasihan, Indonesia
14Department of Nursing, Wilkes University, Wilkes-Barre, PA, USA
15Information Science Department, Kuwait University, Kuwait, Kuwait
16College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar
17School of Nursing, Jordan University of Science and Technology, Irbid, Jordan
18Nursing department, Chi Mei Medical Center, Tainan, Taiwan
19Department of Nursing, Chang Jung Christian University, Tainan, Taiwan
20College of Nursing, Tzu University of Science and Technology, Hualien, Taiwan
21Department of Nursing, Gangneung-Wonju National University, Wonju, Korea
Corresponding Author: Jisan Lee, Department of Nursing, Gangneung-Wonju National University, 150 Namwon-ro, Heungeop-myeon, Wonju 26403, Korea. Tel: +82-33-760-8646, E-mail: saan2mari@gmail.com (https://orcid.org/0000-0002-9039-7448)
Received 2023 November 12; Revised 2024 January 26; Accepted 2024 January 26.

Abstract

Objectives

With the sudden global shift to online learning modalities, this study aimed to understand the unique challenges and experiences of emergency remote teaching (ERT) in nursing education.

Methods

We conducted a comprehensive online international cross-sectional survey to capture the current state and firsthand experiences of ERT in the nursing discipline. Our analytical methods included a combination of traditional statistical analysis, advanced natural language processing techniques, latent Dirichlet allocation using Python, and a thorough qualitative assessment of feedback from open-ended questions.

Results

We received responses from 328 nursing educators from 18 different countries. The data revealed generally positive satisfaction levels, strong technological self-efficacy, and significant support from their institutions. Notably, the characteristics of professors, such as age (p = 0.02) and position (p = 0.03), influenced satisfaction levels. The ERT experience varied significantly by country, as evidenced by satisfaction (p = 0.05), delivery (p = 0.001), teacher-student interaction (p = 0.04), and willingness to use ERT in the future (p = 0.04). However, concerns were raised about the depth of content, the transition to online delivery, teacher-student interaction, and the technology gap.

Conclusions

Our findings can help advance nursing education. Nevertheless, collaborative efforts from all stakeholders are essential to address current challenges, achieve digital equity, and develop a standardized curriculum for nursing education.

I. Introduction

Emergency remote teaching (ERT) refers to a temporary shift to online education during crises or disasters [1]. In response to the coronavirus disease 2019 (COVID-19) pandemic, schools were shuttered to curb the virus’s spread, prompting widespread closures of educational systems in several countries [2]. Hodes et al. [1] emphasized the term ‘Emergency’ in ERT, noting that it is a temporary measure distinct from traditional, well-established online learning platforms, and thus should not be directly compared. Consequently, educators faced a substantial increase in preparation time due to the transition to online learning [3].

Several studies have examined educators’ general characteristics that can influence online learning outcomes [4,5]. Kent and Giles found that an educator’s age, highest level of education, and teaching experience impacted their technology self-efficacy in online learning environments. Furthermore, the effectiveness of online learning has been the subject of previous research. Roach and Lemasters [6] assessed both the content and delivery methods of online education, as well as the ease of locating educational materials, and how these factors might affect learners’ satisfaction with online learning. Shelton et al. [7] identified the interaction between teachers and students as a key factor influencing student satisfaction with online education. Hung [8] investigated technology self-efficacy to determine instructors’ preparedness for online teaching and the adequacy of institutional support for online education.

Apart from research on online learning, there are also studies focusing on nursing education during the COVID-19 pandemic. Wild et al. [9] conducted a comparison between simulation-based and traditional face-to-face nursing education in the United States. Meanwhile, Leigh et al. [10] suggested various learning strategies, such as scenario-based, virtual, and self-directed learning, for undergraduate nursing education in the United Kingdom.

Since ERT differs from well-planned online learning, it is believed that the challenges faced by nursing educators are unique. The primary research question of the current study is, “How have nursing educators managed the implementation of nursing education using ERT in various countries during the pandemic?” The secondary research questions are as follows: “What teaching methods have been employed in response to the current pandemic?” “How do educators perceive the status of nursing education?” and “What factors influence satisfaction with ERT?” The aim of this study is to determine how the factors derived in previous online learning research influence ERT satisfaction and to identify the current circumstances and challenges faced by nursing educators, with the goal of proposing enhancements to nursing education and its curriculum.

II. Methods

1. Study Design

This incorporated an international cross-sectional survey and a parallel mixed-method study. We conducted a mixed-method study that involved quantitative and qualitative analysis using natural language processing to gather a wide range of opinions from educators. Additionally, we conducted an international cross-sectional study to gain insights into various current conditions, avoiding bias toward any specific country. Qualitative analysis provides a richer understanding, but is time-intensive, labor-intensive, and prone to bias for researchers [11]. However, a previous study used computerized analyses such as natural language processing— a new form of qualitative analysis that applies algorithms to analyze text data—to compensate for some of the limitations of qualitative research [12]. Thus, after the qualitative responses were subjected to natural language processing, the researchers reviewed the outcomes and subjected them to further analysis.

2. Questionnaire

The questionnaire was developed through iterative discussions among 11 experts from the International Medical Informatics Association–Student and Emerging Professionals Group–Nursing Informatics (IMIA-SEP-NI). It was translated into seven languages: Arabic, English, Korean, Indonesian, Portuguese, Spanish, and Traditional Chinese. For each language, two bilingual nurses or health informaticians with a background in nursing informatics (NI) carried out the translation. This was then verified by at least two other bilingual experts and revised until a final version was achieved.

The questionnaire consisted of 21 questions (see Supplement A). The first seven questions gathered demographic information about the educators, including age, country and city of residence, current position, level of education, educational background, experience in nursing education, and the type of subject taught [46,13,14]. The eighth question inquired about the teaching methods used during the COVID-19 pandemic, specifically face-to-face versus online methods. Questions #9 to #18 required participants to rate their responses on a 5-point Likert scale, ranging from strongly disagree to strongly agree. These questions also invited open-ended comments to elaborate on the reasons behind their ratings. The topics addressed in these questions pertained to ERT and included overall satisfaction, content depth and breadth, the delivery of pre-prepared educational materials, teacher–student interactions, perceived burden, technological self-efficacy, and support. The support-related items specifically asked about the ease of accessing digital/online material support and institutional backing for the transition to digital/online resources. Additionally, participants were asked about their willingness to continue using these methods in the future. The final three questions (#19–#21) were open-ended. They prompted respondents to reflect on their experiences with ERT during the COVID-19 pandemic by discussing lessons learned, expectations for the advancement of nursing education, and suggestions for how NI organizations could bolster nursing education. This study received approval from an Institutional Review Board of Hoseo University (No. 1041231-200825-HR-114-01).

3. Participants and Data Collection

Any educator with experience in nursing education during the COVID-19 pandemic, dating back to January 2020, was eligible to participate. We employed the convenience snowball sampling method, which relies on networking and referrals [15]. Initially, the authors emailed the IMIA-SEP-NI group to serve as the starting point for global data collection, distributing Google Forms that included consent forms and the questionnaire (see Supplement A). Subsequently, participants who consented were asked to share the Google Forms link through their academic networks, such as their country’s NI or professional nursing groups, via email or social network services (e.g., Twitter and KakaoTalk). Data collection spanned from November 2020 to January 2021.

4. Analysis

The analytical process used in this study is shown in Figure 1. Authors from each participating country translated the survey responses from their respective national languages into English. The English-translated data were then collectively analyzed. Initially, a descriptive analysis of the participants’ characteristics and the teaching methods referenced in questions #1–#7 was conducted. Subsequently, means and standard deviations were calculated for the scores of questions #9–#18. The responses to question #14, which pertained to burden, were reverse-coded. Lastly, the open-ended responses to questions #9–#21 were subjected to a separate analysis. This involved the use of natural language processing and latent Dirichlet allocation (LDA) topic modeling via Python [16,17], as well as qualitative analysis and the extraction of meaningful insights. These tasks were undertaken by the first and corresponding authors (EJJ and JL), both of whom are NI researchers.

Figure 1

Overview of the research process.

The descriptive analysis was conducted using Python (3.6.9) with the numpy (1.19.4), pandas (1.1.5), and sklearn (0.22.2) libraries. Spearman correlation coefficients and the chi-square test were used to determine the impact of educators’ characteristics.

To analyze qualitative data from open-ended question responses, two researchers initially categorized all comments for each question as either positive or negative. This was followed by the commencement of the pre-processing stage. For natural language preprocessing, we utilized Python’s regular expressions to remove special characters and double spaces. Data were then tokenized using the NLTK (3.2.5) to-kenizer available in Python. During part-of-speech tagging, we included adjectives and verbs, specifically tagging “Adjective (JJ),” “Adjective, comparative (JJR),” “Adjective, superlative (JJS),” “Adverb (RB),” “Adverb, comparative (RBR),” “Adverb, superlative (RBS),” “Verb, base form (VB),” “Verb, past tense (VBD),” “Verb, gerund or present participle (VBG),” “Verb, past participle (VBN),” “Verb, non-3rd person singular present (VBP),” and “Verb, 3rd person singular present (VBZ).” Following this, English stop words from the NLTK library were removed. Finally, lemmatization was performed using the WordNet Lemmatizer of the Python NLTK library (e.g., “have,” “has,” “had” → “have”).

Next, LDA topic modeling was performed using the Python Gensim library (version 3.6.0) to extract core topics. LDA operates by classifying or categorizing text into documents and words per topic, which are modeled based on Dirichlet distributions and processes [18]. Additionally, the optimal number of topics for LDA is determined by the CV coherence score value. This metric evaluates a topic’s semantic consistency, with higher values indicating greater semantic consistency.

Two NI researchers independently reviewed all comments and 20 representative words from each topic to gain a better understanding of the participants’ responses and meanings. They conducted a qualitative analysis to categorize the topics, merging or adding categories as necessary. Each researcher independently read and classified the responses according to the topics identified through LDA, and they introduced new thematic labels to account for comments that did not fit into the existing topics. Any inconsistencies in the categorization of comments and the introduction of new themes were resolved through discussion.

III. Results

1. General Characteristics of Respondents and Teaching Methods

A total of 328 respondents from 18 countries participated in the survey: Brazil (128, 39.02%), Indonesia (57, 17.38%), South Korea (33, 10.06%), Jordan (27, 8.23%), the Philippines (22, 6.71%), Taiwan (17, 5.18%), Argentina (11, 3.35%), Canada (8, 2.44%), Finland (6, 1.83%), the US (6, 1.83%), Mexico (5, 1.52%), Italy (2, 0.61%), India (1, 0.3%), Portugal (1, 0.3%), Saudi Arabia (1, 0.3%), Scotland (1, 0.3%), Switzerland (1, 0.3%), and Türkiye (1, 0.3%).

Table 1 shows the respondents’ characteristics. Most respondents were 30–39 years of age (36.28%), and 26.22% were assistant professors.

General and educational characteristics (n = 328)

Question #8, on online teaching methods, allowed multiple selections. The most used were video conference systems (e.g., Zoom and Microsoft Teams; n = 281, 28.18%), followed by teaching management platforms (e.g., Google Classroom and Moodle; n = 197, 19.76%), social networking technology (e.g., Facebook, Google+, WhatsApp, and Twitter; n = 147, 14.74%), video sharing platforms (e.g., YouTube and Flipgrid; n = 145, 14.54%), the institution’s online platform (n = 99, 9.93%), game-based teaching platforms (e.g., Kahoot; n = 47, 4.71%), blogs or websites (n = 36, 3.61%), massive open online courses (e.g., Coursera and Canvas network;n = 29, 2.91%), and virtual learning systems (e.g., SecondLife and vSim; n = 16, 1.60%). In analyzing the relationship between the number of software platforms used and other variables (Questions #9–#18), no statistically significant correlations were found.

2. ERT Experience: Quantitative Data Analysis

The results for ERT status (questions #9–#18) are shown in Table 2. Regarding the positive aspects of ERT, support from the institution had the highest score, followed by technological self-efficacy, willingness to use ERT in the future, support for using digital/online material, overall satisfaction with ERT, and the range of the content.

Quantitative results for emergency remote teaching experience (n = 328; 5-point Likert scale)

The results for the influence of educators’ characteristics on ERT experiences are shown in Table 3. The average satisfaction level was 4.00 ± 0.88 out of 5 for professors, 3.58 ± 0.98 for associate professors, 3.71 ± 0.72 for assistant professors, and 3.49 ± 0.82 for instructor/lecturers. Thus, more highly-ranked positions were generally associated with higher satisfaction with ERT. The country of the educators also showed a significant correlation with ERT experiences. Results showing substantial average differences between countries that provided five or more responses (for questions #9, #11, #12, #13, #14, and #18) are illustrated in Figure 2.

Influence of teachers' characteristics on their emergency remote teaching experiences (n = 328)

Figure 2

Differences between countries with 5 or more responses to significant questions.

3. Detailed Comments on ERT Experience: Qualitative Data Analysis

Table 4 presents the number of topics selected for each question. More specifically, Supplement B shows topics using words extracted by LDA for each question. Two researchers qualitatively analyzed participants’ responses to the open-ended comments sections of the ERT questionnaire, and the results are presented in Supplement C.

Preprocessing method and parameters in latent Dirichlet allocation analysis

4. Lessons and Expectations

Table 5 shows the results for questions #19–#21 of the questionnaire. The respondents reported that they had learned the following lessons by applying ERT in nursing education: “Effective in theory but inadequate in practice class,” “One must use ERT because it is essential in the pandemic era, but there is room for improvements,” and “Online teaching is a future trend, so it should be continuously improved and utilized.” They also believed that ERT has the advantages of accessibility (i.e., availability anytime and anywhere), repeatability, and self-learning. In contrast, educators commented on the lack of suitability of the ERT for clinical practice in nursing education.

Qualitative results for lessons and expectations of emergency remote teaching experiences (n = 328)

The respondents also provided the following suggestions to improve nursing education: “We need to develop a practical or hybrid course suitable for the pandemic era,” and “Online teaching should be developed.” They also expressed a need for further support for high-quality instruction in ERT through improvements in related laws and guidelines.

Respondents offered several recommendations for how NI organizations can support nursing education, including “support for online teaching and for the simulation of clinical practice,” “provide curricula and standards for online teaching methods,” and “education on freeware teaching tools, and reliable online resources, among others.” Hence, they recognized the need for organizations to provide standards and structures for ERT in nursing.

IV. Discussion

This study is meaningful because it employed both quantitative and qualitative analyses, utilizing computer programs and human researchers, respectively, to investigate the ERT experiences of 328 nursing educators from 18 different countries.

Overall, the participants reported a moderate level of satisfaction with ERT in nursing, as indicated by an average score of 3.59 out of 5. This finding is consistent with survey results from previous research, which indicated that 62.9% of faculty members were satisfied with online teaching in the United Arab Emirates during the COVID-19 pandemic [19]. Similarly, a study on ERT satisfaction in the United States revealed that 68.7% of academic faculty were content with ERT, giving it a score of 3.71 out of 5 [20]. Despite the additional workload involved in preparing for ERT, faculty members reportedly developed online self-efficacy through this experience and adapted accordingly [21]. This may correspond to the higher score observed in this study for the “willingness to use in the future” item, which exceeded satisfaction levels with a score of 3.76 out of 5. Despite the challenges faced by educators, digital technology has proven indispensable for maintaining educational relationships [22]. Moreover, respondents expressed the opinion that ERT, as an emerging trend in education, is expected to improve over time.

Nonetheless, our study and previous studies confirmed that the shift to ERT was burdensome for faculty members. Factors contributing to dissatisfaction included a higher work-load and the need for extended preparation time [19]. Al-leviating this burden will require well-organized IT technical support, collaborative teams, and established standards for online learning [20,23]. Furthermore, there should be clear standards for online learning to enable professors to develop a range of strategies for teaching in this modality [20].

Respondents also described the disadvantages of ERT, including issues such as content depth, delivery, and teacher– student interaction. These challenges are similar to the limitations of online learning. However, is not appropriate to compare the sudden shift to online learning due to COVID-19 with existing well-designed online learning, and doing so may mislead and spread the stigma and general perception that online education is of low quality [24]. Instead, we suggest that the negative aspects were highlighted to a greater extent due to the rapid transition to ERT. Therefore, well-planned online learning is likely to lead to higher satisfaction and growth potential.

Brazil (n = 129) had the lowest score for delivery, with an average of 2.34 ± 1.21 out of 5. Respondents noted a lack of dynamic, real-time interaction for practice and expressed a preference for face-to-face education, emphasizing the importance of eye-to-eye contact with students. In contrast, South Korea (n = 34) reported satisfaction with the delivery of online learning, which was executed as planned. Respondents highlighted the use of various tools and, with a satisfaction score of 4 or more points, many comments mentioned the employment of diverse software such as Google Classroom and Zoom.

Interestingly, the technological self-efficacy score was high. Previous studies have shown that, due to online learning, professors have acquired skills in online technology [20], and this high self-efficacy has facilitated an efficient transition from face-to-face to virtual formats [21]. Additionally, many respondents highlighted the importance of online learning infrastructure and IT support. However, there were instances where the necessary equipment for online learning, such as computers and monitors, was not available, or internet speeds were too slow to conduct lectures effectively. The COVID-19 pandemic has exposed a global educational and technological divide, posing a threat to digital equity [25]. A worldwide survey of higher education students also reported issues with internet connectivity [26]. As technology is rapidly integrated, the disparity in access to the technology and devices required for ERT among educators and students may need to be addressed. In planning for future online learning, it is essential to consider digital equity.

Although 57 topics were identified via LDA, it was sometimes challenging to clearly discern the topics. This difficulty arose partly because the top 20 representative words for each topic were not always sufficient to convey the full scope of the topic, given LDA’s limitations in capturing pragmatic and semantic nuances [11]. For example, topics such as ‘individual level contact’ or ‘not effective’ required a review of the actual responses to fully understand their implications. As a result, this combined approach of computational and human analysis identified an additional 55 distinct themes, underscoring the importance of human interpretation in complementing computer-generated results. In light of the limitations identified in our study, we propose recommendations for future research. Our methodology involved convenience snowball sampling, and we did not collect participants’ email addresses, which would have helped in recognizing duplicate responses. Consequently, our final sample had an uneven geographical representation. Specifically, Brazil accounted for 39% of the responses, European countries had a low response rate, and we received no responses from educators in China. In future studies, we plan to nationalize portions of the research and collect email addresses to better understand international perspectives on the topic.

In conclusion, the findings and implications of our study related to technological challenges and solutions in NI education are as follows. Our results showed that nursing educators had adapted well to ERT, even though they initially found it burdensome to use ERT during the COVID-19 pandemic. This study’s findings underscore the importance of nursing education stakeholders being prepared to apply hybrid education drawing on the experiences gained from ERT. These should include standardized, student-centered classes and strengthened support to promote digital equity. Our findings also highlight the significant role of special interest groups or academic associations of NI in providing feasible software solutions and practical simulation training based on real clinical data, along with reliable online materials. Furthermore, it is essential to organize forums to share training courses and ERT experiences on these ever-changing online teaching platforms.

Acknowledgments

We thank the IMIA-SEP-NI group members for their support, feedback on the survey, and everyone who helped distribute it.

This work was supported by a National Research Foundation of Korea (NRF) grant funded by the Korean government (MSIT) (No. NRF-2021R1C1C1004505).

Notes

Conflict of Interest

No potential conflict of interest relevant to this article was reported.

References

1. Hodges C, Moore S, Lockee B, Trust T, Bond A. The difference between emergency remote teaching and online learning [Internet] Denver (CO): Educause Review; 2020. [cited at 2024 Jan 30]. Available from: https://er.educause.edu/articles/2020/3/the-difference-between-emergency-remote-teaching-and-online-learning.
2. Viner RM, Russell SJ, Croker H, Packer J, Ward J, Stansfield C, et al. School closure and management practices during coronavirus outbreaks including COVID-19: a rapid systematic review. Lancet Child Adolesc Health 2020;4(5):397–404. https://doi.org/10.1016/S2352-4642(20)30095-X.
3. Elshami W, Taha MH, Abuzaid M, Saravanan C, Al Kawas S, Abdalla ME. Satisfaction with online learning in the new normal: perspective of students and faculty at medical and health sciences colleges. Med Educ Onlin 2021;26(1):1920090. https://doi.org/10.1080/10872981.2021.1920090.
4. Kent AM, Giles RM. Preservice teachers’ technology self-efficacy. SRATE J 2017;26(1):9–20.
5. Peltonen LM, Pruinelli L, Ronquillo C, Nibber R, Peresmitre EL, Block L, et al. The current state of Nursing Informatics: an international cross-sectional survey. Finn J eHealth eWelf 2019;11(3):220–31. https://doi.org/10.23996/fjhw.77584.
6. Roach V, Lemasters L. Satisfaction with online learning: a comparative descriptive study. J Interact Online Learn 2006;5(3):317–32.
7. Shelton BE, Hung JL, Lowenthal PR. Predicting student success by modeling student interaction in asynchronous online courses. Distance Educ 2017;38(1):59–69. https://doi.org/10.1080/01587919.2017.1299562.
8. Hung ML. Teacher readiness for online learning: Scale development and teacher perceptions. Comput Educ 2016;94:120–33. https://doi.org/10.1016/j.compedu.2015.11.012.
9. Wild LM, Congdon B, Boyle K, Provost V, Schlesinger M, Salyers V, et al. Innovations in nursing education: Recommendations in response to the COVID-19 pandemic [Internet] San Diego (CA): National Education Progression in Nursing Collaborative; 2020. [cited at 2024 Jan 30]. Available from: https://oadn.org/wp-content/uploads/2021/03/Nursing-Education-and-COVID-Pandemic-March-30-2020-FINAL-1.pdf.
10. Leigh J, Vasilica C, Dron R, Gawthorpe D, Burns E, Kennedy S, et al. Redefining undergraduate nurse teaching during the coronavirus pandemic: use of digital technologies. Br J Nurs 2020;29(10):566–9. https://doi.org/10.12968/bjon.2020.29.10.566.
11. Leeson W, Resnick A, Alexander D, Rovers J. Natural language processing (NLP) in qualitative public health research: a proof of concept study. Int J Qual Methods 2019;18:1609406919887021. https://doi.org/10.1177/1609406919887021.
12. Crowston K, Allen EE, Heckman R. Using natural language processing technology for qualitative data analysis. Int J Soc Res Methodol 2012;15(6):523–43. https://doi.org/10.1080/13645579.2011.625764.
13. Jeon E, Kim J, Park HA, Lee JH, Kim J, Jin M, et al. Current status of nursing informatics education in Korea. Healthc Inform Res 2016;22(2):142–50. https://doi.org/10.4258/hir.2016.22.2.142.
14. Mitchell MM, Delgado C. Online learning: advantages and challenges in implementing an effective practicum experience. Open J Nurs 2014;4(6):379–84. https://doi.org/10.4236/ojn.2014.46044.
15. Parker C, Scott S, Geddes A. Snowball sampling London, UK: SAGE Research Methods Foundations; 2019.
16. Koltcov S, Koltsova O, Nikolenko S. Latent Dirichlet allocation: stability and applications to studies of user-generated content. In : Proceedings of the 2014 ACM Conference on Web Science; 2014 Kim 23–26; Bloomington, IN, USA. p. 161–5. https://doi.org/10.1145/2615569.2615680.
17. Xue J, Chen J, Chen C, Zheng C, Li S, Zhu T. Public discourse and sentiment during the COVID 19 pandemic: using latent Dirichlet allocation for topic modeling on Twitter. PLoS One 2020;15(9):e0239441. https://doi.org/10.1371/journal.pone.0239441.
18. Blei DM, Ng AY, Jordan MI, Lafferty J. Latent Dirichlet allocation. J Mach Learn Res 2003;3:993–1022.
19. Elshami W, Taha MH, Abuzaid M, Saravanan C, Al Kawas S, Abdalla ME. Satisfaction with online learning in the new normal: perspective of students and faculty at medical and health sciences colleges. Med Educ Online 2021;26(1):1920090. https://doi.org/10.1080/10872981.2021.1920090.
20. Sacco TL, Kelly MM. Nursing faculty experiences during the COVID-19 pandemic response. Nurs Educ Perspect 2021;42(5):285–90. https://doi.org/10.1097/01.NEP.0000000000000843.
21. Culp-Roche A, Hardin-Fanning F, Tartavoulle T, Hampton D, Hensley A, Wilson JL, et al. Perception of online teacher self-efficacy: a multi-state study of nursing faculty pivoting courses during COVID 19. Nurse Educ Today 2021;106:105064. https://doi.org/10.1016/j.nedt.2021.105064.
22. Berndtsson I, Dahlborg E, Pennbrant S. Work-integrated learning as a pedagogical tool to integrate theory and practice in nursing education: an integrative literature review. Nurse Educ Pract 2020;42:102685. https://doi.org/10.1016/j.nepr.2019.102685.
23. McKay MA, Pariseault CA, Whitehouse CR, Smith T, Ross JG. The experience of baccalaureate clinical nursing faculty transitioning to emergency remote clinical teaching during the COVID-19 pandemic: lessons for the future. Nurse Educ Today 2022;111:105309. https://doi.org/10.1016/j.nedt.2022.105309.
24. Fuchs K. The difference between emergency remote teaching and e-learning. Front Educ 2022;7:921332. https://doi.org/10.3389/feduc.2022.921332.
25. Mukhtar K, Javed K, Arooj M, Sethi A. Advantages, limitations and recommendations for online learning during COVID-19 pandemic era. Pak J Med Sci 2020;36(COVID19-S4):S27–S31. https://doi.org/10.12669/pjms.36.COVID19-S4.2785.
26. Aristovnik A, Kerzic D, Ravselj D, Tomazevic N, Umek L. Impacts of the COVID-19 pandemic on life of higher education students: a global perspective. Sustainability 2020;12(20):8438. https://doi.org/10.3390/su12208438.

Article information Continued

Figure 1

Overview of the research process.

Figure 2

Differences between countries with 5 or more responses to significant questions.

Table 1

General and educational characteristics (n = 328)

Characteristic n (%)
Age (yr)
 20–29 15 (4.57)
 30–39 119 (36.28)
 40–49 118 (35.98)
 50–59 47 (14.33)
 60+ 30 (8.84)

Current position
 Instructor/lecturer 169 (51.52)
 Assistant professor 86 (26.22)
 Associate professor 46 (14.02)
 Professor 24 (7.32)
 Other 3 (0.91)

Teaching experience (yr)
 0–9 154 (46.95)
 10–19 132 (40.24)
 20–29 27 (8.23)
 30+ 15 (4.57)

Highest educational qualification
 Bachelor’s 18 (5.49)
 Master’s 126 (38.41)
 Doctor/PhD 180 (54.88)
 Other 2 (0.61)
 No response 2 (0.61)

Specialization (multiple responses allowed; n = 373)
 Adult health nursing 93 (24.93)
 Public health/community nursing 54 (14.48)
 Maternal/child health and neonatal nursing 53 (14.21)
 Nursing administration 48 (12.87)
 General nurse (no specialization) 22 (5.09)
 Acute care 19 (5.09)
 Psychiatric/mental health nursing 18 (4.83)
 Geriatric nursing 15 (4.02)
 Nursing informatics 15 (4.02)
 Women’s health nursing 11 (2.95)
 Infection prevention 4 (1.07)
 Other 21 (5.63)

Type of courses taught
 Both 232 (70.73)
 Didactic course 58 (17.68)
 Clinical practicum 38 (11.59)

Category of students taught (multiple responses allowed; n = 476)
 Undergraduate students 303 (63.66)
 Graduate students 55 (11.55)
 Postgraduate 97 (20.38)
 Postdoctoral 10 (2.10)
 Other 9 (1.89)
 No response 2 (0.42)

Table 2

Quantitative results for emergency remote teaching experience (n = 328; 5-point Likert scale)

Concept of question Question Mean (SD)
9. Overall satisfaction Overall, emergency remote teaching worked well in my teaching. 3.59 (0.83)
10. Contents (in-depth) Emergency remote teaching provided in-depth learning opportunities for students compared with traditional teaching. 2.96 (1.06)
11. Contents (wide range) Emergency remote teaching provided a wide range of learning opportunities for students compared with traditional teaching. 3.20 (1.05)
12. Delivery Emergency remote teaching delivered exactly what I originally planned, regardless of COVID-19. 2.83 (1.17)
13. Teacher–student interaction The teacher–student interaction worked equally well in emergency remote teaching compared to traditional methods. 2.67 (1.18)
14. Burdena Moving to emergency remote teaching from traditional teaching has been a burden for me. 3.27 (1.25)
15. Technological self-efficacy I have become much more confident in dealing with online teaching technology since the emergency remote teaching began. 3.76 (1.05)
16. Support (finding material) It has been easy to find help using digital/online educational material for emergency remote teaching. 3.61 (1.07)
17. Support (institution) My institution/school has fully supported the transfer of my teaching to emergency remote teaching. 3.88 (1.14)
18. Willingness to use in the future I will increase the use of distance/online education methods that have been used in emergency remote teaching in the future. 3.76 (1.16)
a

Reverse-coded question.

Table 3

Influence of teachers' characteristics on their emergency remote teaching experiences (n = 328)

Q9 Q10 Q11 Q12 Q13 Q14d Q15 Q16 Q17 Q18
Agea 0.174* 0.137* 0.043 0.087 0.075 −0.115* 0.064 0.053 0.089 0.097
Current positionb 2.929* 2.098 1.132 3.989* 0.800 0.579 3.607* 0.720 1.298 0.011
Teaching experiencea 0.100 0.069 −0.013 −0.036 0.025 −0.099 −0.038 0.050 0.073 −0.029
Teaching subjectc (except ‘Both,’ n = 95) −3.302* −1.521 0.048 −0.799 0.296 1.558 −1.046 0.067 −0.610 −1.801
Countryb 3.950* 1.089 2.659 7.481* 3.137* 3.406* 1.157 1.484 1.738 2.332*

Q9: Overall satisfaction, Q10: Contents (in-depth), Q11: Contents (wide range), Q12: Delivery, Q13: Teacher-student interaction, Q14: Burden, Q15: Technological self-efficacy, Q16: Support (finding material), Q17: Support (institution), Q18: Willingness to use in the future.

a

Spearman correlation,

b

ANOVA test,

c

t-test,

d

reverse-coded question.

*

p < 0.05.

Table 4

Preprocessing method and parameters in latent Dirichlet allocation analysis

Concept of question Positive comment Negative comment


n (%) Topics Coherence n (%) Topics Coherence
9. Overall satisfaction 83 (43.2) 2 0.7023 109 (56.8) 4 0.6797

10. Contents (in-depth) 53 (34.0) 2 0.6912 103 (66.0) 5 0.6851

11. Contents (wide range) 69 (51.9) 2 0.6823 64 (48.1) 2 0.7314

12. Delivery 30 (23.6) 2 0.7325 97 (76.4) 5 0.6792

13. Teacher–student interaction 28 (19.9) 2 0.6712 113 (80.1) 4 0.7145

14. Burdena 47 (30.9) 2 0.7508 105 (69.1) 4 0.6628

15. Technological self-efficacy 71 (62.8) 3 0.7174 42 (37.2) 2 0.7149

16. Support (finding material) 83 (69.2) 3 0.7086 37 (30.8) 2 0.7532

17. Support (institution) 43 (70.5) 2 0.7372 18 (29.5) 3 0.6526

18. Willingness to use in the future 72 (75.0) 2 0.7120 24 (25.0) 4 0.6080
a

Reverse-coded question.

Table 5

Qualitative results for lessons and expectations of emergency remote teaching experiences (n = 328)

Concept of question Main theme Comment
19. Lessons and learning Unsuitable for nursing practice “Practical courses are very difficult to conduct remotely or without the presence of real patients” [ID:7, Jordan]
“There are many restrictions in practical training. Nursing education using information technology such as simulation and virtual reality is urgently needed” [ID:166, South Korea]
Need for improvement “It is important to seek strategies to encourage students’ autonomy in the teaching–learning process.” [ID:309, Brazil]
“[There is a need for] technology preparedness at the university level to handle distance learning” [ID:54, US]
Future trends “I believe that teaching will never be the same after ending the pandemic teaching process. Remote teaching was a growth opportunity for students and teachers.”
[ID:188, Brazil]

20. Suggestions for nursing education Develop practical courses The online learning or simulation practices developed so far do not seem to have enough core capabilities for graduate nurses” [ID:161, South Korea]
“Innovative and creative learning media using virtual reality and augmented reality [are needed] to support the clinical learning process” [ID:139, Indonesia]
Hybrid method “Theoretical teaching works very well virtually. However, practical classes and internships need to exist.” [ID:309, Brazil]
Standards and guidelines “I hope to produce a guide and official video for each subject for the non-face-to-face practical classes.” [ID:176, South Korea]

21. Request to nursing informatics organizations Support software “Work with software designers to develop realistic clinical scenarios that are truly interactive and user friendly.” [ID:49, Canada]
“Create a free virtual simulation platform” [ID:86, Argentina]
“[Deploy] less heavy and easy-to-use programs in terms of the graphical interface and user connection” [ID:80, Mexico]
Training courses “Provide effective online learning workshops.” [ID:121, Indonesia]
“Offer courses to become proficient in the use of online platforms” [ID:66, Italy]
Relevant sources “Provide standardized learning materials that can be used interactively for learning theory and especially practicum” [ID:102, Indonesia]
“Assist in the preservation of data and copyright, security and ethics in information”
[ID:296, Brazil]