doi: 10.5455/mjhs.2022.04.005
Original Article
Medical Staff Teaching Experience During COVID-19 Pandemic
1KSA- Madinah
Abstract
Background and Aims: The COVID-19 pandemic changed teaching and learning methods across the world. This cross-sectional study aimed to assess clinical tutor feedback on the e-learning at Taibah University Medical College during pandemic. Methods: Consenting medical faculty were asked to provide their feedback through an electronic semi-structured questionnaire which had both multiple choice and Likert scale responses. Sociodemographic data were also collected. The study was approved by Institutional Ethics Committee. Results: A total of 66 medical faculty members were participated. Most of the respondents were females (53%), almost half of them were Saudi nationals, and 48.4% had fewer than ten years of teaching experience. Most respondents felt that online teaching was the preferred choice during the pandemic, but over half of them (56.1%) favored classroom teaching for medical students. Almost fifty percent of the faculty members had not undergone training for medical education or online teaching. 86.4% of them felt that knowledge could be imparted through online teaching, but communication skills and psychomotor skills couldn’t be acquired by online teaching. Around 60% of teachers felt that it is difficult to assess the students through the virtual teaching method. Conclusions: The medical faculty members believe that e-learning is time-consuming, it decreases student-teacher interaction, and student evaluation and assessment are more difficult than classroom teaching. Virtual teaching is good for imparting knowledge; however, it is not the preferred method for teaching communication and psychomotor skills.
Keywords Online education · Virtual teaching · e-learning · Medical education · COVID-19
Introduction
Since COVID-19 first took hold in Wuhan, China, the world has seen incredible advancements and failures for humanity. Within months, COVID-19 seamlessly crossed all geographical and political boundaries to become a pandemic.1 Teacher, along with other professionals, had to quickly find alternative ways to carry out their work. To continue medical education unabated and prevent the loss of time and knowledge, the Ministry of Education and Health in Saudi Arabia recommended online teaching for medical students.2
Thus, the age-old method of classroom teaching, based on personal interaction between students and teachers, had to be substituted with comparable, or improved, ways of interactive, informative, and effective teaching. In addition to this, medical teachers had to look for options for teaching clinical skills, which had also been suspended simultaneously. Classroom or clinical-setting teaching aims to stimulate deep learning, which is enforced when students become responsible for their learning and use critical analysis effectively.
Virtual education, or e-learning, refers to instruction in a learning environment where educators and students are separated by time, space, or both.3,4 This learning format confers several advantages over conventional approaches. E-learning is easy to access as there is no geographical restriction; it crosses all longitudes and latitudes for one and all.3,5,6 Virtual learning is neither static nor time-bound. It encourages self-motivation and self-learning for the students. Lastly, education can be consistent for all students through virtual teaching. E-learning can be didactic or interactive depending upon the teacher's model and the response of students. It can either be synchronous or asynchronous, depending upon time constraints and the convenience for both students and teachers.6 Thus, the inclusion of e-learning into the current system of medical education as a blended learning system is being promoted.7
Although the shift from conventional teaching to virtual teaching was new for medical students of our university, remote online education for medical professionals was already a part of the curriculum in some medical schools.3,8–12 The inclusion of virtual learning in the medical curriculum was recommended by the World Health Organization, mainly to decrease the gap between the availability and requirement of healthcare professionals in the developing world.3 World-class universities started participating in Massive Online Open Courses (MOCC), by which learning has become easily accessible in all corners of the world.13,14 There has been an exponential increase in e-learning for economically developing countries as well.2 There have been various initiatives in Saudi Arabia to modify the mode of education because of the easy and widespread access to the internet and web-based resources.15
However, due to the COVID-19 pandemic, e-learning became mandatory rather than optional. The mushrooming of online platforms such as Zoom, Microsoft Teams, Google classroom, etc., have not only helped teachers but presented confusing technical and logistical hurdles. It has been challenging for teachers and students to familiarize themselves with this virtual classroom model. The teachers have had to shift to remote teaching while supporting learning outcomes and fulfilling teaching objectives. The need to complete the academic year without any loss to the students has encouraged the medical faculty to become accustomed to remote/virtual teaching as early as possible.
As the waves of COVID cases have not yet subsided, and there is no timeline for returning to regular or pre-pandemic medical teaching, there is a pressing need to understand the flaws of online medical education and improve upon them. We conducted this cross-sectional clinical study to assess clinical tutor feedback about e-learning during the COVID-19 pandemic at Taibah University Medical College.
Methods
Study design: This descriptive cross-sectional study was undertaken during the academic year 2020-21 from 1st January 2021 to 31st March 2021 at the College of Medicine at Taibah University, Al Madinah City, Saudi Arabia. The study was approved by the Research Ethics Committee/College of Medicine/Taibah University (IRB00010413).
Study participants: We invited all medical faculty of Taibah Medical College to participate in the study. Recently recruited faculty members, those who had not been given teaching responsibility, and those who refused to participate were excluded from the study. Written informed consent was obtained from all the participants.
Questionnaire: The data was collected by researchers using a semi-structured questionnaire that helped gather information on the socio-demographics of participants and their views on e-learning. We developed a questionnaire for this study which consisted of 43 questions. (Appendix 1) (https://docs.google.com/forms/d/e/1FAIpQLSdErrlA8gC6SHyrucWG0IfCTiQapwrdIx-nAplZO9uvOG8Ufw/viewform)
The questionnaire had two types of questions: multiple-choice questions and those with Likert scale answers. We utilized the five-point Likert scale for scoring, i.e., 5, strongly agree; 4, agree; 3, not sure; 2, disagree; and 1, strongly disagree. We sent an invitation link of the questionnaire as a Google form to all the consenting medical faculty members, through email and WhatsApp messages. All participants were requested to understand the purpose and methodology of the study and reach out to us for any clarification. Email reminders were sent twice every ten days to encourage maximum participation. Only completed questionnaires were considered.
Data analysis and management: Statistical analysis was done using the Statistical Package for Social Science (SPSS) version 21.0 (SPSS, Chicago, Il, USA). Quantitative data were represented as mean and standard deviation (SD), and qualitative data as frequencies and percentages.
Results
Demographics: Sixty-six medical faculty members working at Taibah University Medical College, Al Madinah City, KSA, were enrolled in this study. Table 1 gives brief information about the participating faculty. Among the 66 participants, 35 (53%) were females, with most participants (23, 34.8%) falling into the 41–50-year-old age bracket. Over half (51.5%) were Saudi nationals. The Mean age (±SD) of the participants was 42.93 ±7.22 years. Almost 50% of the faculty members had work experience of fewer than ten years, and 19.7% had more than 20 years of teaching experience. Half of the participants were from the Medicine department, and the rest, 30.3% and 18.2%, were from Basic Medical Science and Surgical departments, respectively. Most of the faculty was involved in teaching all students (i.e., from 2nd to 6th profession (or year)), and only 12 (18.2%) faculty members were teaching female students only. Approx. two-thirds (66.7%) of the teaching faculty did not have any degrees or certificates in medical education. (Table 1) profession (or year)), and only 12 (18.2%) faculty members were teaching female students only. Approx. two-thirds (66.7%) of the teaching faculty did not have any degree or certificate in medical education. (Table 1)
Experience and training of staff: During the COVID-19 pandemic, medical faculty took up various teaching activities. The most common activities were Skill Lab (44, 67.7%), Case- based collaborative learning (44, 67.7%), personal professional development (42, 63.6%), early clinical experience (29, 3.9%) and case management (23, 34.8%). Most of the faculty members (59, 89.4%) conducted their online classes from their respective homes. Our questions regarding the teaching practices showed that 29 (43.9%) preferred online e-learning classes. In contrast, the rest (37, 56.1%) preferred live classroom teaching, which shows that most of the medical faculty feel more comfortable with classroom lectures, a traditional teaching approach. Most of the teaching faculty had attended the workshops related to medical education (28.8% always and 39.4% occasionally), and 50% of the faculty had attended the E-learning/online teaching workshop whenever they had been offered such courses. A similar percentage (53.1%) had attended workshops for using technology (Zoom, blackboard) for teaching (Table 2).
Difficulties faced by teaching staff: The faculty members (39.4%) highlighted that they were aware of the university’s technical support available for their problems. Networking issues were occasionally faced by 28.8% of the faculty members during teaching from their homes (Table 4). A majority (66.7%) of the faculty members felt that allocated time was always appropriate for them to deliver the lecture online, and the rest felt the time allocation was occasionally proper. As medical education has a significant section of practical work, 71.2% of the faculty strongly agreed that face-to-face learning is the best option for practical teaching, and only 6.1% remained neutral. (Table 3)
Innovations by teaching staff: The faculty members tried various ways to make teaching more interactive between students and the teachers. Two-thirds of the medical faculty felt that using a whiteboard was an outdated method and didn’t make teaching more communicative; 84.4% felt that live teaching in skill-laboratory was not a proper way to teach, and 30 % had a bitter experience with the use of videos during lectures. On the other hand, 95.5% felt that sharing a screen made their sessions more interactive, and 50% wanted their students to switch on the cameras.
Skill training: When questioned about the different domains of medical education, 86.4% felt that knowledge could be gained through online teaching, and 68.2% felt that cognitive skills could be improved with virtual instructions. However, 71.2% and 62.1% felt psychomotor skills and communication skills couldn't be learned by students through online teaching, respectively. About 68.2% felt that educational material had been changed to adapt to a new online teaching strategy. The majority of the faculty members (75.8%) participated in changing/planning and reframing content for online teaching. Almost all the faculty members gave students feedback about their performance. In regards to feedback styles; 68.2% of faculty members were specific and provided examples when needed, 77.3% addressed the positive issues first and then asked about the areas needing improvement, and only 16.7% of the faculty members conducted weekly meetings.
Participation of students: Regarding the involvement of the students, only 18.2% of teachers were dissatisfied with the participation and involvement of students during online classes. Close to half (48.5%) of the faculty felt that they could occasionally maintain the group dynamics (i.e., the group's performance as one team) during an online class. Approximately half of the faculty members felt that trust could be established among groups if the group members did not criticize each other, and 83.3% felt that a listening attitude could also enhance trust among group members. Teachers felt that the reasons for poor interaction included lack of effective communication (54%), lack of motivation (51%), lack of interest (41%), and lastly, the students' lack of listening skills for online classes (30%). Most of the teachers (71.2%) tried to motivate the students and were flexible with questioning for assessment and comparison of knowledge. Teachers (53%) encouraged the students to explain their answers with critical and logical reasoning, and some (36.4%) also suggested they use flow diagrams to explain complex concepts.
Assessment using online teaching: Regarding the evaluation of knowledge and cognitive skills, a majority (86.4%) felt that multiple-choice questions (MCQs) were the best method, followed by Objective Structured Clinical Examination (OSCE (62.1%)), and 47% thought oral examination is the right option. For practical and clinical skill assessment, a majority favored OSCE (84.8%), followed by Objective Structured Practical Examination (OSPE (72.7%)); MCQ and mini-essay-questions (MEQ) were not preferred.
Overall experience: After the online teaching modality was taken up due to restrictive orders, only 13.6% found e-learning to be a valuable teaching method, and 30.3% did not find e-learning helpful. Only 13.6% felt that e-learning serves to provide rich educational resources and experiences; 7.6% thought that e-learning provides extensive education to learners, and only 3.0% felt that it improves the participation of students in learning processes. Additionally, 42.4% felt that e-learning needs well-prepared educational resources; 57.6% thought that technological infrastructure is crucial for successful implementation, and 54.6% did not agree that e-learning improves the effectiveness of teaching. Furthermore, when assessing the view that e-learning saves time and effort when compared to conventional on-campus teaching, only 18.2% strongly agreed, 27.3% agreed, and 34.8% of the faculty were neutral. Additionally, 60.6% felt that it is difficult to evaluate students' performance through e-learning (Table 4).
Discussion
The year 2020 has seen medical educators around the world forced to transition to virtual education, all while facing the enormous challenges of COVID-19. Although this was a sudden shift for the faculty members of the university, many medical institutions across the globe were already in the process of including e-learning into their curriculum.8,9,12 In the medical education system, teachers must become facilitators for learning, which is far more than just delivering didactic lectures. The conventional role of a teacher as the content provider has changed into one where the teacher plays an active role in progressing and developing a science student into a doctor. All the learning domains, such as cognitive, psychomotor, and affective, are to be taken care of while teaching.
Thus, the transition from age-old classroom medical teaching to virtual learning, or e-learning, in medical education is slow and facing some barriers.16,17,18 E-learning can be network-based or non-network-based, or it can be a blended learning management system. Network-based is taking live classes, and non-network implies that students are not always connected; resources are shared via pen drives or compact discs. A blended learning management system means that the resources, track record of the students and notifications are available online to both students and teachers; however, the teaching is generally held in the conventional classroom method.12 The blended education system can overcome some of the disadvantages of online teaching.12,19 When blended with classroom teaching, e-learning can help provide resources, increase student participation, and can include regular assessments after each topic is completed.6,9,12,20,21 Before the onset of the pandemic, we had established a web-based platform that contains cases, assessment questionnaires, educational content, and notices from the administration; however, this was not interactive, and teaching was undertaken live physically. The mixed responses of the teachers included in this study show that the inclusion of a learning management system for the university and blended education system can be taken forward to improve medical education in the country.
The results of the study show that the medical faculty members considered e-learning/teaching to be more time-consuming and require more training and proper infrastructure, as compared to conventional classroom teaching. In our study, most faculty members were females, Saudi nationals, less than 50 years of age, and 50% had less than ten years of teaching experience. Only one-third of the faculty members had training for medical education. Almost half of them occasionally attended the workshops and courses for medical education and online education, and technology for teaching. Interestingly, during this short period of less than a year, faculty members tried different teaching methods to increase the students' active participation.
Our faculty members showed a positive response for the initiation of e-learning during the pandemic which has been reflected from other clinical studies as well. Hoq et al. found that most of the teachers welcomed the new teaching method and were happy to prevent any academic loss for the students.2 Another study from medical colleges of Saudi Arabia also showed that the faculty members had a positive attitude towards the inclusion of e-learning in their curriculum.22
However, the overall experience of the faculty members showed a preference for classroom teaching as compared to online teaching. Some of the reasons for the preference for classroom teaching included differences in the level of group interaction, effective communication, and motivation among students. As psychomotor skills can be best taught in real-life scenarios, our teachers also did not see any role of e-learning in imparting psychomotor skills to students. Technological difficulties were not a significant concern for the faculty, and they were satisfied with the timely technical help from the university staff. The difficulties included the non-serious attitude of the students, apart from the technical glitches, which were not significant. Additionally, the home environment was not suitable for both teachers and students alike. Teachers above the age of 50 years and students living in areas with poor internet connectivity had difficulties in this transition. Our faculty members also felt the lack of student-teacher interaction during virtual teaching.3,23 In addition to our analysis, other problems of e-learning included difficulty in availability and accessibility of hardware and software, connectivity issues, increased financial burden for the students and the university management, and the teacher's constant effort required to make e-learning captivating and retainable.16,17,18
As the second and third waves of the pandemic are still engulfing the world and mass vaccination is not yet complete, faculty members will have to make further efforts to impart psychomotor skills through videos demonstrating various procedures and interventions.6 Some of the suggested methods to improve e-learning might include proper training of the medical teaching staff and establishing appropriate infrastructure.24 All the stakeholders should be on the same page before the set-up of online teaching. The authorities, teaching staff, and the students should have a positive attitude toward including e-learning in the education system.23 The teachers can allocate tasks to students, involve them in presenting seminars, interpreting cases, and having open discussions. E-learning is beneficial for continuing in-service training and for improving clinical skills.25,26
One of the limitations of our study was the non-inclusion of feedback from the medical students. In a study among medical students of Qasim Medical Institute, Saudi Arabia, the students were surveyed about the success of e-learning in compensating for the urgent suspension of face-to-face teaching during the COVID-19 pandemic and the effectiveness of online assessment in testing their knowledge and skill levels.27 There was an overwhelmingly positive response for e-learning as 87% of the students found e-learning to be unique and highly satisfying. Interestingly, e-learning gave more chances for students to participate in discussions, and they thought that this method gave them more time to do other things and thus lead a normal life. Contrary to our results, the teaching staff was satisfied with the online teaching and assessment methods and hoped to continue them later. There were some concerns about the inadequate knowledge and experience of the medical teaching staff.27 Interestingly, there are conflicting views from the students about the benefits and disadvantages of e-learning. Some studies have reported that students find e-learning beneficial as it improves understanding, is easily accessible and is flexible; additionally, there is increased student participation.6,28,29 On the other hand, students have also reported e-learning to be more time-consuming, stating a lack of student-teacher interaction and tutor support, and feelings of isolation or difficulty in clarifying any doubts.3 Some reports suggest that teachers find that e-learning saves time, content can be easily edited, there is no variation in content for different sub-groups of the class, and videos can help in teaching skills that are difficult to teach every student equally in the laboratories.6,30,31
As the continuation of medical education became more critical during this pandemic, we wanted to evaluate the new strategies and overcome the flaws and work on improving medical education. This study aims to recognize the experience of medical faculty during the transition from physical classroom and hospital-based teaching to virtual e-learning for medical students. Parallel to our study, various other clinical studies were also conducted to understand the changing role of virtual learning for students.2,27,32–34 While analyzing the response of the medical faculty members, it is also crucial to remember that this transition was stressful and difficult for medical teachers as they had to adapt to a new way of teaching in a short span. The medical teachers had to continue with “student-centered learning” through virtual classrooms as well. Additionally, the medical faculty had to remotely help students in controlling the stress and panic of the COVID-19 pandemic.
Our study had some limitations, including small sample size, cross-sectional study design, single-center study, and a lack of feedback information from the students, parents, and university officials. However, such feedback with analysis will help the university, and further studies with students and a larger sample size can help understand the advantages, effectiveness, and flaws of online teaching for medical students. The introduction of e-learning was a learning experience for the medical faculty as well. Although working from home is coming up as an alternative approach for the employees, there is a smaller chance that online teaching will be considered a substitute for classroom teaching for medical education.
Conclusion
The medical faculty found online teaching to be a good substitute for classroom teaching during the COVID-19 pandemic. However, they still prefer conventional teaching methods as online education is less interactive, students are less serious during classes, assessment is complex, and practical/clinical skills cannot be taught effectively. The inclusion of online platforms can be a good way of communicating with students educational resources and for logbook maintenance.
4. Source of funding
"This research did not receive any specific grant from funding agencies in the public, commercial, or not for- profit sectors"
5. Conflict of interest
There is no conflict of interest
6. Ethical approval
was obtained from Scientific Research Ethics Committee college of medicine IORG0008716-IRB00010413.
7.References
1. World Health Organization. WHO Director-General’s opening remarks at the media briefing on COVID-19 - 11 March 2020. Published March 11, 2020. Accessed April 13, 2021. https://www.who.int/director-general/speeches/detail/who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19---11-march-2020
2. Hoq MZ. E-Learning During the Period of Pandemic (COVID-19) in the Kingdom of Saudi Arabia: An Empirical Study. Am J Educ Res. 2020;8(7):457-464. doi:10.12691/education-8-7-2
3. Al-Shorbaji Najeeb, Atun Rifat, Car Josip, Majeed Azeem, Wheeler Erica. WHO | eLearning for undergraduate health professional education. January 2015. Published 2015. Accessed May 4, 2021. https://www.who.int/hrh/documents/elearning_hwf/en/
4. Ellaway R, Masters K. AMEE Guide 32: E-Learning in medical education Part 1: Learning, teaching and assessment. Med Teach. 2008;30(5):455-473. doi:10.1080/01421590802108331
5. George PP, Papachristou N, Belisario JM, et al. Online eLearning for undergraduates in health professions: A systematic review of the impact on knowledge, skills, attitudes and satisfaction. J Glob Health. 2014;4(1). doi:10.7189/jogh.04.010406
6. Dhir SK, Verma D, Batta M, Mishra D. E-learning in medical education in India. Indian Pediatr. 2017;54(10):871-877. doi:10.1007/s13312-017-1152-9
7. Choules AP. The use of e-learning in medical education: a review of the current situation. Postgrad Med 2007; 83(978): 212e216.
8. Kim KJ, Kim G. Development of e-learning in medical education: 10 years’ experience of Korean medical schools. Korean J Med Educ. 2019;31(3):205-214. doi:10.3946/kjme.2019.131
9. Walsh K. E-learning in medical education: The potential environmental impact. Educ Prim Care. 2018;29(2):104-106. doi:10.1080/14739879.2017.1389619
10. Lewis KO, Cidon MJ, Seto TL, Chen H, Mahan JD. Leveraging e-learning in medical education. Curr Probl Pediatr Adolesc Health Care. 2014;44(6):150-163. doi:10.1016/j.cppeds.2014.01.004
11. Ruiz JG, Mintzer MJ, Leipzig RM. The impact of e-learning in medical education. Acad Med. 2006;81(3):207-212. doi:10.1097/00001888-200603000-00002
12. Vallee A, Blacher J, Cariou A, Sorbets E. Blended learning compared to traditional learning in medical education: Systematic review and meta-analysis. J Med Internet Res. 2020;22(8). doi:10.2196/16504
13. Das AK, Das A, Das S. Present Status of Massive Open Online Course (MOOC) initiatives for Open Education Systems in India – An Analytical Study. Asian Journal of Multidisciplinary Studies ISSN: Published 2015. Accessed April 13, 2021. https://www.researchgate.net/publication/305075435_Present_Status_of_Massive_Open_Online_Course_MOOC_initiatives_for_Open_Education_Systems_in_India_--_An_Analytical_Study
14. Aydin CH. Current Status of the MOOC Movement in the World and Reaction of the Turkish Higher Education Institutions. Open Prax. 2017;9(1):59. doi:10.5944/openpraxis.9.1.463
15. Al-Shehri A. E-learning in Saudi Arabia: ′To E or not to E, that is the question′. J Fam Community Med. 2010;17(3):147. doi:10.4103/1319-1683.74333
16. O’Doherty D, Dromey M, Lougheed J, Hannigan A, Last J, McGrath D. Barriers and solutions to online learning in medical education - An integrative review. BMC Med Educ. 2018;18(1). doi:10.1186/s12909-018-1240-0
17. Nimavat N, Singh S, Fichadiya N, Sharma P, Patel N, Kumar M, Chauhan G, Pandit N. Online Medical Education in India – Different Challenges and Probable Solutions in the Age of COVID-19. Adv Med Educ Pract. 2021;12:237-243 https://doi.org/10.2147/AMEP.S295728
18. Syed S, Rastogi A, Bansal A, et al. Future of e-Learning in Medical Education—Perception, Readiness, and Challenges in a Developing Country. Front Educ. 2021;6:1. doi:10.3389/feduc.2021.598309
19. Sweeney J, O’donoghue T, Whitehead C. Traditional face‐to‐face and web‐based tutorials: a study of university students’ perspectives on the roles of tutorial participants. Teach High Educ. 2004;9(3):311-323. doi:10.1080/1356251042000216633
20. Hadley J, Kulier R, Zamora J, et al. Effectiveness of an e-learning course in evidence-based medicine for foundation (internship) training. J R Soc Med. 2010;103(7):288-294. doi:10.1258/jrsm.2010.100036
21. Gerdprasert S, Pruksacheva T, Panijpan B, Ruenwongsa P. An interactive web-based learning unit to facilitate and improve intrapartum nursing care of nursing students. Nurse Educ Today. 2011;31(5):531-535. doi:10.1016/j.nedt.2010.10.008
22. Alanazi A A. Views of faculty members on the use of e-learning in Saudi Medical and Health Colleges during CoVID-19 pandemic. J Nat Sci Med. 2020;3(4):308-317.
23. Ferri F, Grifoni P, Guzzo T. Online Learning and Emergency Remote Teaching: Opportunities and Challenges in Emergency Situations. Societies. 2020;10(4):86. doi:10.3390/soc10040086
24. Toquero CM. Challenges and Opportunities for Higher Education amid the COVID-19 Pandemic: The Philippine Context. Pedagog Res. 2020;5(4):em0063. doi:10.29333/pr/7947
25. Kullberg MLJ, Mouthaan J, Schoorl M, De Beurs D, Kenter RMF, Kerkhof AJFM. E-learning to improve suicide prevention practice skills among undergraduate psychology students: Randomized controlled trial. JMIR Ment Heal. 2020;7(1):e14623. doi:10.2196/14623
26. Colaceci S, Zambri F, D’Amore C, et al. Long-Term Effectiveness of an E-Learning Program in Improving Health Care Professionals’ Attitudes and Practices on Breastfeeding: A 1-Year Follow-Up Study. Breastfeed Med. 2020;15(4):254-260. doi:10.1089/bfm.2019.0203
27. Elzainy A, El Sadik A, Al Abdulmonem W. Experience of e-learning and online assessment during the COVID-19 pandemic at the College of Medicine, Qassim University. J Taibah Univ Med Sci. 2020;15(6):456-462. doi:10.1016/j.jtumed.2020.09.005
- Bains M, Reynolds PA, Mcdonald F, Sherriff M. Effectiveness and acceptability of face-to-face, blended and e-learning: A randomised trial of orthodontic undergraduates. Eur J Dent Educ. 2011;15(2):110-117. doi:10.1111/j.1600-0579.2010.00651.x
29. Kong J, Li X, Wang Y, Sun W, Zhang J. Effect of digital problem-based learning cases on student learning outcomes in ophthalmology courses. Arch Ophthalmol. 2009;127(9):1211-1214. doi:10.1001/archophthalmol.2009.110
30. Toumas M, Basheti IA, Bosnic-Anticevich SZ. Comparison of small-group training with self-directed internet-based training in inhaler techniques. Am J Pharm Educ. 2009;73(5). doi:10.5688/aj730585
31. Flowers SK, Vanderbush RE, Hastings JK, West D. Web-based multimedia vignettes in advanced community pharmacy practice experiences. Am J Pharm Educ. 2010;74(3). doi:10.5688/aj740339
32. Bhardwaj A, Nagandla K, Swe KMM, Abas ABL. Academic staff perspectives towards adoption of E-learning at Melaka manipal medical college: Has e-learning redefined our teaching model? Kathmandu Univ Med J. 2015;13(49):12-18. doi:10.3126/kumj.v13i1.13746
33. Moawad RA. Online Learning during the COVID- 19 Pandemic and Academic Stress in University Students. Rev Rom pentru Educ Multidimens. 2020;12(1Sup2):100-107. doi:10.18662/rrem/12.1sup2/252
34. Hanafy SM, Jumaa MI, Arafa MA. A comparative study of online learning in response to the coronavirus disease 2019 pandemic versus conventional learning. Saudi Med J. 2021;42(3):324-331. doi:10.15537/smj.2021.42.3.20200741