Year : 2022 | Volume
| Issue : 4 | Page : 379-382
What's best, online or on-site? The write a scientific paper course
Victor Grech1, Jeremy Borg Myatt2, Sarah Cuschieri3
1 Department of Paediatrics, Mater Dei Hospital, Msida MSD2090, Malta
2 Foundation Programme Malta, Mater Dei Hospital, Msida MSD2090, Malta
3 Department of Anatomy, Faculty of Medicine and Surgery, University of Malta, Msida MSD2080, Malta
Jeremy Borg Myatt
Foundation Year 2 Doctor, Mater Dei Hospital, Msida MSD2090
Source of Support: None, Conflict of Interest: None
|Date of Submission||02-Apr-2022|
|Date of Decision||27-Apr-2022|
|Date of Web Publication||03-Sep-2022|
Background: The ability to publish is a career-critical skill but requires the acquisition of a wide and disparate skill set. The Write a Scientific Paper (WASP) course was created in Malta in 2010, an intensive, three-day event. WASP is an accredited event held in Malta, London, and Bahrain. The COVID pandemic forced WASP to go online. This study compared satisfaction with WASP online as opposed to in-person by analyzing course feedback pre- and post-pandemic.
Methods: Google forms are used to collect anonymous feedback on a Likert scale for various aspects of each WASP. The period 2017 to 2022 was used to compare four courses on-site and five courses online. Feedback on: Rate lectures, handouts, WASP overall and how likely are you to recommend WASP was compared.
Results: Response rates were >60% and almost all Cronbach's Alpha values were >0.7. High satisfaction scores were achieved in all four questions (>4/5). There were no significant differences except in lectures, which scored well but fared slightly worse overall online.
Conclusions: Migrating online does not necessarily lead to change/s in presentation contents but transforms delivery. Our results indicate that WASP is accepted online but the slightly lower lectures score implies that WASP might be better delivered in-person than online. However, students remained happy to recommend WASP and this accords with other studies that overall, student satisfaction with online education is common. It is hoped that as the pandemic recedes, webinars complement and not continue to totally replace traditional in-person meetings.
Keywords: Biostatistics, computers, PowerPoint, presentations, research, software
|How to cite this article:|
Grech V, Myatt JB, Cuschieri S. What's best, online or on-site? The write a scientific paper course. Saudi J Anaesth 2022;16:379-82
| Introduction|| |
The ability to write up one's research is a career-critical skill, acceding to the “publish or perish” mantra. However, this requires the individual to learn a wide and disparate series of skill sets, a gamut that ranges from literature review, to proposal, to grant applications, to ethics to data protection, to data collection to analysis. One then proceeds with writing, to creating abstracts and/or posters and/or presentations, to paper formatting and referencing software, to submission and peer review to perhaps a dissertation. These skills are typically acquired piecemeal and haphazardly. For this reason, a group of Maltese medical academics came together in 2010 to create an intensive, three-day course that would attempt to inform interested junior colleagues about these skill sets.
The Write a Scientific Paper course (WASP - http://www.ithams.com/wasp/) was first held in 2010 in Malta and was held once or twice a year (per perceived demand) at the Malta Life Sciences Park adjacent to Malta's regional hospital. Delegate feedback allowed the course to be refined and fine-tuned. WASP was also held at the Royal College of Paediatrics in London in January 2017 and at the University of Manana in Bahrain in April 2018. The WASP lectures are delivered by experienced academics and journal editors and the learning objectives for each talk are laid out in an online document (http://www.ithams.com/wasp/extras/upcoming/learningobjectives.pdf). Talks are given via PowerPoint presentations. A half-day is dedicated to practical, hands-on statistical analysis using bespoke sheets created for WASP, sheets that greatly extend Excel's native capabilities.
WASP was formally reviewed by peers from the European Board & College of Obstetrics and Gynaecology (EBCOG) and the Mediterranean Incontinence and Pelvic Floor Society (MIPS) in 2017 and after implementing the suggested changes, both bodies formally endorsed WASP, as did the Malta Medical Association (MAM) and several other Maltese medical bodies. WASP is accredited with 18 CME points. Certification is obtained via the Medical Association of Malta. WASP has also been approved by the Federation of the Royal Colleges of Physicians of the United Kingdom and by the Royal College of Paediatrics for 18 category one (external) CPD credits.
The COVID pandemic forced the course to go online (using Microsoft Teams) in 2020 with no other changes to the course content. An online course allows the facile inclusion of overseas faculty and delegates and the last course (21-23 Feb 2022) included ten delegates (40%) from Ghana via the HopeXchange program, with a greatly reduced registration fee. The transition from on-site to online provided an opportunity to ascertain whether attendees prefer online as opposed to in-person courses by analyzing course feedback pre- and post-pandemic.
| Material and Methods|| |
Google forms are used to collect anonymous feedback on a Likert scale for various aspects of each WASP course. The spreadsheets generated were compared for the period 2017 to 2022 for four courses on-site and five courses online as per [Table 1]. Four common aspects were compared between onsite vs. online courses, as follows:
|Table 1: Dates of WASP courses on-site and online, and response rates to feedback questionnaire|
Click here to view
- Rate lectures. These were rated individually and the scores for lectures were amalgamated.
- Rate handouts (Excel sheets, datasets, papers).
- Rate WASP overall.
- How likely are you to recommend this course?
Data was in ordinal format (Likert) and processed in Excel. Cronbach's alpha was used for each course to measure the questionnaires' internal consistency. The data were highly skewed overall toward high values, so the Mann-Whitney U test was used to compare on-site vs. online. The tests were applied in bespoke Excel sheets created for the WASP course.
| Results|| |
Response rates are shown in [Table 1]. The minimum response rate was >60% and the average response rate was >80%. Cronbach's Alpha values are displayed in [Table 2] and all results except for the last course are in the acceptable (>0.7) range.
The comparisons for onsite vs. online are shown in [Table 3]. High satisfaction scores were achieved in all four categories both on-site and online. There were no significant differences except in lectures, which scored well both on-site and online but fared slightly worse overall online than on-site.
|Table 3: Medians and means for four questions on-site and online and Mann-Whitney U test comparison|
Click here to view
| Discussion|| |
Multimedia theory has been extensively studied, most notably by the educational psychologist Richard E. Mayer. His Cognitive Theory of Multimedia Learning is based on the fact that there are two channels for data entry to the brain: auditory and visual, acceding to older Dual-Coding theory, which avers that visual and verbal information are both mentally used to represent information. Mayer maintains that deeper learning occurs when information is presented simultaneously as text and graphics, and is based on 12 principles [Table 4].
The application of Mayer's theory to PowerPoint results in effective presentation and it has been noted that the appropriate usage of Multimedia Learning Theory results in significant retention improvements when compared with presentations using more traditional methods, improvements which also applied to long-term transfer and retention.,, Indeed, a systematic review demonstrated that the most frequent advice given to presentation design was to keep slides simple, with little detail and text, the inclusion of phrases instead of sentences and utilizing simple tables and visuals with a paucity of animations.
However, the ongoing COVID pandemic has forced a move to online events and presentations. Migrating online does not necessarily lead to change/s in PowerPoint contents but certainly transforms presentation delivery. For example, audiences may change, with attendance of individuals who might not otherwise have been able to attend, requiring tailoring of presentation content and/or style. In addition, paralanguage is partly lost in online presentations. Paralangauage is the nonlexical component of communication during speech, such as intonation, pitch and speed of speaking, hesitation noises, gasps, sighs, throat clearing, gestures, and facial expressions such as smiles/frowns. Body language during presentations is also largely lost particularly with loss of eye contact. This is important as the 7-38-55% rule affirms that these percentages respectively account for the relative impact of words, tone of voice, and body language when speaking. All of these factors may potentially fluster speakers and undermine confidence and PowerPoint timings, crucial components for any presentations.
Modern technology fortunately allowed a swift transition to online meetings and presentations due to COVID but it must be borne in mind that substantial portions of potential audiences may have barriers to moving online in this way, and this includes poor network connections, data affordability, and hardware limitations. Indeed, it has been shown that students' responses depend on their proficiency in employing online tools and technical ability to access online events.
On the other hand, more connected individuals were faced with an excessive choice of meetings as webinars flourished and became major education avenues during the pandemic. While this paradigm shift was initially embraced, many became overwhelmed by the sheer number and frequency of events and it is hoped that as the pandemic recedes, webinars complement and not continue to totally replace traditional in-person meetings.
Our results appear to indicate that WASP is accepted online but the slightly lower lectures score may imply that this course might be better delivered in-person than online. However, our attendees were happy to recommend WASP and this accords with the finding by other studies that overall, student satisfaction with online education is common, a finding common to both genders. The low internal questionnaire Cronbach's consistency in the last course only is attributed to the inclusion of a large proportion of non-European attendees.
The message, for both online and in-person presentations, remains the same: avoid prolixity, complexity, and gaucheness - the key principles are simplicity, brevity, cogency, and clarity.
Financial support and sponsorship
Conflicts of interest
Victor Grech is the founder, coordinator and faculty of the Write a Scientific Paper Course (WASP).
Sarah Cuschieri is a member of faculty of the Write a Scientific Paper Course (WASP).
| References|| |
Grech V, Cuschieri S. Write a scientific paper (WASP) - A career-critical skill. Early Hum Dev 2018;117:96-7.
HopeXchange Medical Center. We Alleviate Suffering in Developing Countries. Kumasi, Ghana: HopeXchange Medical Center; 2022.
Wessa P. Cronbach alpha (v1.0.6) in Free Statistics Software (v1.2.1). Office for research Development and Education. 2021.
Gliem JA, Gliem RR. Calculating, Interpreting, And Reporting Cronbach's Alpha Reliability Coefficient For Likert-Type Scales. ScholarWorks. Midwest Research-to-Practice Conference in Adult, Continuing, and Community Education; 2003.
Mayer R. Multimedia Learning. New York: Cambridge University Press; 2001.
Paivio A. Mental imagery in associative learning and memory. Psychol Rev 1969;76:241-63.
Grech V. The application of the Mayer multimedia learning theory to medical PowerPoint slide show presentations. J Vis Commun Med 2018;41:36-41.
Issa N, Schuller M, Santacaterina S, Shapiro M, Wang E, Mayer RE, et al
. Applying multimedia design principles enhances learning in medical education. Med Educ 2011;45:818-26.
Issa N, Mayer RE, Schuller M, Wang E, Shapiro MB, DaRosa DA. Teaching for understanding in medical classrooms using multimedia design principles. Med Educ 2013;47:388-96.
Blome C, Sondermann H, Augustin M. Accepted standards on how to give a Medical Research Presentation: A systematic review of expert opinion papers. GMS J Med Educ 2017;34:Doc11.
Zhang N, Yang S, Jia P. Cultivating resilience during the COVID-19 pandemic: A socioecological perspective. Annu Rev Psychol 2022;73:575-98.
Abercrombie D. Paralanguage. Int J Lang Commun Disord 1968;3:55-9.
Mehrabian A. Silent Messages. Belmont, CA: Wadsworth; 1971.
Stuart AE. Engaging the audience: Developing presentation skills in science students. J Undergrad Neurosci Educ 2013;12:A4-10.
Abdul Aziz MM, Imtiaz M, Rasul CH. Comparison between online and traditional teaching-learning among non-clinical medical students. BIRDEM Med J 2021;12:45-50.
Butnaru GI, Niță V, Anichiti A, Brînză G. The effectiveness of online education during Covid 19 pandemic—A comparative analysis between the perceptions of academic students and high school students from Romania. Sustainability 2021;13:5311.
Ismail II, Abdelkarim A, Al-Hashel JY. Physicians' attitude towards webinars and online education amid COVID-19 pandemic: When less is more. PLoS One 2021;16:e0250241. doi: 10.1371/journal.pone. 0250241.
Alblihed MA, Aly SM, Albrakati A, Eldehn AF, Ali SAA, Al-Hazani T, et al
. The effectiveness of online education in basic medical sciences courses during the COVID-19 pandemic in Saudi Arabia: Cross-sectional study. Sustainability 2021;14:224.
He L, Yang N, Xu L, Ping F, Li W, Sun Q, et al
. Synchronous distance education vs traditional education for health science students: A systematic review and meta-analysis. Med Educ 2021;55:293-308.
[Table 1], [Table 2], [Table 3], [Table 4]