Loading [Contrib]/a11y/accessibility-menu.js
Jefferson GD, Boyd BJ, Jackson LL, Stringer SP. Flipped Classroom Experience in a Single Otolaryngology-Head & Neck Surgery Post-Graduate Residency Program. Intl J Surgical Education (IJSED). Published online January 31, 2023.
Download all (2)
  • Figure 1. Key Elements for a Successful Flipped Classroom
  • Figure 2. Flipped Classroom SWOT (Strengths, Weaknesses, Opportunities, Threats) Analysis



Post-graduate resident physician curriculum is traditionally delivered through didactic lectures and experientially through direct patient care. Didactic lectures reportedly garner low resident engagement. Flipped classroom may increase participation by utilizing prerecorded videos, reading assignments, or other electronic curricula in advance of class, reserving dedicated class time for collaborative learning and advancement of concepts. Theoretically, flipped classrooms improve content retention, and application and mastery of knowledge.


Based upon annual Program Evaluation Committee discussion, educational leadership sought to identify methods to reinvigorate resident didactic curriculum. We aim to share the experience of our Otolaryngology training program incorporating flipped classrooms in didactic teaching.


A tertiary level academic teaching hospital.


Cross-sectional study.


During academic year (AY) 2018-2019 faculty were provided rationale and structure for flipped classrooms. Residents were informed of flipped classroom integration and expectations. Assessment in AY 2020-2021 was through surveys focused on feasibility, resident and faculty perspectives, and lessons learned. Participants: 11 of 15 resident physicians and 5 of 7 participating faculty completed survey evaluation of the flipped classroom experience.


Resident (11/15) and faculty (5/7) survey responses indicated enjoyment of flipped classroom with appropriately chosen topics. Time demands were a concern for residents. Residents and faculty raised concern for mastery of resident assignments with possible decreased topic mastery for subject matter not formally assigned to a specific resident. Senior resident level of engagement remained unchanged.


Key to widespread use of flipped classroom for Otolaryngology curriculum delivery is collaboration amongst residency programs to develop flipped classroom standardized scenarios. Specific topic scenarios using uniform key elements will permit evaluation of flipped classroom pedagogy benefit. Flipped classroom is feasible, enjoyable, and meaningful to participants of our Otolaryngology-Head & Neck Surgery residency program.


Post-graduate resident physician curriculum is typically delivered as a combination of didactic lectures and experiential, direct patient care activities. However, this pedagogy has led to questioning resident engagement as well as knowledge acquisition and retention.1 This is particularly true regarding current generations of residents who prefer short blocks of learning material, or microlearning, and online digital resources for presentation of information.2,3

A flipped classroom may increase resident engagement since its pedagogy requires preclass assignments to successfully engage during in-class activity. Dedicated class time is reserved for problem-based, collaborative learning and advancement of concepts.4 The flipped classroom pedagogy theoretically improves content retention and a higher level of learning. Residents may better apply information, experience greater analytic skill to identify appropriate use of information, augmented ability to evaluate their knowledge application, and perhaps even demonstrate mastery by developing or researching methods for systems improvement.5,6

There are reports of flipped classroom benefits in several healthcare professional programs including medical school.7–9 Only a handful of reports in graduate medical education exist, and even fewer publications discussing application of flipped classroom in Otolaryngology-Head & Neck Surgery (ORL) post-graduate resident education.

Our aim is to share the experience through survey responses of a single ORL training program incorporating the flipped classroom method. We also discuss feasibility, resident and faculty perspectives, and lessons learned. We hypothesize that inclusion of flipped classroom pedagogy into didactic curriculum engages resident physician trainees and repurposes some faculty lectures.


Annual Program Evaluation. Residency programs annually conduct internal review by the Program Evaluation Committee (PEC) per the Accreditation Council for Graduate Medical Education (ACGME), the residency program accrediting agency that ensures professional education standards are met for physician trainees to deliver high-quality, safe medical care upon graduation. In 2018 our residents of the University of Mississippi Otolaryngology-Head &Neck Surgery program commented on the annual internal survey that they wished faculty lectures underwent improvement with addition of new material, removal of outdated items and complete overhaul of certain presentations. This critique precipitated PEC and department educational leadership to develop a program action plan of implementing flipped classroom method for some rhinologic and head and neck surgery topics in academic year (AY) 2018-2019.

The junior and senior level residents that participate in the PEC annual program review agreed that integration of formal flipped classroom format for some topics could improve various didactic presentations perceived as needing an update. Additionally, they felt flipped classrooms may engage resident learners through non-traditional, interesting encounters of new material for juniors, or review of the curriculum for seniors. Action plan areas for improvement is a requirement by the ACGME, and implementation of an action plan involves faculty and resident assessment. Therefore, our implementation of our flipped classroom action plan falls into the University of Mississippi IRB class of exemption.

Faculty Introduction to Flipped Classroom. In AY 2019-2020, flipped classroom theory, rationale for use, key elements, and literature review were shared with all faculty. Our program goal for faculty was to collectively incorporate flipped classroom method into 30% of curriculum in AY 2019-2020 where at least 1 topic from each subspecialty was delivered this way. Flipped classroom involves exposing the learner to new subject matter prior to formal inclass instruction. The application and higher level of subject matter processing occurs during inclassroom activity. Key elements to delivering a flipped classroom include: a) warm-up activity,

b) an incentive to complete the pre-classroom warm-up, c) mechanism to assess knowledge at the conclusion of warm-up, and d) in-class activity to focus on higher level cognitive activities (see Figure 1).10 These key elements and specific tools to aid in creating a successful flipped classroom such as Nearpodâ and PowerPointâ voiceover, were shared with faculty. Our department Education Coordinator availed herself to any faculty member requesting assistance with technology for their specific flipped classroom.

Assessment. At the conclusion of AY 2020-2021 residents and faculty were surveyed [Appendix A1] regarding their experience with flipped classroom methodology and to assess benefits of incorporating this approach to curriculum delivery. The surveys administered were internally developed and specific to our residency program with no collection of validity evidence.


Both resident learners and faculty members were surveyed via Microsoft Formsâ. Residents were queried on topics to assess their experience with flipped classroom, to consider preparation time, and appropriateness of topics covered utilizing flipped classroom to convey subject matter. Eleven of 15 residents responded. All post-graduate year 4 and 5 trainees responded while only 1 of 3 post-graduate year 3 trainees completed the survey. Overall, postgraduate trainees in years 1-4 had a positive experience with flipped classroom scoring better than neutral regarding “enjoy participation”, “overall positive experience”, “appropriateness for certain topics”, “increase knowledge application”, and “increase knowledge retention.” Twothirds of senior level residents in their 4th and 5th years of post-graduate training believed that the flipped classroom format required too much preparation time, as did 50% of interns that participated. No resident felt that subject matter covered by flipped classroom method was inappropriate. Some comments reflecting consideration of appropriateness of flipped classroom and overall utility are found in Table 1.

Table 1.Otolaryngology Training Program Resident and Faculty Participant Comments on Flipped Classroom
Resident Comments Faculty Comments
“I enjoy a flipped classroom occasionally, but don’t think it should be utilized for every lecture. It is most useful when coupled with a faculty presentation of some sort to ensure we are covering all relevant material” “I think that the resident that is presenting a specific subset of information probably learns it better than they would from a standard didactic lecture, but for the other subsets that they are not responsible for, not so much”
“I think flipped classroom can be good sometimes, but I don’t think it should be the primary way of teaching for our lectures” “I enjoy the challenge of presenting material in a non-traditional format and to see all the individual resident topics come together to create an entire lesson”
“I think a lot of times when we do flipped classrooms I end up learning more about my specific question or topic but don’t get as much out of the other topics that all the other residents are assigned”
“With regards to time in preparation, it depends on the amount of time given by the presenter…I feel maybe if we have a week that would be a reasonable amount of time to expect us to be able to gather the information”

In AYs 2018-2020, there were 12 core Otolaryngology faculty. Faculty survey responses were provided by 5 of the 7 faculty who conducted flipped classroom. The residency program director and associate residency program director were excluded to minimize bias since they created the flipped classroom educational programming. Faculty disciplines who submitted survey responses included General Otolaryngology, Rhinology & Skull Base Surgery, Neurotology, and Plastic & Reconstructive Surgery. Excluded from survey participation, the residency program and associate program directors’ disciplines were both Head & Neck Surgical Oncology. Forty percent of faculty survey respondents believed development of flipped classroom for curriculum delivery demanded more time than typical PowerPointâ presentation.

Most faculty respondents (80%) either agreed, or strongly agreed with enjoying the flipped classroom experience. All faculty respondents understood the key components and rationale for producing a flipped classroom. One faculty member did not believe the flipped classroom experience was positive and 80% responded that the flipped classroom pedagogy should have a regular role in resident curriculum delivery. Faculty comments describing flipped classroom experience are found in Table 1.


Resident and faculty survey responses demonstrate that utilization of flipped classroom effectively delivered chosen didactic curricula and was feasible for our ORL training program. Overall, both resident physician trainees and faculty enjoyed flipped classroom delivery of subject matter chosen. Faculty understood the rationale and structure for creating a flipped classroom. Resident trainees understood their assignments, demonstrated responsibility in completing the assignment prior to the planned classroom activity, and understood the need for completion of pre-classroom work to fully participate and benefit in the assembled class learning event. Neither residents nor faculty felt too much extra time was involved in participating or preparing a flipped classroom event overall.

A concern raised by both a resident and faculty member was that the individual assignment for learners favors mastery of that specific assigned topic leaving the resident at a potential deficit with respect to the remainder of the lesson. Indeed, a threat to resident completion of pre-classroom warm up is time [see Figure 2]. Even with provision of the pre-class assignment 1-2 weeks in advance, residents must also balance on-call obligations, preparing for daily surgical cases, and remaining current with all other educational curricula. However, most Otolaryngology residents are likely compelled to not only prepare their assigned topic, but also to review other material outlined in the curriculum schedule for both traditional lectures and alternative classroom formats. In fact, the lead author’s experience with flipped classroom was that, on one occasion, a mid-level resident apologized to the residents during the in-class activity for not remembering to share his assignment. Following class, the resident immediately emailed the faculty member and residents his assignment to complete the comprehensive slide deck that resulted from the in-class activity for residents to review later if desired.

Figure 2
Figure 2.Flipped Classroom SWOT (Strengths, Weaknesses, Opportunities, Threats) Analysis

One opportunity of the flipped classroom model is the customizable nature of successful flipped classroom events [see Figure 2]. Customization allows the faculty members to create learning experiences specific to a topic. For instance, a topic focused on a surgical procedure may utilize an in-class simulation; whereas, a topic focused on clinical trial studies that impact head and neck cancer treatment may utilize in-class case-studies. Customization allows development of in-class activities that can optimize learner application and higher levels of learning. Opportunity lies in ability to test the theory that flipped classroom pedagogy increases knowledge acquisition and retention. Current methods of assessing resident physician trainee knowledge is largely based on standardized testing. The ability to test the theorized benefit of increased knowledge gain, retention, and application of knowledge is not suited for standardized testing. Rather, observation of resident application of knowledge is assessed in the operating room or in the management of patient consultations for example. The optimal next step is collaboration amongst residency programs to develop standardized flipped classroom scenarios for specific topics designed and implemented using the same key elements to better test the theory of higher learning benefit via flipped classroom pedagogy.

Another opportunity to enhance senior level resident experience is to lead in-class activities with the faculty member providing in-person support. Serving as the leader could increase senior resident demonstration of higher level of learning and engagement. On the other hand, senior level residents may feel they mastered the topics covered in the flipped classroom scenarios provided.

We recognize several resident educational benefits provided by flipped classroom [see Figure 2]. Active learning assignments, which are necessary pre-class to achieve a successful inclass experience, foster the requisite lifelong self-directed learning of physicians. Millennial generation trainees and after prefer accessibility of learning materials through online applications, available on-the-go. Residents can reference previously utilized course material for studying and reinforcement of knowledge, preparing for a difficult case, reviewing relevant material for specific surgical rotations. The flipped classroom model lends itself to the preferable learning pattern of today’s students, structured by interactive learning experiences delivered in shorter segments utilizing media such as videos and other technology-driven interactive formats.9 In-class engagement activities may also aid in developing a more reserved resident’s selfconfidence and ability to educate others – peers, students, consulting healthcare providers, patients and families.1,7

A primary threat to achieving successful flipped classroom learning experiences for Otolaryngology residents is their time. Time is also a potential threat to faculty preparing these educational events. The faculty member requires some creativity to envision an effective inclassroom event. The in-class event development dictates the pre-class learning materials and activities provided in advance. Effective flipped classrooms also require high-quality information technology. With assistance from our program’s education coordinator, we were able to navigate the use of Nearpodâ, create voice-over PowerPointâ that were prior presentations and deconstructed into smaller subtopics, and incorporate the American Academy of Otolaryngology’s appropriate FLEX (FLEX—Focused Lifelong Education Xperience) curriculum of surgical videos, webinars, online simulation and gaming modules, for example.

Our Otolaryngology trainee educational curriculum is delivered over a 2-year cycle. This construct permits faculty members to deliver a specific subject to each trainee twice during the residents’ tenure. We believe delivery of appropriately chosen topics can occur in the traditional format and in an alternative pedagogical form. Residents thereby encounter a variety of teaching methods that may further reinforce the subject matter, particularly since knowledge is acquired differently amongst individual learners and is further informed throughout training by experiential encounters.

One limitation of this study is that it represents the experience of a single residency program. This prevents generalizability to other training programs both within Otolaryngology and other disciplines. Customization of each flipped classroom event is attractive to make content delivery interesting and capture the audience. Customization minimizes comparison of scenarios to determine best practices. The authors believe that through collaboration with other training programs utilizing standardized flipped classroom content will allow evaluation of these limitations.


Flipped classroom is feasible, enjoyable and meaningful to participants of a single Otolaryngology-Head & Neck Surgery residency program. All subject matter necessary for resident trainees to become independent practitioners may not be amenable to a successful flipped classroom.

Author contributions

  • Conception and design of study: GDJ, SPS
  • Acquisition of data: GDJ, BJB
  • Analysis and/or interpretation of data: GDJ, BJB, LLJ, SPS
  • Drafting the manuscript: GDJ, SPS
  • Revising the manuscript critically for important intellectual content: GDJ, BJB, LLJ, SPS
  • Approval of the version of the manuscript to be submitted: GDJ, BJB, LLJ, SPS

Financial disclosures

The authors have no financial disclosures.

Accepted: January 14, 2023 EDT


Moskowitz HS, Hsueh WD. Integrative Resident Education Curriculum to Adapt to the Modern Otolaryngology Trainee. Laryngoscope. 2020;130(3):615-621. doi:10.1002/lary.28069
Google Scholar
Magnacca M. A Guide to Millennial Learning. Published January 4, 2018. Accessed January 5, 2022. https://trainingmag.com/guide-millennial-learning/
Meyer S. Study: How Millennials Learn Best. Published February 23, 2017. Accessed January 5, 2022. https://rapidlearninginstitute.com/blog/study-millennials-learn-best/
Bates JE, Almekdash H, Gilchrest-Dunnam MJ. The Flipped College Classroom: Conceptualized and Re-Conceptualized. (Green LS, Banas JR, Perkins RA, eds.). Springer International Publishing; 2017.
Google Scholar
Riddell J, Jhun P, Fung CC, et al. Does the Flipped Classroom Improve Learning in Graduate Medical Education? J Grad Med Educ. 2017;9(4):491-496. doi:10.4300/jgme-d-16-00817.1
Google ScholarPubMed CentralPubMed
Graham KL, Cohen A, Reynolds EE, Huang GC. Effect of a Flipped Classroom on Knowledge Acquisition and Retention in an Internal Medicine Residency Program. J Grad Med Educ. 2019;11(1):92-97. doi:10.4300/jgme-d-18-00536.1
Google ScholarPubMed CentralPubMed
Rotellar C, Cain J. Review: Research, Perspectives, and Recommendations on Implementing the Flipped Classroom. Am J Pharm Edu. 2016;80(2):Article 34. doi:10.5688/ajpe80234
Google ScholarPubMed CentralPubMed
Dombrowski T, Wrobel C, Dazert S, Volkenstein S. Flipped classroom frameworks improve efficacy in undergraduate practical courses – a quasi-randomized pilot study in otorhinolaryngology. BMC Med Educ. 2018;18(1):294-301. doi:10.1186/s12909-018-1398-5
Google ScholarPubMed CentralPubMed
Buja LM. Medical education today: all that glitters is not gold. BMC Med Educ. 2019;19(1):110-121. doi:10.1186/s12909-019-1535-9
Google ScholarPubMed CentralPubMed
Brame C. Flipping the Classroom. Published 2013. Accessed January 5, 2022. http://cft.vanderbilt.edu/guides-sub-pages/flipping-the-classroom/

Appendix A1

Resident Flipped Classroom Assessment

  1. I enjoy participation in flipped classroom event(s).

    a. Strongly disagree b) Disagree c) Neutral d) Agree e) Strongly Agree

  2. My experience with flipped classroom is overall positive.

    a. Strongly disagree b) Disagree c) Neutral d) Agree e) Strongly Agree

  3. I believe that flipped classroom approach to education is appropriate for certain topics.

    a. Strongly disagree b) Disagree c) Neutral d) Agree e) Strongly Agree

  4. I feel I have experienced an increase in knowledge application by participating in a flipped classroom on the topic.

    a. Strongly disagree b) Disagree c) Neutral d) Agree e) Strongly Agree

  5. I feel I have experienced an increase in knowledge retention by participating in a flipped classroom on the topic.

    a. Strongly disagree b) Disagree c) Neutral d) Agree e) Strongly Agree

  6. Can you recall any particular topic delivered by flipped classroom you thought inappropriate for this method? a) Yes b) No

  7. If yes, which topic and why?

  8. Do you feel use of flipped classroom method requires too much of your time in preparation?

    a. Yes b) No

  9. Please indicate your post-graduate year of training.

    a. PGY-1 b) PGY-2 c) PGY-3 d) PGY-4 e) PGY-5 10. Please provide any additional comments you may have regarding flipped classroom.

Faculty Flipped Classroom Assessment

  1. Creation of a flipped classroom learning event demanded more of my time than creation of traditional PowerPoint presentation.

    a. Strongly disagree b) Disagree c) Neutral d) Agree e) Strongly Agree

  2. I enjoyed the delivery of my flipped classroom event(s).

    a. Strongly disagree b) Disagree c) Neutral d) Agree e) Strongly Agree

  3. I understand the structure and rationale for producing a flipped classroom event.

    a. Strongly disagree b) Disagree c) Neutral d) Agree e) Strongly Agree

  4. I feel I have enough tools to develop a successful flipped classroom event.

    a. Strongly disagree b) Disagree c) Neutral d) Agree e) Strongly Agree

  5. My experience with flipped classroom is positive.

    a. Strongly disagree b) Disagree c) Neutral d) Agree e) Strongly Agree

  6. The flipped classroom pedagogy deserves some regular utilization in our didactic curriculum.

    a. Strongly disagree b) Disagree c) Neutral d) Agree e) Strongly Agree

  7. Please provide any additional comments you may have regarding flipped classroom.