ORIGINAL ARTICLE
Protected Block Curriculum Enhances Learning During General Surgery Residency Training Travis P. Webb, MD; John A. Weigelt, MD; Philip N. Redlich, MD; Rebecca C. Anderson, PhD; Karen J. Brasel, MD, MPH; Deborah Simpson, PhD
Background: Changes in medical education require a rethinking of our training paradigm. We implemented a protected block curriculum for postgraduate year (PGY)–1 and PGY-2 surgery residents.
tion scores of control and curriculum residents were compared. Surgical and communication skills were assessed using checklist assessment forms. Curriculum residents evaluated the content and delivery.
Hypothesis: A protected block curriculum promotes
Results: Pretest and posttest results demonstrated ac-
adult learning consistent with the 6 competencies. Design: Prospective static-group comparison with pretesting and posttesting. Setting: Medical College of Wisconsin, Milwaukee. Participants: Eight university-based surgical residents (curriculum group) and 8 residents who did not participate in the curriculum (control group). Main Outcome Measures: The curriculum occurs during protected time away from clinical activity. Predefined learning objectives and competencies were identified for PGY-1 and PGY-2 residents. Multiple choice examinations were administered to assess knowledge. The first 3 tests of the year in the PGY-2 curriculum were also given to the PGY-3 and PGY-4 and -5 residents for comparison with curriculum residents. In-training examina-
S
Author Affiliations: Medical College of Wisconsin, Milwaukee.
quisition of knowledge with improved aggregated mean scores from 57.5% to 71.4% for PGY-1 residents and 58.6% to 72.6% for PGY-2 residents. The average curriculum test results were 76.7% for curriculum residents, 56.9% for control residents, and 57.3% for all residents. The 2-year average in-training scores were 71.2% for curriculum and 60.3% for control residents. Assessments demonstrated improvements in communication and surgical skills. Conclusions: A protected block curriculum enhanced
surgical residents’ learning compared with a traditional model. Improvement in medical knowledge was easiest to measure, but performance in other Accreditation Council for Graduate Medical Education competency areas also demonstrated improvement. Arch Surg. 2009;144(2):160-166
URGICAL RESIDENCY TRAINING
programs face many challenges in producing competent surgeons. The Accreditation Council for Graduate Medical Education (ACGME) requires residents to receive training in 6 competencies, and programs must document the achievement of those competencies with great precision.1 As these new training guidelines were introduced, new dutyhour restrictions were mandated limiting residents’ time on service and in educational activities.2 Numerous articles detail how training programs are dealing with the duty-hour restrictions.3-9 Fewer articles discuss efforts to meet educational expectations in this changing environment.10-12 Although the struggle to meet the workhour restrictions and accreditation mandates
(REPRINTED) ARCH SURG/ VOL 144 (NO. 2), FEB 2009 160
can be all-consuming, these changes were intended to ensure both quality patient care and competent trainees. Our goal was to design a training curriculum that maximized residents’ educational experience consistent with competency-based education within the confines of duty-hour limitations.13-15 In 2002, our residency training program started a major curriculum change, developing a protected block curriculum (PBC).15 This curriculum model started with a needs assessment to identify learning objectives, guidance from the Office of Educational Services at the Medical College of Wisconsin, and development of the curriculum around adult learning principles. We established the curriculum using the following assumptions: (1) residents are adult learners;(2) clinical care op-
WWW.ARCHSURG.COM
Downloaded from www.archsurg.com at Medical College of Wisconsin, on February 16, 2009 ©2009 American Medical Association. All rights reserved.
erations can function without residents’ constant presence; (3) specific competency-based objectives for each training year could be identified; (4) learning was best achieved by training-year cohorts; (5) graduated introduction of clinical knowledge and skills could be achieved in a nonclinical situation; and (6) ongoing evaluation of the program and trainees would be used to guide program revision. Our first class completed 2.5 years of the curriculum. This study highlights key features of the longitudinal curriculum and educational outcomes from the first 2 years, which we believe are linked to our PBC. This study was classified as exempt by the Medical College of Wisconsin institutional review board. METHODS
LEARNERS The postgraduate year (PGY)–1 and PGY-2 curriculum group (n = 8) includes 2 nongeneral surgery residents. Their educational outcomes were compared with 8 residents (6 general surgery and 2 nongeneral surgery) in their PGY-3 year who served as the noncurricular or control group. The United States Medical Licensing Examination scores of both groups showed no significant difference between curriculum and noncurriculum residents.
CURRICULUM DESCRIPTION A hallmark of our curricular design is protected time away from clinical responsibilities. Each curriculum week is preceded by a free weekend for resident preparation. For the period described, the PGY-1 week was 5.5 days and the PGY-2 curriculum 4.5 days, including the preceding weekend. During these blocks of time, they take no calls, do not report to their service, and are not allowed vacation, thus assuring 100% attendance and participation. In the first year of implementation, PGY-1 residents participated in six 1-week curriculum blocks. The curriculum topics were based on educational objectives developed through the needs assessments and curriculum materials from the Association of Program Directors in Surgery and the American College of Surgeons Committee on Education.16,17 Instruction during these blocks used adult-learning methods including out of class assignments, interactive lectures, case-based discussions and presentations, problem-based learning sessions, skills laboratories, cadaver laboratories, and simulator laboratories. A sample of a PGY-1 curriculum block day is provided (Table 1). Curriculum topics for PGY-2 were again developed based on local needs assessment data. These topics were informed by available educational materials from textbooks, professional publications, and current literature. The structure and instructional formats for the PGY-2 curriculum were consistent with principles of adult learning and modified by feedback and evaluation data from year 1. For example, faculty and residents recommended that protected PGY-2 curriculum time be reduced and that lectures be eliminated in favor of more participatory learning. Each curriculum block was structured to address a specific organ system(s) and disease state(s). Topics covered included breast disease, trauma, critical care, diverticular disease, colorectal cancer, and vascular disease. Table 2 provides an example of a PGY-2 curriculum day. Surgical skill laboratories were integral to the curriculum and represented a continuum of learning. An example of the progression of sur-
gical skills covered during the PGY-1 and PGY-2 years is provided in Table 3. All curriculum sessions and topics, along with associated learner assessment tools, were explicitly linked to the 6 ACGME core competencies.1 Evaluations were designed to assess resident performance and curriculum design.
CURRICULUM EVALUATION Multiple assessment tools aligned with the instructional objectives and methods were used to evaluate the curriculum. Resident performance was assessed using multiple-choice question examinations, American Board of Surgery In-training Examination (ABSITE) performance, Objective Structured Assessment of Technical Skill (OSATS), performance checklists, and portfolio entries. Residents evaluated the teaching faculty and curriculum structure using structured curriculum evaluation forms. Statistical analysis was performed on the results of the multiple-choice question examinations, the ABSITE examinations, and the OSATS. Independent t tests were used to determine significance using SPSS for Windows Version 15.0 (SPSS Inc, Chicago, Illinois).
MULTIPLE-CHOICE QUESTIONS Multiple-choice question examinations were developed and reviewed by experienced faculty based on identified learning objectives. These were administered to the residents prior to and after each curriculum block to provide formative assessment of knowledge gained. Multiple-choice examinations were analyzed for item difficulty, discrimination, and overall test reliability. Pretests and posttests for the PGY-1 and PGY-2 resident years were compared by pooling the mean pretest and posttest results for each curricular block by year. In addition, an examination covering the material from the first 3 weeks of the PGY-2 curriculum was given to the entire residency (PGY-1 to -5). Results of this examination were compared between the PGY-2 (n=8) curriculum residents and the PGY-3 (n=8) noncurriculum residents as controls as well as the entire group of noncurriculum residents (PGY-1 to -5; n=32). Competencies assessed by multiple-choice question examinations included medical knowledge, patient care, professionalism, and systemsbased practice.
AMERICAN BOARD OF SURGERY IN-TRAINING EXAMINATION Results of the first 2 years of ABSITE scores of the PGY-2 general surgery residents (n=6) were compared with those of the PGY-3 noncurriculum general surgery residents (n=6). Comparing the ABSITE scores over the same training period between these 2 groups was an attempt to identify medical knowledge gains using a standardized national examination.
OBJECTIVE STRUCTURED ASSESSMENT OF TECHNICAL SKILL Objective surgical skills assessment was performed for surgical skills at the PGY-1 and PGY-2 levels. These skills were selected based on learning objectives identified by our needs assessment and curriculum committee. Basic skills, including tying knots and performing simple interrupted, running, and mattress sutures were videotaped and assessed in an OSATS manner using an item analysis and global assessment form during the PGY-1 and -2 years. Competency in performing a bowel anastomosis using pig colon and a vascular anastomosis using a polytetrafluroethylene graft was assessed by trained faculty
(REPRINTED) ARCH SURG/ VOL 144 (NO. 2), FEB 2009 161
WWW.ARCHSURG.COM
Downloaded from www.archsurg.com at Medical College of Wisconsin, on February 16, 2009 ©2009 American Medical Association. All rights reserved.
Table 1. Sample of a PGY-1 Curriculum Block Schedule Time 7:00 AM-7:45 AM 7:45 AM-8:45 AM
8:45 AM-9:00 AM 9:00 AM-10:00 AM
10:00 AM-11:00 AM
11:00 AM-12:00 PM
12:00 PM-1:00 PM 1:00 PM-1:30 PM 1:30 PM-4:00 PM
Topic (Category) Orientation & pretest (medical knowledge) Basic science review session #1: wound healing (medical knowledge) Break Inguinal anatomy/hernia CD; respond to comments from curriculum week 1 (medical knowledge) Time management (systems-based practice) Glucose control in the surgical patient; required reading handout: endocrine problems, intensive insulin therapy in the medical ICU (patient care, medical knowledge) Lunch Introduction to cadaver groin dissection Group 1. Skills laboratory 1: groin dissection and placement of mesh; required reading: Greenfield text, pages 1178-1200 (patient care, medical knowledge)
1:30 PM-2:30 PM
Group 2. OR practical aspects; required reading, handouts: electrosurgery by Slakey preparation of the OR (systems-based practice)
2:30 PM-4:30 PM
Group 2. Skills laboratory 2: knot tying (patient care)
2:30 PM-4:30 PM
Group 2. Simulated nurse calls (patient care, professionalism, communication)
4:30 PM-5:30 PM
Anticoagulation: prophylaxis and treatment; required reading: Greenfield text pages 1781-1786; handout: chest, cardiopulmonary and critical care (patient care, medical knowledge) Announcements and review Laparoscopic skills sessions (patient care)
5:30 PM 5:30 PM-6:30 PM
Goals/Objectives Review schedule for the week including assignments. Complete pretest. Lead a discussion of each basic science question assigned, 4 questions per intern, facilitated by faculty. Answer each assigned question in a thorough and comprehensive manner. Identify why each potential answer is correct or incorrect. Review inguinal anatomy related to hernia repair. Describe the important anatomic aspects of the inguinal region related to both an anterior and posterior approaches to hernia repair. Understand that time management is an acquired skill. Identify tasks that can waste time. Learn methods to improve time management. Identify the goal of glucose control in the perioperative period with respect to the level of blood glucose and the “tightness” of control with insulin. Describe the methods of administration of insulin, eg, intermittent intravenous, continuous drip, subcutaneous, and the patients in whom each method would be preferred. Identify the consequences, short and long term, of poorly managed blood glucose on patient outcomes. Identify the patient populations that most benefit from tight blood glucose control. Review groin anatomy. Review plan and expectations for the groin skills dissection laboratory. Demonstrate proper handling of all instruments used in the conduct of a hernia repair. Identify structures as they are encountered in the course of the operation including fascial layers, nerves, contents of spermatic cord, and ligamentous structures. Perform a satisfactory tension-free mesh hernia repair. State the expected complications of a herniorrhaphy including recurrence rate and the most likely areas for recurrence based on the type of repair performed. Homework: watch CineMed Case, Lichtenstein open tension-free hernioplasty, 19 min, 1997 (CineMed Case 1869). Describe the typical OR setup. Describe roles of OR personnel including circulator, scrub, and anesthesia technician. Describe electrocautery in the OR: monopolar, bipolar, modes, cutting/cautery. State 4 common positions for a patient on the operating room table and describe the position of the arms and legs for each one, with particular attention to arm and leg padding. Describe the additional positioning needs of the obese patient. Practice knot tying in the following situations: flat surface, cylinder. Practice 2-handed, 1-handed, and instrument tying. Practice with free ties and reels. Answer the nurse’s page in a timely manner. Address all of the concerns of the nurses in an appropriate professional manner. Prioritize the management issues and respond in an organized manner. Communicate in a clear straightforward manner. Additional instruction: you will be paged about a patient scenario that requires your response. The situation is that you are busy and cannot come to see the patient right away, so must work with the nurse to solve and prioritize the patient’s management. Your response will be documented for future analysis. Identify the risk factors for PE and DVT. Describe appropriate guidelines for DVT treatment and prophylaxis. State the most common presenting signs and symptoms of pulmonary embolus. Describe treatment appropriate guidelines for PE treatment.
Practice laparoscopic skills and complete exercises under direct faculty supervision, with time limited to 20 min each.
Abbreviations: DVT, deep vein thrombosis; ICU, intensive care unit; OR, operating room; PE, pulmonary embolism; PGY, postgraduate year.
using a similarly structured form based on a previously validated assessment form.18,19 Results of the basic suture skills evaluations from the PGY-1 year were compared with PGY-2 results and PGY-3 resident results using independent t tests. The
overall competence of the PGY-2 class performing colonic and vascular anastomoses was analyzed based on criterion achievement as the percentage of residents who were competent after each skills session.
(REPRINTED) ARCH SURG/ VOL 144 (NO. 2), FEB 2009 162
WWW.ARCHSURG.COM
Downloaded from www.archsurg.com at Medical College of Wisconsin, on February 16, 2009 ©2009 American Medical Association. All rights reserved.
Table 2. Sample of PGY-2 Curriculum Block Daily Schedule Time
Topic (Category)
7:00 AM-8:00 AM
Pretest/basic science curriculum (medical knowledge) PBL session: shock in the SICU 8:00 AM-9:30 AM (patient care, medical knowledge, PBL&I) Break 9:30 AM-9:45 AM 9:45 AM-11:00 AM Thromboembolic disease (patient care, medical knowledge) 11:00 AM-12:00 PM Postoperative treatment of the cardiac patient (patient care, medical knowledge) 12:00 AM-12:45 PM Lunch 12:45 AM-1:45 PM End of life/withdrawal of care (professionalism, patient care, communication and interpersonal skills, systems-based) Geriatrics critical care case 1:45 AM-2:45 PM study (medical knowledge, patient care, system-based) Break 2:45 AM-3:00 PM Trauma man practicum 3:00 AM-5:00 PM (medical knowledge, patient care) 5:00 AM- 5:15 PM 5:15 AM-6:30 PM
Debrief PBL groups reconvene; (PBL&I)
Goals/Objectives The assigned resident will lead a discussion of each ABSITE-type question with facilitation by faculty. Answer each assigned question in a thorough and comprehensive manner. Identify why each potential answer is correct or incorrect. Review assessment and management options of shock. List characteristics of common pressor agents. Describe expected outcomes. List indications and contraindications for DVT prophylaxis in the critically ill patient. List criteria that place general surgical patients at high risk for DVT and PE. Define a method for evaluating a patient with a suspected PE. Discuss the postoperative treatment of a cardiac patient. Describe clinical pathways for postoperative treatment of a CABG patient.
List 5 physician and 5 patient/family barriers to the appropriate/timely withdrawal of life-sustaining treatments. List a 10-step approach to running a family meeting to discuss treatment withdrawal. Describe how to withdraw mechanical ventilation support in a manner that preserves patient dignity. Review geriatric trauma and ICU case with emphasis on complication reduction. Describe pain management and polypharmacy complications in geriatric population. Describe outcomes and ethical decision making in the elderly population. Perform cricothyroidotomy. Perform chest tube placement. Perform diagnostic peritoneal lavage. Perform orotracheal intubation. Provide feedback regarding the content and delivery of today’s sessions. Research topics and answer questions derived from shock PBL session.
Abbreviations: ABSITE, American Board of Surgery In-training Examination; CABG, coronary artery bypass graft; DVT, deep vein thrombosis; PBL&I, practice-based learning and improvement; PE, pulmonary embolism; PGY, post-graduate year; (S)ICU, (surgical) intensive care unit.
PRESENTATION AND COMMUNICATION SKILLS OBSERVATION CHECKLIST Communication skills and professionalism were emphasized across the curriculum with selected sessions. For example, the PGY-1 residents were given instruction in presentation skills and then videotaped giving a 10-minute presentation on a medical topic. Communication, presentation skills, and professionalism were directly assessed using a checklist competency form completed by 2 trained faculty observers (T.W. and P.R.). The videotapes were reviewed and evaluated by a single faculty evaluator (T.W.), and feedback was provided to each resident while reviewing highlights of the presentations. A similar presentation videotape debriefing exercise was repeated during the PGY-2 curriculum. Performance on the videotaped presentation as a PGY-2 resident was compared with their PGY-1 performance. These results were analyzed as the percentage who achieved successful completion of goals and using qualitative analysis of comments from the assessment forms.
assessed using the SLIP include medical knowledge, practice-based learning, systems-based practice, communication skills, and professionalism. Data analysis was limited to completion of the SLIP.
LONGITUDINAL AND SESSION EVALUATION FORMS Curriculum design and content was evaluated using several methods and data sources. Likert scale evaluation forms were distributed to the residents after each session and at the end of the curriculum blocks. The scaled ratings were analyzed to yield a mean distribution of positive vs negative scores and qualitative analysis to itemize themes and frequency within the comments. Overall quantitative results across sessions by year are reported with detailed qualitative analysis of narrative comments. RESULTS
SURGICAL LEARNING AND INSTRUCTIONAL PORTFOLIO
MULTIPLE-CHOICE QUESTIONS
The Surgical Learning and Instructional Portfolio (SLIP) is a learning portfolio that is used to improve the depth of knowledge of residents as they examine a case and describe specific learning points associated with their management of the case.20 Residents are to complete their SLIP entry prior to participation in the curriculum block. Competencies
Pretest and posttest results showed acquisition of knowledge with statistically significant improvement in mean (SD) pooled test scores from 57.5% (3.9%) to 71.4% (3.0%) (P⬍.001) for the PGY-1 residents and 58.6% (6.2%) to 72.6% (6.2%) for PGY-2 residents (P⬍.001), and are presented in Table 4. Mean (SD) curriculum test results were
(REPRINTED) ARCH SURG/ VOL 144 (NO. 2), FEB 2009 163
WWW.ARCHSURG.COM
Downloaded from www.archsurg.com at Medical College of Wisconsin, on February 16, 2009 ©2009 American Medical Association. All rights reserved.
Table 3. Surgical Skills Progression Week 1
2
3
4
5
6
PGY-1
Table 4. Results of Multiple-Choice Questions, Pretests and Posttests PGY-2
Knot-tying; suture skills
Introduction to laparoscopy; advanced knot tying; suture skills Suture skills; bowel anastomosis; CVL insertion Bowel anastomosis (latex simulator); laparoscopy skills; introduction to endoscopy EGD; bowel anastomosis (latex simulator) Colonoscopy; bowel anastomosis (pig colon)
Chest tube and CVL insertion; intubation skills; ultrasound for vascular access Vascular anastomosis; amputations (TMA, BKA, AKA) Bowel anastomosis; introduction to ultrasound simulator; EGD and colonoscopy Breast lumpectomy; mastectomy; axillary dissection; ultrasound for breast disease Bowel anastomosis
Bowel anastomosis; vascular anastomosis; FAST examination
Abbreviations: AKA, above-knee amputation; BKA, below-knee amputation; CVL, central venous line; EGD, esophagogastroduodenoscopy; FAST, focused assessment by sonography in trauma; PGY, postgraduate year; TMA, transmetatarsal amputation.
76.7% (6.7%) for curriculum residents, 56.9% (7.0%) for noncurriculum control residents, and 57.3% (9.4%) for all residents, with a statistically significant difference between the curriculum and noncurriculum control residents (P⬍.001), and are presented in Table 5. AMERICAN BOARD Of SURGERY IN-TRAINING EXAMINATION General surgery PGY-2 residents’ ABSITE scores were combined for years 1 and 2 (n = 6) and compared with the scores for our noncurriculum PGY-3 general surgery residents (n=6) taken during their second year. The mean (SD) 2-year average in-training test scores were 71.2% (7.5%) for curriculum residents and 60.3% (9.0%) for control residents, with the difference in mean scores being statistically significant (P = .004). OBJECTIVE STRUCTURED ASSESSMENT OF TECHNICAL SKILL
Mean (SD)
PGY-1 (n = 8) PGY-2 (n = 8)
Pretest
Posttest
P Value
57.5 (3.9) 58.6 (6.2)
71.4 (3.0) 72.6 (6.2)
.001 .001
Abbreviation: PGY, postgraduate year.
PRESENTATION AND COMMUNICATION SKILLS OBSERVATION CHECKLIST Curriculum residents’ communication skills demonstrated improvement between the PGY-1 and PGY-2 years. Improvements were most notable in the ability of the residents to engage the audience with appropriate eye contact and body language and to use appropriately formatted PowerPoint (Microsoft, Redmond, Washington) slides. Specific faculty comments included, “The structure of the presentations have become much more focused and easy to follow” and, the presenter has “greatly improved his ability to engage the audience.” Specific resident evaluation comments included, “The presentations, although embarrassing, were very helpful for self analysis.” SURGICAL LEARNING AND INSTRUCTIONAL PORTFOLIO All (n=8) curriculum residents successfully completed this assignment. The importance of this activity as a component of lifelong learning was emphasized during the curriculum. LONGITUDINAL AND SESSION EVALUATION FORMS Longitudinal and session evaluations demonstrated high satisfaction with the quality of the curriculum design, objectives, teaching, and attainment of the targeted educational objectives. Table 6 shows evaluation data from the session evaluations for the most recent PGY-1 and PGY-2 curriculum. Specific comments included, “The curriculum is a huge positive about the program. It has provided me with a real sense of team with my colleagues.” COMMENT
Surgical skills demonstrated improvement over the course of the PGY-1 and -2 years. Analysis of the time, item score, and global score (range, 1-5; 1, novice; 5, expert) all showed improvement. The PGY-1 global scores improved from a mean of 1.25 to a mean of 3.14 (P⬍.001). The mean global score for the curriculum PGY-2 residents was 3.5 compared with a mean score of 2.9 for the noncurriculum PGY-3 residents (P = .04). These assessments were done at the same time in the residents’ training. At the end of the PGY-2 year, all (n=8) residents met the minimum competency standards, performing vascular and bowel anastomoses based on checklist criteria and global assessment.
A major effort is under way to define a core surgical curriculum.21 This goal was set as part of the recommendations from the blue ribbon committee report on surgical education.22 A distinction should be made between a curriculum and an educational model. A core curriculum should be a constant for each discipline.8,9,22-25 In addition to a core curriculum, a systematic, evidence-based education plan for how to provide this instruction in compliance with the ACGME Outcome Project and the 80-hour work week is necessary for the curriculum to succeed. Our core curriculum was systematically developed based on current recommendations, with needs assess-
(REPRINTED) ARCH SURG/ VOL 144 (NO. 2), FEB 2009 164
WWW.ARCHSURG.COM
Downloaded from www.archsurg.com at Medical College of Wisconsin, on February 16, 2009 ©2009 American Medical Association. All rights reserved.
Table 5. Results of PGY-2 Weeks 1 Through 3 Combined Test Correct, % (SD) PGY-2 (n = 8) PGY-3 (n = 8) All residents (n = 32)
76.7 (6.7) 56.9 (7.0) 57.3 (9.4)
Table 6. Results From Curriculum Evaluations of PGY-1 and PGY-2 in July 2007 P Value
Mean (SD)
.001 PGY-1 (n = 8) PGY-2 (n = 8)
Abbreviation: PGY, postgraduate year.
ment data by our faculty and residents. Once core curriculum elements were determined, our PBC instructional model was developed. In designing our model, we borrowed from evidence suggesting that protected time away from clinical responsibilities would positively affect education and learning. Dedicated learning time on a given topic has been used to improve surgery in-training examination scores.26 A dedicated 13-hour curriculum to enhance resident’s teaching skills has been successful.27 These models, like ours, enable aspects of a traditional surgical residency to be retained for most of the residency training program. A more complete restructuring of a surgical residency program has been provided by Schneider and colleagues.10 They conclude that blended apprenticeships, small teams, and a night float system can be integrated into a new model without reducing resident educational experience. We chose a curriculum model that had protected or dedicated time for the adult learner. This model has distinct benefits in preparing residents, as adult learners and emerging professionals, to identify and develop learning plans and strategies that address identified performance needs. Consistent with the literature on adult learning, instructional methods blending independent and self-directed learning with interactive discussions and simulations were rated as highly successful by residents.28-30 These principles are also consistent with the ACGME’s Practice-based Learning and Improvement competency, and the emerging requirements for maintenance of certification. Additional principles include appropriate time for integrating new ideas and thoughts, ability to practice without distractions, and consistent attendance for small group discussion. Residents in our PBC emphasize the value of time away from clinical duties in facilitating learning.15 The PBC also produces a sense of collegiality among the group and ensures that the learner is rested and optimally receptive to be challenged to learn and apply new concepts and skills.31,32 Objective data concerning acquisition of new knowledge is supported by test scores and attainment of surgical skills. We constructed a control group of residents who were matched for level of training but not exposed to the PBC. This noncurriculum resident control group participated in our traditional educational program consisting of weekly departmental and divisional educational meetings. Comparison revealed improved performance by curriculum residents compared with noncurriculum residents on internal tests and the in-training examination. These tests relate primarily to patient care and medical knowledge competencies. As baseline performance on standardized examinations of curriculum and control residents was similar, we attribute most performance differences to the new curriculum format. The
Overall Quality of Content Score a
Overall Quality of Teaching Score b
4.6 (.3) 4.6 (.3)
3.5 (.3) 3.7 (.3)
Abbreviation: PGY, postgraduate year. a Likert scale 1-5; 1, remove from curriculum; 5, excellent. b Likert scale 1-4; 1, needs improvement; 4, outstanding.
ABSITE performance differences by year must be interpreted withcaution,asscoresacrossyearsarenotnecessarilyequated. However,ourresidents’meanpercentageofcorrectresponses has been consistent with those of our control group over previous years; thus, the increase in the performance of our residents is heartening. Similar results were apparent in communication skills, professionalism, practice-based learning, and systemsbased practice. We demonstrated improved outcomes, but recognize that more objective comparisons are needed. Improvement in presentation skills was transparent when reviewing residents’ PGY-1 presentations compared with their PGY-2 presentations. The importance of using an individual portfolio to demonstrate lifelong learning was a component of the curriculum. The longitudinal evaluations clearly indicate the value of the curriculum from the learners’ perspective. Faculty assessments of curriculum residents’ skills in the operating room and the patient care setting were uniformly positive. These assessments reveal a trend toward stronger performance compared with similar-level control residents, but sample sizes and statistical analysis options are limited at this point. In spite of these limitations, the overall positive evaluations by residents and faculty are hard to ignore. The Centers for Medicare and Medicaid Services’ (CMS) request that residents not be taken away from clinical service for 24 hours straight presents a new challenge.33 We sought to incorporate patient care sessions into each day of our curriculum to address this requirement; however, this stipulation is counterproductive to the educational goals and methods of our training program. We suggest that this CMS directive places educational goals in direct conflict with service activities and hope this request will be reconsidered. Our goal must be educational and service activities that comply with duty hours, include all ACGME competencies, enhance patient safety, and promote quality medical care. We acknowledge limitations of this analysis. This program is from a single academic institution and spans 2 years of a 5-year program. Though we are able to accomplish this program within the 80-hour work week, some programs may find it difficult, and other educational models can increase the priority of educational activities. The PBC puts a strain on faculty and the residents who are not participating in the sessions. Faculty and resident buy-in is necessary to effect this type of dramatic culture change, although any major change in our educa-
(REPRINTED) ARCH SURG/ VOL 144 (NO. 2), FEB 2009 165
WWW.ARCHSURG.COM
Downloaded from www.archsurg.com at Medical College of Wisconsin, on February 16, 2009 ©2009 American Medical Association. All rights reserved.
tional system will face the same challenge. Faculty buy-in is necessary at 2 levels. The first is developing educational material and teaching time. The second is developing strategies for patient care as residents are rotated into their protected time. From the residents’ perspective, there is additional work when a class of trainees is away at their curriculum week.34 Finally, identifying curriculum content requires a significant amount of work and planning. The current national activity to define a core curriculum will help define core content, establishing consistency across programs.21 The remaining issue is the instructional model used to engage surgical trainees in learning the components of the core curriculum. Combining the core curriculum with systematically designed and evidence-based instructional models will allow us to produce and document the competence of our surgeons for the future. We are satisfied that the gains in performance of the curricular residents support the continued use of PBC in our training program. Success with our protected block instruction model for surgery core curriculum has spurred us to develop a complementary core curriculum and an instructional model for our PGY-3 through -5 residents. Accepted for Publication: January 24, 2008. Correspondence: Travis P. Webb, MD, 9200 W Wisconsin Ave, Milwaukee, WI 53226 (
[email protected]). Author Contributions: Study concept and design: Weigelt, Anderson, and Simpson. Acquisition of data: Webb, Redlich, and Simpson. Analysis and interpretation of data: Webb, Weigelt, Redlich, and Brasel. Drafting of the manuscript: Webb, Weigelt, and Simpson. Critical revision of the manuscript for important intellectual content: Webb, Weigelt, Redlich, Anderson, Brasel, and Simpson. Statistical analysis: Simpson. Administrative, technical, and material support: Webb, Weigelt, Redlich, Brasel, and Simpson. Study supervision: Webb, Weigelt, and Brasel. Financial Disclosure: None reported. Previous Presentation: Presented at the 2007 Western Surgical Association meeting; November 7, 2007; Colorado Springs, Colorado. Additional Contributions: We would like to acknowledge and thank all of the residents at the Medical College of Wisconsin, those participating in the curriculum and those who did not have the opportunity to do so. We also acknowledge Robert Treat, PhD, from the Office of Educational Services for data management and statistical analysis. REFERENCES 1. Accreditation Council on Graduate Medical Education Web Site. Outcome project. http://www.acgme.org/acWebsite/home/home.asp. Accessed November 15, 2007. 2. Accreditation Council on Graduate Medical Education Web Site. Program director guide to the common program requirements. http://www.acgme.org/acWebsite /navPages/commonpr_documents/VID_DutyHours_DutyHours_Explanation .pdf. Accessed November 15, 2007. 3. Hutter MM, Kellogg KC, Ferguson CM, Abbott WM, Warshaw AL. The impact of the 80 hour resident workweek on surgical residents and attending surgeons. Ann Surg. 2006;243(6):864-875. 4. Fletcher KE, Underwood W III, Davis SQ, Mangrulkar RS, McMahon LF Jr, Saint S. Effects of work hour reduction on residents’ lives. JAMA. 2005;294(9):1088-1100. 5. Brasel KJ, Pierre A, Weigelt JA. Resident work hours: what they are really doing. Arch Surg. 2004;139(5):490-494.
6. Zare´ SM, Galanko JA, Behrns KE, et al. Psychologic well being of surgery residents after inception of the 80 hour workweek. Surgery. 2005;138(2):150158. 7. Woodrow SI, Segouin C, Armbruster J, Hamstra SJ, Hodges B. Duty hours reforms in the United States, France, and Canada: is it time to refocus our attention on education? Acad Med. 2006;81(12):1045-1051. 8. Fitzgibbons JP, Bordley DR, Berkowitz LR, Miller BW, Henderson MC; Association of Program Directors in Internal Medicine. Redesigning residency education in internal medicine. Ann Intern Med. 2006;144(12):920-932. 9. Canter R, Kelly A. A new curriculum for surgical training within the United Kingdom: the first stages of implementation. J Surg Educ. 2007;64(1):20-26. 10. Schneider JR, Coyle JJ, Ryan ER, Bell RH Jr, DaRosa DA. Implementation and evaluation of a new surgical residency model. J Am Coll Surg. 2007;205(3): 393-404. 11. Gallagher AG, Ritter EM, Champion H, et al. Virtual reality simulation for the operating room: proficiency based training as a paradigm shift in surgical skills training. Ann Surg. 2005;241(2):364-372. 12. Gold JP, Begg WB, Fullerton D, et al. Successful implementation of a novel internet hybrid surgery curriculum: the early phase outcome of thoracic surgery prerequisite curriculum e-learning project. Ann Surg. 2004;240(3):499-509. 13. Chahine AA, Jackson PG, Narra V, Evans SRT. How to develop and maintain a didactic schedule in a surgery residency 2005. American College of Surgeons Web site. http://www.facs.org/education/rap/chahine1005.html. Accessed September 15, 2007. 14. Boehler ML, Schwind CJ, Rogers DA, et al. A theory-based curriculum for enhancing surgical skillfulness. J Am Coll Surg. 2007;205(3):492-497. 15. Weigelt JA, Simpson DE, Anderson RC, Brasel KJ, Redlich PNA. PGY-1 curriculum: meeting a need for changing times. Curr Surg. 2006;63(6):410-417. 16. American College of Surgeons Division of Education. Successfully Navigating the First Year of Surgical Residency: Essentials for Medical Students and PGY-1 Residents. Chicago, IL: American College of Surgeons; 2005. 17. Lawrence PF, Alexander RH, Bell RM, et al. Determining the content of a surgical curriculum. Surgery. 1983;94(2):309-317. 18. Reznick R, Regehr G, MacRae H, Martin J, McCulloch W. Testing technical skill via an innovative “bench station” examination. Am J Surg. 1997;173(3):226-230. 19. Martin JA, Regehr G, Reznick R, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84(2):273-278. 20. Webb TP, Aprahamian C, Weigelt JA, Brasel KJ. The Surgical Learning and Instructional Portfolio (SLIP) as a self-assessment educational tool demonstrating practice-based learning. Curr Surg. 2006;63(6):444-447. 21. Bell RH. Surgical Council on Resident Education: a new organization devoted to graduate surgical education. J Am Coll Surg. 2007;204(3):341-346. 22. Debas HT, Bass BL, Brennan MF, et al; American Surgical Association Blue Ribbon Committee. American Surgical Association Blue Ribbon Committee report on surgical education: 2004. Ann Surg. 2005;241(1):1-8. 23. Merriam SB, Caffarella RS, Baumgartner LM. Learning in Adulthood: A Comprehensive Guide. 3rd ed. San Francisco, CA: Jossey-Bass Publishers; 2007. 24. Sloan DA, Plymale MA, Donnelly MB, Schwartz RW, Edwards MJ, Bland KI. Enhancing the clinical skills of surgical residents through structured cancer education. Ann Surg. 2004;239(4):561-566. 25. The Committee on Acute Care Surgery American Association for the Surgery of Trauma. The acute care surgery curriculum. J Trauma. 2007;62(3):553-556. 26. de Virgilio C, Stabile BE, Lewis RJ, Brayack C. Significantly improved American Board of Surgery in-training examination scores associated with weekly assigned reading and preparatory examinations. Arch Surg. 2003;138(11):1195-1197. 27. Morrison EH, Rucker L, Boker JR, et al. The effect of a 13-hour curriculum to improve residents’ teaching skills. Ann Intern Med. 2004;141(4):257-263. 28. ABMS maintenance of certification. American Board of Medical Specialties Web site. http://www.abms.org/Maintenance_of_Certification/ABMS_MOC.aspx. Accessed November 12, 2008. 29. Updated accreditation criteria. Accreditation Council for Continuing Medical Education Web site. http://www.accme.org/dir_docs/doc_upload/7ac66e27-3ed0-4b83 -854d-ce5a8ed82099_uploaddocument.pdf. Accessed October 14, 2006. 30. Houle CO. Continuing Learning in the Professions. San Fransciso, CA: JosseyBasee Publishers; 1980. 31. LePine JA, LePine MA, Jackson CL. Challenge and hindrance stress: relationships with exhaustion, motivation to learn, and learning performance. J Appl Psychol. 2004;89(5):883-891. 32. Papp KK, Stoller EP, Sage P, et al. The effects of sleep loss and fatigue on residentphysicians: a multi-institutional, mixed-method study. Acad Med. 2004;79 (5):394-406. 33. AAMC legislative and regulatory update. Association of American Medical Colleges. http://www.aamc.org/advocacy/1006update.pdf. Accessed November 1, 2007. 34. Brown K, Whitehouse J, Sato TT, et al. Protected block curriculum: assessing the gains and losses for an intern curriculum. Abstract Presented at: the Wisconsin Chapter of the American College of Surgeons Meeting; October 20, 2006; Kohler, Wisconsin.
(REPRINTED) ARCH SURG/ VOL 144 (NO. 2), FEB 2009 166
WWW.ARCHSURG.COM
Downloaded from www.archsurg.com at Medical College of Wisconsin, on February 16, 2009 ©2009 American Medical Association. All rights reserved.
