The Society for Academic Emergency Medicine (SAEM) and the Council of Emergency Medicine Residency Directors (CORD) have developed this Model Curriculum as an educational resource. It is not intended to be a list of requirements which programs must adhere. Rather, we invite you to amend it or use it in any way that helps meet the educational mission of your own institution.
The first edition of this model curriculum, developed by SAEM in the early 1990’s,was created to assist program directors in creating a functional curriculum in the face of an ever-expanding Core Content in Emergency Medicine document. Shortly after completion, the original model curriculum document was transferred to CORD for further development and maintenance. Since that time, the Core Content has been updated and many other treatment and diagnostic developments in Emergency Medicine have changed.
A major criticism of past editions of the Core Content has been that no component is weighted in terms of the importance of the topic to the overall curriculum and practice of our specialty. For example, myocardial infarction and obscure parasitic induced illnesses receive the same emphasis. Therefore, in this revision of the model curriculum, we have “weighted” each educational objective in order to assist residents in self-study efforts, program directors in utilization of limited formal curriculum time, and CME planners in program planning. We propose that residents develop “mastery”, “proficiency”, or “familiarity”- as appropriate- with each educational objective. Our definitions of “mastery”, “proficiency” and “familiarity” appear on the next page. We encourage program directors to edit and use this document in any way that helps meet the needs of their program. While we anticipate that this document may not prove useful for every training program, we sincerely hope that most of you find this updated model curriculum to be helpful.
The Model Curriculum Task Force consisted of SAEM representatives Steven Dronen MD and Scott Syverud MD, and CORD representatives Sam Keim MD and Carey Chisholm MD. Louis Ling MD served as the Task Force Chair. We are indebted to the assistance of Pat Miller at SAEM for her administrative assistance in this project.
The above quote, attributed to an anonymous program director, reflects the frustration many program directors have felt with the process of curriculum development. This frustration is compounded when programs are cited for the lack of an adequate curriculum. Some may view the focus on curriculum development as a symptom of bureaucratic excess. An alternate and more plausible view is that ultimately residency programs will be stronger if based on well thought-out educational blueprints. While it is tempting to fantasize that the right mix of patients, faculty and residents will result in a strong program, often this is not the case. It is particularly challenging to develop strong educational programs in Emergency Medicine (EM). EM faculty are in large part inexperienced educators. Most EM programs are young and many have been accredited just within the past few years. The subject material is extremely broad and the clinical experiences are fragmented. Success under such circumstances generally demands a prospective, carefully thought-out plan of action. In the world of education, this plan is called a curriculum.
“Curriculum” is defined in the Dictionary of Education as “a general over-all plan of the content or specific materials of instruction that the school should offer the student by way of qualifying the student for graduation or certification.” Thus the curriculum is the road map that explains how the medical school graduate will ultimately develop into a skilled emergency medicine specialist.
It is important to note that curriculum is defined as an educational plan rather than an all-inclusive list. The quality of a curriculum is judged by the amount of information it conveys rather than the number of trees that were sacrificed in its production. Unfortunately, some programs respond to the uncertainty surrounding curriculum development by producing several hundred page documents that are exhaustively detailed, yet fail to adequately describe the educational program about which they are written. This may reflect an incomplete understanding of the role the curriculum should play in a residency program.
This manual was written to offer practical advice to program directors struggling with writing and using their curricula. Unlike most publications on the subject of curriculum development, this manual was not written by education theorists but by emergency physicians who are also educators. The goal was to produce a readable and reasonable document, devoid of technical jargon, that would discuss the essentials of what is needed and why it is needed. It is not intended to be an all encompassing treatise on curriculum development. There are many other excellent references on this subject, and several are listed in the bibliography.
Aside from being time-consuming to write, one of the most frequent complaints heard about curricula is that they are never used. That is why this section is presented before those that discuss writing the document. It must be clear from the outset that a curriculum should not be written to fulfill a program certification requirement but to serve as an educational tool. Because it is the plan for the educational program, the curriculum should not exist in isolation from the program. In other words, it should not be the last thing completed before the program application is submitted; nor should it sit on a shelf gathering dust until the next RRC site visit. For new programs, a well-structured curriculum should be developed before clinical or didactic experiences are scheduled. In fact, the educational goals and objectives described in the curriculum should be the focal point for discussions between the program director and those responsible for overseeing various resident rotations. For established programs, both residents and faculty should be aware of the curriculum’s content and attempt to follow the educational plan it describes. Faculty and residents should regularly evaluate the appropriateness of the plan and the program’s success in meeting its stated goals. Listed below are ways the various individuals involved in the residency program should use the curriculum.
The Program Director – While most commonly identified as the individual primarily responsible for writing the curriculum, the program director’s real challenge is to see that the document is used. This begins, early in the writing phase, with a realistic assessment of the document’s practicality and ability to convey information. A document that does not convey practical information will not be used. This concept will be covered in greater detail in Section V.
Once the curriculum is written it is the program director’s responsibility to insure that relevant sections are shared with the personnel responsible for providing the residents’ education and that these individuals actually accomplish what the document claims they do. Feedback is the essential component of this process. By requesting feedback that relates specifically to program goals and objectives, the program director invites active participation in the process and increases the likelihood that the program goals will actually be met. Feedback should be solicited on a regular basis and incorporated into revisions of the document.
The Emergency Medicine Faculty – It is probably a safe assumption that many emergency medicine faculty are unfamiliar with their program’s curriculum. Nevertheless, these are the people responsible for providing or supervising at least 50% of the residents’ educational experiences. At a minimum, the EM faculty should read the sections describing the Emergency Department rotations and the program didactics. They should participate in a regular evaluation of the program and its curriculum which involves assessing whether the curriculum accurately describes the residents’ clinical and didactic experiences, whether resident evaluations accurately reflect their progress in meeting their educational goals, and perhaps most important of all, asking themselves if they function in a way that optimizes the program’s ability to achieve its stated goals.
Off-Service Faculty – Expecting off-service faculty to have an interest in the emergency medicine curriculum is probably unrealistic, but the individuals responsible for coordinating off-service rotations and evaluating the residents should be aware of the educational expectations of those rotations. Before a program begins, rotation coordinators should indicate in writing that they are aware of the goals and objectives and will work with the program director to insure that these are met. For established programs, a periodic review of each rotation is essential to insure that high standards are maintained. This is also a good time sit down with each rotation coordinator, review the relevant educational objectives and discuss the feedback that has been exchanged relating to both resident and faculty performance.
The Residents – Ideally, residents’ clinical experiences should be structured to insure that they begin with the most basic cases and proceed in an orderly fashion to cases of increasing complexity. Exposure should be provided to all rare disorders and redundant exposure to common disorders should be avoided. This ideal is often compromised in a medical education system that is based to a great extent upon clinical service needs. Although this system may be very effective, it is by design, inefficient. This inefficiency is potentially greater in emergency medicine because residents rely on other departments to provide more than half of their education. The curriculum is the tool the residents should use to insure that their time is well spent and that there are no gaps in their knowledge or experience base. Before each rotation residents should review the goals and objectives and the methods by which they will be expected to achieve them. A post-rotation evaluation should be submitted by all residents that focuses on the question, “Does the rotation meet its stated objectives?” Residents should also participate in a periodic evaluation of the program and the curriculum.
This section describes the essential components of a curriculum from a functional point of view, i.e., What does each accomplish? In its most basic form, the curriculum should answer the following questions:
- What is the overall intent of the educational program and its component parts? In other words, what are the goals? These may be broad, pertaining to the program as a whole, or more specific, pertaining to a single rotation or even a single lecture. However, they are generally conceptual in nature, describing the desired end-point.
- What specific skills or changes in behavior should the participants be able to demonstrate upon completion of the program? Unlike goals, the program objectives must be distinct, observable or measurable skills or behaviors. Attainment of the program objectives is evidence that the goals have been achieved.
- How will the skills or changes in behavior be taught? A number of methods are used either singly or in combination to take participants from the starting point to attainment of the program objectives. Typically these include clinical experiences, lectures, reading assignments and other special educational activities such as tutorials, skills workshops and computer simulations.
- How will program success be measured? In other words, what system of evaluation exists to demonstrate that participants meet the educational objectives?
- How will information about the program’s strengths and weaknesses be collected and used to improve the program? In other words, how is feedback solicited and used?
- What is the subject matter upon which the program is based? In other words, what is the program content?
For most program directors, creating a curriculum is an unpleasant task and certainly one they hesitate to begin. It is a huge amount of work and it often must be done at just the wrong time. New program directors are busy setting up clinical rotations and resolving the political problems associated with a developing program. Experienced program directors often revise their curricula while preparing for an upcoming RRC site survey and are preoccupied with correcting potential program deficiencies. Although it is understandable that attention frequently is directed elsewhere, a key to successful curriculum development is integration of the process with these seemingly more important activities. In other words, planning or modifying a program and writing or amending a curriculum should not be viewed as distinct activities, but as part of the same process.
The principle that program planning and curriculum development are concurrent, integrated activities is particularly relevant when deciding who should write the curriculum document. Given the size and complexity of the task, many programs elect to have a team of emergency medicine faculty involved. This is an effective approach as long as team members asked to write sections of the curriculum are simultaneously working on program planning. It is difficult to accurately describe a program without firsthand knowledge and involvement. In addition to sharing the workload, there are other significant advantages to a team approach: 1) there will be a greater exchange of ideas that may strengthen the program, and 2) integrally involved faculty will develop a greater commitment to successful curricular implementation.
Given the time limitations and size of the task, a common starting point when writing a curriculum is to borrow documents from several program directors to serve as models. New directors correctly assume that there are many common elements of residency programs and that it is unnecessary to reinvent the wheel. It is helpful to look at several completed curricula while the document (and the program) are still in the planning phase. This review will provide a realistic assessment of the resources and planning necessary for a successful program. Reading several documents gives exposure to a variety of styles and ideas and helps develop a better sense of what works. This review also gives a clearer idea of what the finished product should look like. One danger in reading other curricula in preparation for writing one is that others’ mistakes may be repeated. ACGME accreditation is not a guarantee of a high quality curriculum. A greater danger in modeling a program’s curriculum after others’ is that the final product will inadequately describe those features that make that program unique. When reviewing other programs’ documents it is important to remember that the curriculum is the plan for a distinct program, intended for use by that program. Therefore, the finished product must clearly describe that program.
As noted previously, reviewing other programs’ curricula provides a better idea of the resources needed to build a program. It can thus be a useful exercise to help reassess the quantity and quality of the available resources. It is amazing how often the absence of essential resources does not become clear until after the document is written and the RRC has paid a visit. It is also appropriate to ask hard questions relating to the adequacy of the educational experiences being planned. Is the ED patient population comprehensive or is some pathology lacking? What off-service rotations will be needed to round out the residents’ education? Can these rotations realistically accomplish their desired goals and objectives? Who will provide the didactic portion of the program? How will training in specific areas such as EMS and research be provided? These are just a few of the many questions that must be asked while writing the curriculum.
Perhaps the most immediate resource-related concern is finding the time and manpower needed to complete the document. If this is a new document, it is reasonable to expect the program director to receive protected time averaging 12-16 hours per week over a six month period devoted solely to program planning and curriculum development. Other members of the program planning/curriculum development committee will also require protected time proportional to the extent of their involvement. The program director should have a full-time secretary with access to word processing.
It is essential that a timetable for completion of the document be developed and that the timetable is followed. It is realistic to expect that each step will require 50% more time than initially expected. It is a good idea to add sufficient time to have an unbiased reviewer critique the document prior to RRC submission. Paid consultants are available to assist in this task.
Few topics spark a livelier debate among program directors than curriculum design. There are a numerous approaches, each with its share of advocates and detractors. Many program directors choose a particular curriculum design based upon their perceptions of what the RRC expects the document to look like. This is a mistake that often leads to production of a non-functional curriculum. There is no need to become involved in a complicated and cumbersome process in the mistaken belief that this is what the RRC expects. Therefore, the curricular model used is much less important than the effectiveness with which it is used. A curriculum should be designed to accurately and efficiently describe an educational program. It’s that simple.
Irrespective of the approach taken, the curriculum must describe educational goals and objectives, the methods by which the objectives are achieved, and evaluation and feedback methods. Standard methods for achieving the educational goals include clinical experiences, lectures, reading and special skills labs or workshops.
Section VI provides a basic outline of an Emergency Medicine curriculum. It is organized according to the major disciplines or topics that make up the specialty. This model was chosen because EM is to a certain extent a composite of the acute care aspects of these disciplines and because this is the best fit with the approach used in most residencies, i.e., a series of clinical rotations based on those disciplines. Also included are broad topics particularly pertinent to EM such as ED Administration, EMS, Environmental Illnesses, and Resuscitation. This approach avoids much of the redundancy associated with other models and allows coordinated presentation of clinical experiences (both in and out of the ED), didactics and required reading for each discipline.
An alternate approach is to individually present experiential, didactic and literature-based curricula. The strength of this model is its organization, but it requires presentation of most subjects in at least three separate sections, increasing the potential for fragmentation and redundancy. This is likely to make the document less usable (particularly for a resident) than if all information relevant to a particular discipline were presented in a coordinated fashion.
A third approach that can work well is to organize the document according to the major organ systems. This is apt to produce a detailed and thorough document, but its weakness is that most programs are not structured in this way. For example, there are generally no clinical experiences in Abdominal Disorders or Head and Neck Disorders,but, instead, in Medicine, Surgery, Ophthalmology, and ENT. A separate description of these experiences still needs to be included when this approach is used.
While only one organizational approach is outlined, the program director is urged to consider several options and decide which works best in his own setting. Other approaches are certainly acceptable provided that they contain the necessary elements and facilitate use by faculty and residents. With this proviso in mind, it is appropriate to comment on an approach that has become popular recently, modeling the curriculum after the Core Content.
It is our good fortune to practice and teach a broad discipline. Unfortunately this breadth creates problems when program directors are required to describe what they are trying to teach. The problem has been further complicated by the mistaken belief that a curriculum is not complete unless it specifically addresses all 1000+ items listed in the Core Content. It is important to maintain the perspective that the Core Content was not developed to serve as a list of educational objectives. To suggest that residents will be knowledgeable in every item and that programs will be able to document their residents’ proficiency in every item is pure fantasy. It is not necessarily even a desirable state of affairs. Modeling a curriculum after the Core Content presents major design problems. Such a document is abundantly and redundantly detailed. While the leaves may be in sharp focus, the forest is a blur. In addition, the long lists of Core Content items often make these documents unreadable. A document that is difficult to read will not be used. Finally, Core Content-based curricula frequently do not mirror the residents= educational experiences. Most residency programs are not structured as a list of 1000+ items to be learned. Rather, a typical residency consists of a collection of clinical experiences, a series of lectures or workshops, and a fair amount of reading. These are the items upon which the curriculum should be focused.
Is there a place then for the Core Content in the development of curricula? Absolutely! As the only comprehensive list of topics relevant to the discipline it serves as a useful tool to insure that there are not gaps in the residents’ education. There are several ways in which this tool can be used. For example, an index of Core Content headings may be appended to the curriculum indicating the location of relevant material within the document. Alternatively, when describing program objectives throughout the curriculum, the relevant Core Content areas may be referenced. Both of these approaches maintain the descriptive character of the curriculum, while simultaneously ensuring that program content is not compromised.
A. INTRODUCTION – This section provides a brief overview of the program, its resources and its educational philosophy.
B. SUBJECTS OR DISCIPLINES TO BE TAUGHT – In this section a list is provided of the subjects that will be taught during the residency. This is the framework around which the program is constructed. It is essentially a means of breaking down the broad topic, Emergency Medicine, into a series of discrete and manageable subjects. In this document the curriculum is organized according to broad medical disciplines but other approaches can be used such as organ systems or Core Content headings.
C. INDIVIDUAL SUBJECT CURRICULA – In this section, a curriculum is provided for each of the subjects. This includes goals, objectives, implementation methods, evaluation techniques, and feedback. It is important to describe how objectives and implementation methods vary depending upon the clinical setting and the year of training. For example, Anesthesia (Appendix A) is described not only as a clinical rotation, but also as a subject taught in the ED. There are distinct objectives in Anesthesia for each year of the program, and distinct activities designed to accomplish these objectives. Because this is the way the subject is often taught, this description is likely to be more accurate than the typical isolated description of an Anesthesia rotation. Descriptions such as this also provide solid evidence that graduated responsibility exists in a program.
Appendices A and C provide examples of a basic framework or list of subjects into which Emergency Medicine can be subdivided, as well as a description of a curriculum for Anesthesia. The latter is provided as an example of the essential elements that should be included in a curriculum, not as a model of how a particular program should be structured. Appendix D lists goals and objectives for each of the 24 subjects listed in Appendix C. These could easily be modified to describe the unique characteristics of a particular program.
E. EVALUATION – A carefully planned system of evaluation is the tool programs use to determine whether or not the educational objectives have been met. Both subjective and objective methods can be successfully incorporated into a residency program. The evaluation methods selected should be matched to the particular performance or behavior one wishes to measure. Objective techniques are best suited to quantitatively measurable performances (e.g., number of patients seen, number of procedures successfully performed, quiz scores, attendance at lectures). Subjective techniques are frequently used for complicated behaviors or qualitative assessments (e.g., judgement in patient management, interpersonal skills). Evaluations may be designed to test a minimal performance standard (e.g., ability to intubate), or they may be relative comparisons to peer performance (e.g., percentile score on ABEM inservice exam). Both approaches have strengths and weaknesses, so most programs use a combination of performance parameters matching the appropriate method to the particular objective.
The evaluation tools should match up with program objectives. Too many evaluations focus heavily on a variety of subjective resident characteristics but never determine if residents achieve the program objectives. All written evaluations should specifically refer to the relevant educational objectives (see Appendix A).
In addition to specific rotational or course evaluations, it is necessary to describe the overall system of evaluation that exists in the educational program. Appendix B describes a number of evaluation methods that may be used.
F. FEEDBACK – Feedback is the mechanism by which residents and faculty learn whether they are meeting the program objectives. This section of the curriculum should describe the overall system by which information obtained from the evaluation process is shared with residents and faculty. It should be clear that feedback is provided in a regular and systematic fashion. The precise responsibilities of various faculty members in the feedback process should be detailed and a schedule for those activities should be provided.
Both formal and informal methods should be described. For example, formal mechanisms may include written evaluations and semi-annual reviews; informal mechanisms may include direct verbal or written communications relating to a specific occurrence.
G. PROGRAM CONTENT – Every curriculum should list the subject matter that the program intends to teach, i.e., the program content. This task has been simplified in Emergency Medicine by the availability of the Core Content. However, simply reprinting the Core Content and appending it to the curriculum is not informative. Instead, the curriculum should include a system that ties Core Content items to specific program educational objectives. This will document that the program is designed to teach all important content items. In Appendix E the Core Content has been cross-referenced to the list of goals and objectives provided in Appendix D. In addition, the list of goals and objectives has been cross-referenced to indicate the related Core Content items.
- Tyler R. The Curriculum – Then and Now, in Proceedings of the 1956 Invitational Conference on Testing Problems. 1957. Princeton N. J. Educational Testing Service.
- English F. Fundamental Curriculum Decisions. 1983, Alexandria: Association for Supervision and Curriculum Development.
- Tabba H. Curriculum Development: Theory and Practice. 1962, New York: Harcourt, Grace, Jovanovich, Inc.
- Tyler R. Curriculum Theory in Milwaukee, in Curriculum Theory Conference. 1976. University of Wisconsin Milwaukee: Association for Supervision and Curriculum Dev., 1701 K Street, N.W., Suite 1100, Washington, D.C. 2006.
NOTE:
THIS SAMPLE SUBJECT CURRICULUM WAS DEVELOPED FROM THE ANESTHESIA OBJECTIVES IN THE PREVIOUS EDITION OF HTIS MODEL CURRICULUM, AND IS PRESENTED HERE FOR ILLUSTRATION PURPOSES ONLY. THE UPDATED OBJECTIVES FOR ANESTHESIA APPEAR IN THE TABLE OF CATEGORIES.
ANESTHESIA
GOALS
Develop airway management skills
- Develop familiarity with pharmacologic agents used in anesthesia
- Learn standard monitoring techniques
- Learn relevant pre-operative historical and physical exam considerations
- Learn principles of pain management.
OBJECTIVES
Upon completion of the PGY I Anesthesia rotation the resident will be able to:
- Demonstrate correct use of the bag-valve-mask device.
- Demonstrate knowledge of the anatomy of the upper airway.
- Demonstrate basic familiarity with nasotracheal and endotracheal intubation as well as the indications and complications
- State the dosages, indications and contraindications for inhalation anesthetic agents, intravenous analgesic and anesthetics, and neuromuscular blocking agents.
- Demonstrate ability to use standard monitoring techniques.
- Demonstrate ability to manage a patient on a ventilator.Upon completion of the PGY I year the resident, in addition to achieving objectives A-F, will be able to:
- Demonstrate knowledge of the principles of regional anesthesia and successfully perform metacarpal, digital, radial, median, ulnar, tibial and sural nerve blocks.
- Demonstrate ability to administer local anesthetics and be familiar with agents, dosing, side effects, and techniques to monitor pain.Upon completion of the PGY II year the resident will be able to:
- Recognize and manage an obstructed airway.
- Demonstrate skill in all aspects of nasotracheal and endotracheal intubation.
- Demonstrate ability to use standard emergency department monitoring techniques.
- Perform conscious sedation under faculty supervision.
- Perform facial nerve blocks to include supraorbital, infraorbital, mental and auricular nerves.Upon completion of the PGY III year the resident will be able to:
- Demonstrate appropriate judgement regarding the need for airway intervention.
- Demonstrate skill in the use of anesthetics and neuromuscular blocking agents including conscious sedation and rapid sequence intubation.
- Demonstrate ability to obtain a surgical airway.
- Perform dental blocks.
While the Anesthesia objectives should be relatively consistent from one program to another, the implementation methods may vary quite a bit. In the section above, the standard list of Anesthesia objectives was subdivided to indicate where and when they are taught in a hypothetical residency program. The next section describes one method by which these objectives may be achieved. It is presented only as an example, not as a recommended method.
IMPLEMENTATION METHODS
These objectives will be achieved through a one month rotation in the Anesthesia Department during the first year and through participation in the management of Emergency Department patients during the three years of the residency.
Anesthesia Rotation:
Clinical Activities – Residents are assigned to work under the supervision of an attending anesthesiologist who oversees their participation in 4-6 cases per day. Resident responsibilities include performance of a pre-operative history and physical examination, induction and maintenance of anesthesia, airway and ventilator management, intraoperative monitoring, and post-operative evaluation. Residents take in-house call every fourth night during which time supervision is provided by attending staff or senior level anesthesia residents.
Lectures – Residents attend Department of Anesthesia Grand Rounds every Wednesday from 3:00 to 4:00 PM.
Reading Assignments – Clinical Procedures in Emergency Medicine, Chapters 1, 2, 42. Emergency Medicine – Concepts and Clinical Practice, Chapters 4, 5. Emergency Department Rotations:
Clinical Activities – During the PGY I year the resident works one day per week in the Fast Track area of the emergency department under the direct supervision of a EM PGY III. During the PGY I ED experience the resident receives instruction in administration of local anesthesia for patients with lacerations and minor orthopedic injuries. The PGY I resident assists senior residents with intubation and during the second half of the year may perform intubation under close supervision. During the PGY II year the resident is the primary resident responsible for performing tracheal intubations in the ED. The resident is supervised and instructed in the proper technique as well as appropriate use of monitoring devices by the faculty physician. Critical decisions regarding airway intervention are generally made by the PGY III in consultation with the faculty physician. The PGY III is also responsible for administration of pharmacologic adjuncts to intubation and for performance of all cricothyrotomies in the ED.
Lectures– During the PGY I orientation the following lectures are provided: Upper Airway Anatomy, Local Anesthetic Agents, Administration of Regional Anesthesia, Parenteral Analgesic Agents. The orientation also includes an animal lab and ATLS and ACLS courses during which residents are exposed to the mechanics of orotracheal intubation and cricothyrotomy. The following lectures are provided once every 36 months: Neuromuscular Blocking Agents, Monitoring in the ED, Rapid Sequence Induction, Techniques of Regional Blocks.
Recommended Reading – Principles and Techniques of Minor Wound Care.
EVALUATION
Residents receive a written evaluation upon completion of the Anesthesia rotation, as well as after each month in the ED. Residents are evaluated specifically on their skills in airway management and monitoring. All evaluations are reviewed by the program director and placed in the residents’ files. (A sample of the Anesthesia rotation evaluation is included at the end of this section.)
FEEDBACK
The program director is responsible for notifying residents of any problems noted as soon as possible. Written evaluations are available for review during normal working hours. They are reviewed formally with the residency director on a semi-annual basis.
EMERGENCY MEDICINE RESIDENT EVALUATION
MIDWESTERN UNIVERSITY SCHOOL OF MEDICINE
Division of Emergency Medicine
| Rotation: Anesthesia | Resident: ______________ |
| Evaluator: _________________ | Date: _________________ |
| I. General Evaluation/Personal Attributes | |||
| Motivation/Interest | O G S D IC | History Taking | O G S D IC |
| Dependability | O G S D IC | Physical Exam | O G S D IC |
| Professional Behavior | O G S D IC | Presentations | O G S D IC |
| Interpersonal Skills | O G S D IC | Documentation | 0 G S D IC |
| Patient Management | O G S D IC |
| II. Cognitive Objectives | |
| Knowlege of upper airway anatomy | O G S D IC |
| Understands pharmacology of anesthetic agents | O G S D IC |
| Understands use of monitoring techniques | O G S D IC |
| III. Skill Objectives | |
| Use of bag-valve-mask device | O G S D IC |
| Nasotracheal intubation | O G S D IC |
| Orotracheal intubation | O G S D IC |
| Ventilator management | O G S D IC |
IV. Please provide a description of specific strengths/weaknesses.Evaluator’s Signature ______________________
Key: O=Outstanding, G=Good, S=Satisfactory, D=Deficient, IC=Insufficient Contact
- Written Tests: The formats and types of testing (i.e., essay, multiple choice), vary greatly and each has its strengths. Most programs use some form of written testing in evaluating the knowledge and comprehension of specific subjects, reading assignments, rotations, and lectures. Additionally, national tests (e.g., inservice examinations) allow for relative comparisons among residency groups.
- Oral Tests: Many programs use oral testing or interviews to assess the knowledge, comprehension, and judgment of residents in many areas of clinical patient management. Oral tests may use standardized presentations and allow relative comparisons between residents within a program.
- Attendance Records: Attendance records are used to ensure adequate attendance at didactic and other programs.
- Log Books: Log books are used to accumulate statistics on procedures, the number and types of patients seen, acuity levels and other objective data to ensure adequate clinical experience.
- Quality Assurance Programs (Q.A.): This information may be used to provide statistical and subjective data concerning performance, quality of care, complaints, productivity, utilization review, appropriate documentation, and appropriate use of ancillary tests. Several programs use the data to determine the ability of residents to provide appropriate documentation. QA programs frequently identify problems from ineffective communication. Information from the management of complaints and assessment of patient satisfaction can be provided to assess minimal levels of expected performance. Some QA programs also provide statistical information and productivity. Problems with patient management and disposition may be identified via the QA process, as well as the length of time taken to make dispositions. This information is best used to access the resident’s ability to meet a minimum expected level of performance or identify potential problems.
- Departmental/Statistical: Patient numbers, acuity levels, admissions, diagnoses, procedures, etc., may be derived from departmental data for particular physicians. Billing information may provide this data and has been used to monitor productivity and performance. Programs may establish productivity goals for each PGY level. Additionally, they may look at outliers both too high and too low as a means to determine if there are any problems with the care provided.
- Evaluations of Lectures and Presentations Given by Residents: Evaluation of presentations provide direct feedback to presenters from their audience. Establishing standardized methods to evaluate presentations helps provide meaningful and constructive feedback.
- Rotation Evaluations: Clinical evaluation of performance on rotations is best provided by the physicians directly supervising the resident. Establishing specific areas to evaluate, using standardized forms, and defining expectations for evaluators for resident performance allows for more reliable and useful evaluations.
- Supervision: Direct supervision, observation and feedback are the most commonly used evaluation techniques. This includes the direct immediate feedback provided by supervising attendings as residents provide patient care. Establishing expected levels of performance for specific resident levels and assuring the skills of supervisors to effectively evaluate and constructively communicate maximizes this type of feedback. Additionally, some programs have scheduled evaluations of specific cases (either real or simulated) at specified times in the training program.
- Laboratory and Procedures Skills: Testing can assess technical skill levels through direct observation. Skills demonstrations may be used during the course of patient care.
- Case Simulations: These may be used in verbal and written forms, as well as in patient simulations to evaluate patient assessment and management skills.
- Resident Self-Evaluation: This technique has been used in conjunction with resident interviews to focus on compliance with expectations and subjective elements of individual performance.
- Videotape Evaluations: Videotapes have been used to allow self-evaluation and for critical evaluation of performance (i.e., trauma resuscitation tapes).
- M&M Case Presentations: These allow for peer evaluation and feedback.
- Job Evaluations: Some programs ask the clinical supervisors of their graduates to provide an evaluation of the graduate’s clinical and administrative skills. These programs use this information to strengthen areas of weakness.
- Interactive Computer Programs: These have been used by some programs to assess knowledge and skill levels.
- Achievement of Certifications (ACLS, ATLS, PALS, Base Station Course): These courses use the specific evaluation methods developed for each course.
- Formal Written Resident Evaluations: The program director is required to provide direct feedback to the resident on performance at least biannually. Frequently, these are based on written evaluations by faculty and a compilation of other information on the resident’s performance.
- Resident Evaluations: Residents are frequently asked to evaluate rotations, lectures and faculty. Some programs have asked residents to evaluate their training after they have been in their first clinical job for one year.