Graduate Medical Education

Core Assessment Systems

The following details important criteria and methods for assessment of residents' in the area of the six ACGME Competencies. These assessment methods were taken from presentation materials during the October 2006 faculty development activity.

Programs must assure they are using multiple observers and multiple methods in the assessment of resident competence.

Example of a Core Assessment System:

Method	Competency Assessed
Global Clinical Performance Ratings (e.g., end of rotation evaluations)	All Competencies
Focused Observation Evaluation (e.g., observation of patient encounter)	All Competencies
Multi-rater/360-degree evaluation	Interpersonal Skills & Communication; Professionalism
Performance on Cognitive Test (e.g., in training examination)	Medical Knowledge
Case Log (or similar data) Review	Patient Care
Portfolio	All Competencies

Information about Evaluation Methods

Global Clinical Performance Ratings (end of rotation) Evaluation Methods

Add behavioral anchors to your evaluation tools (e.g., misses important details in H&P)
Provide rating criteria for the evaluators to help them determine the ratings

Global Clinical Performance Ratings (end of rotation) Evaluation Methods

SEGUE Framework/Communication Checklist:: Set the Stage, Elicit Information, Give Information, Understand the Patient's Perspective, End the Encounter, particularly useful in the assessment of interpersonal skills. The SEGUE Framework provides a common vocabulary for teaching, learning, assessing, and studying communication in medical encounters. The SEGUE Framework highlights a set of essential communication tasks (e.g., resident greeted patient appropriately; explained the rationale for the diagnostic procedures)
Observation of Procedural Skills: Objective Structured Assessment of Technical Skills (OSATS)

Multi-rater/360-degree Evaluation Methods

Evaluation of resident by multiple individuals such as self, peers, nurses, technicians, allied health professionals, and patients
Provides multiple perspectives of each residents' performance
Provides opportunity for resident to improve self-assessment skills

Cognitive Tests

In-training examinations (e.g, mock boards; in-service exam)
Multiple choice quizzes
Board Scores (first time pass rate)

Case Logs

Provides documentation of the breadth of clinical and operative experience
May be necessary for future credentialing in some specialties

Portfolios

A collection of materials that represents the residents' efforts, progress and achievement sin multiple areas of the curriculum.
E*Value provides a portfolio feature that allows resident portfolios (MyFolio) to be created by the program. Residents and/or the program director/administrators have the capability of uploading documents to the portfolio. My Folio is a repository where lifetime learners can collect information about their learning experiences, similar to a virtual filing cabinet. This functionality can be used by residents, faculty and administrators and is provided at no cost to the program.

RESOURCES:

ACGME has provided a Facilitator's Guide, "An Introduction to Competency-based Residency Education,"©ACGME (April, 2006; B. Joyce, Ph.D), and a Virtual Program Director's Handbook. You may click on the document name to access these resources, or may visit the ACGME website at www.acgme.org.

Common Program Requirements and Common Program Requirements for One Year Fellowships, both effective 7/1/11, are available at the ACGME website. ACGME also has provided a Program Director's Guide to the Common Program Requirements that became effective 7/1/11.

UMMC has provided a Program Director Guide with examples of program, rotation, and level specific goals and objectives as well as sample evaluation tools for evaluating resident/fellow performance, faculty performance, and program effectiveness.

This page was last updated on: February 6, 2013.