The following details important criteria and methods for assessment of residents' in the area of the six ACGME Competencies. These assessment methods were taken from presentation materials during the October 2006 faculty development activity.

Programs must assure they are using multiple observers and multiple methods in the assessment of resident competence.

Method Competency Assessed
Global Clinical Performance Ratings (e.g., end of rotation evaluations) All Competencies
Focused Observation Evaluation (e.g., observation of patient encounter) All Competencies
Multi-rater/360-degree evaluation Interpersonal Skills & Communication; Professionalism
Performance on Cognitive Test (e.g., in training examination) Medical Knowledge
Case Log (or similar data) Review Patient Care
Portfolio All Competencies

Example of a Core Assessment System:

Information about Evaluation Methods

Global Clinical Performance Ratings (end of rotation) Evaluation Methods

  • Add behavioral anchors to your evaluation tools (e.g., misses important details in H&P)
  • Provide rating criteria for the evaluators to help them determine the ratings

Global Clinical Performance Ratings (end of rotation) Evaluation Methods

  • SEGUE Framework/Communication Checklist:
    • Set the Stage,
    • Elicit Information,
    • Give Information,
    • Understand the Patient's Perspective,
    • End the Encounter, particularly useful in the assessment of interpersonal skills.
    The SEGUE Framework provides a common vocabulary for teaching, learning, assessing, and studying communication in medical encounters. The SEGUE Framework highlights a set of essential communication tasks (e.g., resident greeted patient appropriately; explained the rationale for the diagnostic procedures)
  • Observation of Procedural Skills: Objective Structured Assessment of Technical Skills (OSATS)

Multi-rater/360-degree Evaluation Methods

  • Evaluation of resident by multiple individuals such as self, peers, nurses, technicians, allied health professionals, and patients
  • Provides multiple perspectives of each residents' performance
  • Provides opportunity for resident to improve self-assessment skills

Cognitive Tests

  • In-training examinations (e.g, mock boards; in-service exam)
  • Multiple choice quizzes
  • Board Scores (first time pass rate)

Case Logs

  • Provides documentation of the breadth of clinical and operative experience
  • May be necessary for future credentialing in some specialties

Portfolios

  • A collection of materials that represents the residents' efforts, progress and achievement sin multiple areas of the curriculum.