Assessment Plan Builder

Updated in ME 1.17, the Assessment Plan Builder is now functional and is a required prerequisite to use the CBME program dashboard.

The assessment plan builder allows you to specify minimum requirements for assessment forms on a per-EPA basis. These plans are leveraged to generate resident progress reports in the CBME Program Dashboard.

Currently, the assessment plan builder supports Supervisor Forms, Field Notes, PPAs (with global entrustment item), and Rubric Forms (with global entrustment item). It does not currently support procedure forms built using the procedure form template, or PPAs/Rubrics that do not have the global entrustment item added.

Building an Assessment Plan

  • You must be in an administrative role and have access to a specific program to use the Assessment Plan Builder.

  • Navigate to Admin > Manage Courses.

  • Beside the appropriate program name, click the gear icon and click "CBME".

  • Click the Assessment Plans tab.

  • Click "Add Assessment Plan".

When you click “Add Assessment Plan” you are creating a container for all EPA-specific assessment plans in your curriculum. Each assessment plan container is scoped to a single curriculum version (i.e., if you have multiple versions of your EPAs, you can create different assessment plans for different EPA versions).

  • To add an assessment plan, select the “Version” and create a title for your assessment plan container. Adding a description is optional.

  • Click “Save Plan.” You will now be redirected to the new assessment plan container. You can use one container for all of your EPAs within a version.

  • The assessment plan container will load all EPAs for the selected curriculum version. You can use a free-text search to find a particular EPA, or scroll down to the EPA of interest.

  • Each EPA has a circular icon that indicates the EPA plan status.

    • A green checkmark indicates that an assessment plan has been published for this EPA.

    • A grey circle indicates that no assessment plans have been started for this EPA.

    • An orange exclamation mark indicates that an assessment plan has been saved in draft mode for this EPA. Changes may need to be made before publishing.

  • Click on the EPA you wish to add an assessment plan for.

  • Add a title and an optional description. These are not visualized to other users at this time and are for admin purposes only.

  • Click on "Assessment Tools" to load all tools that have been tagged to this EPA.

  • Select the tools that you wish to add assessment plan requirements for. You can add one plan for each tool for a given EPA, or optionally combine the requirements across tools.

Combine Tools Feature

The combine tools feature allows you to combine multiple tools/forms within the same assessment plan, as long as there are shared contextual variables and the entrustment question is the same. You are able to set the plan requirements for the shared variables & scale, and the system will use assessments from all of the selected tools to feed into the dashboard. For example, if you require 4 assessments to be completed at "meets expectations" or above, and it can be either a Field Note or a Supervisor form, the combine tools feature is an easy way to do this.

To combine tools:

  1. Click "Assessment Tools"

  2. Select all of the tools that you wish to combine

  3. At the top of each tool card, click the checkbox at the top right

  4. Click "Combine Tools"

  5. Enter the plan requirements, as outlined below

Assessment Plan Features

  • Minimum number of assessments: Enter the minimum number of assessments required for this EPA using this tool. This number is linked to the global entrustment rating, which means that completed assessments must be equal or higher than the selected rating scale response in order to fulfill the plan.

  • Rating scale responses: Select the minimum level of entrustment or supervision that is required for this EPA. The number entered in the field before this is linked to this response. For example, this EPA required 3 assessments scored at "Almost" or above.

  • Minimum number of assessors: Enter the minimum number of assessors required to complete assessments on this EPA.

  • Contextual Variable Types: Choose how you wish to track your contextual variable responses for this form. At this time, you can only select one contextual variable type. See below for detailed descriptions of each type.

  • Contextual Variables: Select which contextual variables you need to track for this form. Only the contextual variable categories that are on the selected form will be loaded in this dropdown.

  • Combine Tools: See notes above.

Contextual Variable Types

The assessment plan builder leverages the new grouping functionality within contextual variables. Within a given contextual variable, you are now able to create groups of responses. There are four different ways to track contextual variable responses with the assessment plan builder: spread, specific, group (spread), and group (specific).

Spread

The Spread function allows you to check off a selection of contextual variable responses and indicate how many of any of the selected responses need to be assessed to meet the plan.

Specific

The Specific function allows you to check off a selection of contextual variable responses and indicate how many times each of the selected responses need to be assessed to meet the plan.

Group (Specific)

The Group: Specific function allows you to check off a selection of contextual variable responses within a contextual variable group and indicate how many times each of the selected responses need to be assessed to meet the plan. You can select responses from multiple groups within the same contextual variable.

Group (Spread)

The Group: Spread function allows you to select contextual variable groups and indicate how many of any of the grouped responses need to be assessed to meet the plan. You can add multiple groups from within the same contextual variable.

Once you have entered all of the contextual variable requirements, simply click "Save Draft" or "Publish Plan". The assessment plans are are currently leveraged in the CBME Program Dashboard.

Last updated