After the provided software migrations run with the upgrade to ME 1.24 or higher, some additional configuration is required for your users to move forward using Elentra as they currently do. Please check all tag set settings for the tags included in your Royal College Framework (Milestones). This is important to ensure that the learner dashboard, program dashboard and assessment plan builder behave as expected.

Although Elentra allows individual programs using a Royal College framework to upload specific Key and Enabling Competencies, organizations are still required to upload a standard list of Key and Enabling Competencies at the organization level.

If you see a warning like the one below, it means your organization still needs to upload standard key and enabling competencies through Manage Curriculum.

Information for Consortium Schools Not Using Royal College Programs

Dummy Data for Consortium Schools Exploring CBE

For Consortium schools who are exploring CBE in Elentra, although you are never going to use the Key and Enabling Competency tag sets, Elentra still requires you to populate these tag sets with some data.

Download these files to have available for the curriculum tag upload.

Upload Key and Enabling Competency Tags

• Navigate to Admin > Manage Curriculum.

• Click 'Curriculum Tags' from the Manage Curriculum card on the left sidebar.

• Click on a curriculum tag set name (e.g. CanMEDS Key Competencies) and then click 'Import from CSV' in the top right.

• Drag and drop or select the appropriate file from your computer and click 'Upload'.

• You will get a success message and the curriculum tags you've added will appear on the screen.

Now that you have fulfilled the requirements of the auto-setup tool, you can begin to create your own curriculum framework as needed.

Information for Royal College Programs

Templates to Import Standard Key and Enabling Competencies

Most organizations will have already completed this step while they were using CBME. If you are testing things or building a new organization for some reason, these files can be used to populate the standard key and enabling competencies. When you build objective trees for individual programs you'll need to prepare KC and EC templates to upload for that program.

Upload Standard Key and Enabling Competency Tags

• Navigate to Admin > Manage Curriculum.

• Click 'Curriculum Tags' from the Manage Curriculum card on the left sidebar.

• Click on a curriculum tag set name (e.g. CanMEDS Key Competencies) and then click 'Import from CSV' in the top right.

• Drag and drop or select the appropriate file from your computer and click 'Upload'.

• You will get a success message and the curriculum tags you've added will appear on the screen.

Now that you have fulfilled the requirements of the auto-setup tool, you can begin to create your own curriculum framework as needed.

A Curriculum Framework defines tag sets and the relationships between those tag sets.

To use the CBE dashboards, you must create a curriculum framework and define the tag set options you'd like to use for each tag set included in the framework. The tag set options will determine things like whether a tag set appears on the assessment trigger interface or whether a tag set is shown on a learner dashboard.

Once a Curriculum Framework is create, you can optionally create an organizational tree or multiple course trees.

Creating an organisational tree is optional and is required only when you have multiple courses that will rely on the same curriculum. Otherwise, once you have built the required framework(s), you can work within a course page to build course trees.

Add a Curriculum Framework

1. Log in as a MedTech or Admin user.

2. Open the Admin drop-down on the top menu and click Manage Curriculum.

3. Click Curriculum Framework Builder in the left-side menu.

4. Click the Add Framework button.

5. In the Adding New Framework box, input the Title of the framework and click the Add Framework button.

6. The new framework will appear in the Curriculum Frameworks table.

7. Rename a framework as needed by clicking the edit icon on the right side of the Curriculum Frameworks table.

Once a Curriculum Framework exists, you need to define the tag sets to include in that framework. You can create new tag sets or add existing tag sets. If you add existing tag sets, you'll still need to upload objectives for those tag sets when you build an objective tree, however you'll be able to manually map tags uploaded through an objective tree to other tags stored in Elentra.

Create a Tag Set

1. From Admin > Manage Curriculum > Curriculum Frameworks, click on the framework to which you want to add tag sets.

2. On the Tag Sets page, click the Create Tag Set button.

3. On the Adding Tag Set page, under the Details section, input the Code, Name, Shortname. These fields are required.

4. Scroll down to select which course(s) the tag set will be associated with.

8. Click the Save button to add the tag set.

Add an Existing Tag Set

Note that even if you add an existing tag set to a curriculum framework, Elentra will still require you to upload objectives to build an objective tree.

1. Click on the framework title in the Curriculum Builder table that you want to add tag sets.

2. On the Tag Sets page, click the Use Existing Tag Set button.

3. On the Use an Existing Objective Set box, use the Existing Objective Set drop-down to select a tag set.

4. Click the Import button.

5. On the Edit Tag Set page, under the Details section, ensure the correct Code, Name, and Shortname appear.

6. Scroll down to ensure the proper course(s) are associated with the tag set.

7. Scroll down to ensure the necessary tag set options are selected, if applicable:
8. Click the Save button to add the tag set.

Manage Tag Set Relationships

This step is necessary to define the relationships between tags. These relationships will help store information properly when you import curriculum tags to create the map of your curriculum.

1. Click on the framework title in the Curriculum Builder table that you want to manage the tag set relationships for.

2. Click on the Relationships tab.

3. Click on the Manage Relationships buttons for the tag set you want to add a relationship.

4. In the Adding Relationships to [insert tag set title] box, use the Relationship Type and Tag Set drop-downs to add the proper relationship.

5. Repeat the above steps for all necessary tag sets. This will create the framework for your CBE Course (program).

Remove a Tag Set

1. On the Curriculum Builder page, select the tag set on the Tag Set table.

2. Click the Remove Tag Set button.

3. On the Remove Objective Sets box, review the instructions:

4. Click the Remove button to delete.

A Course Tree is required for every course, however there are several ways you can create a Course Tree. You can upload curriculum tags per course (appropriate when courses/programs have unique curriculum) or copy an existing Organisation Tree to multiple courses (appropriate when multiple courses share the same curriculum).

Creating a Unique Course Tree

Upload objectives within a course under Admin > Manage Courses.

Step 1

Within a course, select the CBME tab and then the Configure CBME tab to begin Step 1: Configuration. Select Use a curriculum framework as a base and click Next Step.

Step 2

Select a framework in the drop-down and click Next Step.

Step 3

Ensure the objective .csv files are formatted as indicated in the highlighted instructions.

Step 4

For each curriculum tag set,

• Select Default upload or Upload referencing a single parent code

• Select the appropriate file

• Click 'Save and upload (tag set name)'

• Choose a file or drag and drop to add a .csv file.

• A confirmation highlighted in green will display when the file is uploaded successfully.

• Repeat for each curriculum tag set as needed.

Notes:

• If you forget to select the correct Upload radio button (ex. Upload referencing a single parent code), you must reset the upload by going back to Step 1: Configuration in the CBME tab of the course.

Step 5

You can review the new proposed tree structure with the uploaded objectives added. Click the Publish button to save.

Note: if there are errors in the upload, then the objective uploads have not been published. The publish button also does not appear when there is an error. You will need to reset the objective upload. See Notes section in Step 4 of this documentation.

Step 6

A behind the scenes task will run to publish your objective tree and make it visible to you. At most schools, this happens once a day. After sufficient time has passed, you can refresh the Configure CBME tab screen to review and search within the new tree mappings.

Depending on your curriculum framework and organization's needs, you may upload your tag sets within the organizational tree (and then leverage that tree in multiple courses), or you may upload your tag sets through individual courses.

Prerequisite:

The titles of the column headings in the uploaded spreadsheets must be the following:

Two Upload Options:

Default Upload

• The “Parent(s)” field must be specific as to where the objective is to be located in the Curriculum Framework structure:

  • Example: for objective PTYPE1, Parent(s) field may be: “DOCC1-EPA1-POE1, DOCC1-EPA1-POE2” - This will attach objective PTYPE1 to Curriculum Tag PEO1 under EPA1, which is under DOCC1, as well as PEO2, under EPA1, which is under DOCC1.

• Parent(s) field can be empty until used in another upload. For example, objectives at the highest level would be uploaded with the “Parent(s)” field empty.

Sample .csv format:

Sample .csv format:

Upload Referencing a Single Parent Code

• Upload objectives referencing their immediate parent.

  • Example: when uploading objective PTYPE1, the Parent(s) field may only specify “POE1, POE2”. This attaches PTYPE1 to wherever Curriculum Tags POE1 and POE2 appear, no matter their parents or where they appear in the hierarchy.

Sample .csv format:

Sample .csv format:

Uploading Objectives Example

Demo Session

The Core Team recorded a demo session with a complete walk-through of the creation and versioning of Objective Trees:

Overview

Given Curriculum Framework with structure:

DOCC - Domains of Clinical Care

EPA - Entrustable Professional Activity

POE - Phase of Encounter

PTYPE - Procedure Type

P - Procedure

SD/FMR - Skill Dimensions & FM CanMEDs Role

PT - Priority Topic

P&P - Progress & Promotion

When selecting to create a new Objective Tree Version and choosing to Upload, a page will be displayed to allow the user to upload objectives for each of the above Curriculum Tag Sets in the hierarchy, in order of hierarchy:

1. Domains of Clinical Care

2. Progress & Promotion

3. Entrustable Professional Activity

4. Phase of Encounter

5. Skill Dimensions & FM CanMEDs Role

6. Priority Topic

7. Procedure Type

8. Procedure

Note: For each of the above, the user can upload a CSV of objectives and select either Default upload or Upload referencing a single parent code.

Level 1 - Root Level

For Curriculum Tag Sets with no parent in the Curriculum Framework structure, the selected method does not matter, since no Parent is specified for the Objectives.

For example, the following can be used to set objectives for Curriculum Tag Domains of Clinical Care, no matter the upload method since no Parent is specified.

Root Level Objectives

Level 2

In addition, for Curriculum Tag Sets that appear in the second level (below the top) in the Curriculum Framework, the upload method will also not matter since only a single Parent is specified:

Root Level Objectives

In the above example, objective EPA2 has two parents, DOCC2 and DOCC3.

For Curriculum Tag Sets that appear in lower levels than the top in the Curriculum Framework, the selected upload method will matter.

Level 3

Default Upload Method Example

The following is an example of how POE objectives can be uploaded using the Default Method, under EPAs:

The above will set objective POE1 under DOC1-EPA1 in the hierarchy for example. Also note the difference between POE4 and POE5.

POE4 is assigned to EPA2, but only EPA2 under DOCC2 in the hierarchy, where POE5 is assigned to EPA2 under DOCC3:

Single Parent Code Upload Example

The following is an example of how POE objectives can be uploaded using the Single Parent Code method, under EPAs:

In the above, EPA2, no matter where it is in the hierarchy, is assigned the set objectives POE2, POE3, POE4 and PEO5. Therefore, both DOCC2-EPA2, and DOCC3-EPA2 are assigned those objectives.

Subsequent levels would be assigned objectives in a similar way.

Organizations will need to map their CBE curriculum before beginning to use additional CBE tools. Typically central administrative staff will create the required curriculum framework(s). Following that, curriculum can be uploaded at the organization or course level, depending on the needs of an organization.

Due to some legacy code, organizations will have to run some auto-setup tools and populate certain tag sets before they can build their own frameworks.

In the context of Royal College programs, after your CBME migrations are complete, any new program onboarding to CBE will have to map Entrustable Professional Activities, Key and Enabling Competencies, Milestones, Contextual Variable Responses and Procedure Attributes (if using procedure form template).

Overview of CBE Curriculum Set Up

The CBE tools allow an organization to build a curriculum framework to define the structure of their curriculum (e.g., exit competencies, phase objectives, course objectives), and leverage that framework to build objectives trees that house the specific curriculum.

Curriculum Framework

A Curriculum Framework defines a list of tag sets and sets relationships between those tag sets. Elentra will look for that information when an objective tree is built. Objective trees consist of the curriculum tags that users will work with in Elentra.

Objective Trees

Objective Trees are built based on the structure defined in a Curriculum Framework. They define the hierarchical relationships between all of the curricular objectives (tags) included.

A Curriculum Framework may be used to generate multiple Objective Trees and Objective Trees are versioned each time there is a change to them.

There are three types of objective trees:

• Organisation Trees - Use an Organization Tree when multiple courses share identical curriculum. You will be able to apply an organisation tree to courses when you set them up. You create an Organization Tree from the Admin > Manage Curriculum > Curriculum Framework Builder. Then it can be leveraged from Admin > Manage Courses > CBME > Configure CBME.

  • Building an organisation tree is most appropriate when a single curriculum is applied across multiple courses.

• Course Trees - A Course Tree is required for every course, however there are several ways you can create a Course Tree. You can upload curriculum tags per course (appropriate when courses/programs have unique curriculum) or copy an existing Organisation Tree to multiple courses (appropriate when multiple courses share the same curriculum).

• User Trees - Elentra creates unique user trees for learners enrolled in courses that have course trees. Updating a user tree is what allows learners to have different versions of organisation trees applied to them as the curriculum changes. In a typical setup, administrators don’t have to modify user trees that often and there is no initial work to build a user tree. A user tree is automatically created for a user when they are enrolled in a course.

After a curriculum framework, organisation trees and course trees are built, you can use the existing competency-based assessment tools like form templates, assessment plans, learner dashboards and program dashboards.

This step is optional based on your curriculum structure and needs. An Organization Tree makes the most sense to use when multiple courses share identical curriculum. You will be able to apply an organisation tree to multiple courses when you set them up and build their course trees.

Create an Organization Tree

1. Click on the framework title in the Curriculum Builder table where you want to create, or edit an organization tree.

2. Click the Organization Tree tab.

3. On the Create New Organization Tree page, input the Title name.

4. Click the Save and Proceed to Uploader button.

5. At this point you'll be prompted to upload the required files to populate your tree.

6. For each tag set select Default Upload or Upload referencing single parent code.

7. Click Choose a file or drag and drop to add a .csv file.

   Once the .csv file is selected, the upload area will display the file name.

8. Click the Save and upload tag set name button. A confirmation highlighted in green will display when the file is uploaded successfully.

9. Scroll down to click the Next Step button.

10. Continue until all tag sets are populated.

Delete an Organization Tree

1. On the Organization Tree tab, click the trash icon associated with the tree you want to delete.

2. On the Delete an Organization Tree page, click the Delete this tree button.

3. You will receive a notification that the tree was deleted, and the page will return to the Organization Trees table.

To use Elentra's CBE tools, nine required curriculum tag sets must be in place. An auto-setup tool will create the tag sets.

Navigate to Admin > Manage Course > Course (new or existing), and click the CBME tab.

If the required curriculum tag sets aren't yet configured, Elentra will prompt users to auto-setup the required curriculum tag sets and will populate the CanMEDS Roles, Royal College Stages, and Contextual Variables tags. You just do this once for an organization.

Users without permission to use the auto-setup feature will be directed to contact a system administrator with the message below.

After building the required tag sets, Elentra will prompt you to populate a standard list of key and enabling competencies. This is also a relic of CBME supporting Royal College programs but schools exploring CBE can upload dummy data to fulfil this requirement. An organization only has to do this once. Go to the next page to learn how to upload information for the standard key and enabling competency tag sets.

Curriculum Tag Sets Built Through Auto-Setup Tool

Pre-requisite: A developer has already migrated CBME data to CBE.

After migrations have run and you log back into your upgraded Elentra ME 1.24 or higher environment, you can expect to see some automatically generated Curriculum Frameworks.

Since most schools have mapped to Milestones, we'll focus on that framework for demonstrative purposes.

The Royal College Framework (Milestones) framework should look like this:

Where tag set relationships are defined as follows:

You should not need to change anything about this setup.

Please check all tag set settings for the tags included in your Royal College Framework (Milestones). This is important to ensure that the learner dashboard, program dashboard and assessment plan builder behave as expected. (See recommended tag set settings in Step 8 on the next page.)

The following steps are for manual setup and not migrated data.

1. Go to Admin > Manage Curriculum.

2. Click Curriculum Framework Builder in the left sidebar.

3. Click Add Framework on the right.

4. Provide a title and click Add Framework.

5. The framework will be created and you can scroll to the bottom of the list of frameworks to find it.

6. Click on the framework name to open it and configure its tag sets.

7. Because the CBME auto-setup tool has run, all tag sets required for a RC program should already exist. Click Use Existing Tag Set, then select the appropriate existing objective set and click Import. Build your curriculum framework as follows:

1. Next, from the Tag Sets tab and click on each tag set to configure its tag set options.

• For Royal College Stages:

  • Set as applicable to All Courses

  • Framework Specific Options

    • Allow tag set to be used as a filter on the dashboard

    • Group Program Dashboard progress by this tag

    • Allow tag set to be used as a filter on Program Dashboard

  • Form Options

    • None

  • Advanced Options

    • This objective set is a container of its children

    • This objective set uses objective ordinality (set as D,F,C,P)
• For Entrustable Professional Activities:

  • Set as applicable to All Courses

  • Framework Specific Options

    • Check all EXCEPT 'Group Program Dashboard progress by this tag'

  • Form Options

    • Check 'Allow tag set to be added to form templates'

  • Advanced Options

    • Check 'This objective set is a primary competency'

    • Check 'Allow tagset to be used as a filter in the triggering interface'

      • Set Label as "Current Stage EPAs"

• For Roles:

  • Set as applicable to All Courses

  • Make no additional selections

• For Key Competencies:

  • Set as applicable to All Courses

• For Enabling Competencies:

  • Set as applicable to All Courses

• For Milestones:

  • Set as applicable to All Courses

  • Framework Specific Options

    • Check 'Allow tag set to be used as a filter on the dashboard'

  • Form Options

    • Check 'Make available when any parent tag set is added to a supervisor form template'

  • Advanced Options

    • None

1. After all required tag sets are configured, click the Relationships tab. Click on each tag set to define its relationship. Set the relationships between tag sets as follows:
2. Create a course in Manage Courses.

3. Follow the tab flow under the Configure CBME tab in the course under Manage Courses to upload curriculum tags.

In the context of Royal College programs, each program will upload its own curriculum via Admin > Manage Courses/Programs > CBME > Configure CBME.

Preparing Templates for RC Curriculum Imports

csv files prepared for RC program curriculum imports should include the following column headings:

• Parent(s)

• Code

• Name

• Description

• Detailed Description

While all tag sets should include code and name information, the full parent path is only required on the milestone template. The other curriculum tag sets can by uploaded with no parents at all.

Importing RC Program Curriculum

1. Navigate to the Configure CBME tab. Select Use a curriculum framework as a base and click Next Step.

2. Select a framework in the drop-down and click Next Step.

3. Complete the required upload for each tag set.

• Reminder: While all tag sets should include code and name information, when using the default upload method, the full parent path is only required on the milestone template. The other curriculum tag sets can by uploaded with no parents at all.

• Select an upload method.

  • For the Stages upload, ensure the Default upload option is selected.

  • For the Entrustable Professional Activities upload, ensure the Default option is selected.

  • For the Roles upload, ensure the Default upload option is selected.

  • For the Key Competency upload, ensure the Default upload option is selected.

  • For the Enabling Competency upload, ensure the Default upload option is selected.

  • For the Milestones upload, ensure the Default upload option is selected.

• Drag and drop a file into the appropriate space. You will see the file name when the file is there.

• Click Save and upload and you'll see a green success message.

Notes:

• If you forget to select the correct Upload radio button (e.g., Upload referencing a single parent code), you must reset the upload by going back to Step 1: Configuration in the CBME tab of the course or in the Organization Trees section of the Curriculum Framework Builder.

1. You can review the new proposed tree structure with the uploaded objectives added. Click the Publish button to save.

Note: If there are errors in the upload, the green Publish button will not display and you will be unable to publish. You will need to reset the objective upload. See Notes section in step 3 of this documentation.

1. After you publish your course tree, a behind the scenes task must run for the curriculum to publish. At many schools this happens once a night. After time has passed, you can refresh the Configure CBME tab screen to view the imported curriculum.

Sample Data For Curriculum Tag Uploads

Please reach out to the Consortium Core Team on Slack if you are a Consortium school and are looking for some sample data to test CBE with.

This template organizes the information about Roles and allows the information to be uploaded to Elentra.

Completing the Roles Template

Every program can use the same Roles template when they upload their program curriculum.

• Parent(s): This can be left blank because you will provide the full parent path in the Milestones Template.

• Code: Provide the code for the role

  • ME, CL, CM, LD, HA, SC, PR

• Name: Provide the full role text

  • ME: Medical Expert

    CM: Communicator CL: Collaborator LD: Leader HA: Health Advocate SC: Scholar PR: Professional

• Description: Not required but complete with CanMEDS information as you wish.

• Detailed Description: Not required.

• Save your file as a CSV.

This template organizes the information about Stages and allows the information to be uploaded to Elentra.

Completing the Stages Template

Every program can use the same Stages template when they upload their program curriculum.

• Parent(s): This column can be left blank.

• Code: Provide the code (i.e., D, F, C, P).

• Name: Provide the full stage name text

  • D: Transition to Discipline F: Foundations of Discipline C: Core Discipline P: Transition to Practice

• Description: Not required.

• Detailed Description: Not required.

• Save your file as a CSV.

This template organizes the information about EPAs and allows the information to be uploaded to Elentra.

Completing the EPA Template

Each program should complete an EPA template with the following information:

• Parent(s): This can be left blank because you will provide the full parent path in the Milestones Template. If you prefer to complete this column, you can indicate the parent of the EPA which is the Stage (i.e., D, F, C, P)

• Code: Indicate the EPA code (e.g., C1, C2, C3). Note that there is no space between the letter and number in the EPA Code.

  • EPA codes should be recorded in uppercase letters and include the learner stage of training and the EPA number. Use the learner stage letters outlined below to ensure that the EPAs correctly map to other curriculum tags. D: Transition to Discipline F: Foundations of Discipline C: Core Discipline P: Transition to Practice

• Name: Provide the competency text

• Description: Provide additional detail about the EPA as required.

• Detailed Description: Not every program will use the ‘Detailed Description’ column.

• Save your file as a CSV.

This template organizes the information about Enabling Competencies and allows the information to be uploaded to Elentra.

Completing the Program-Specific Enabling Competencies Template

• Parent(s): This column is optional because you will provide the full parent path in the Milestones template.

  • If you do chose to populate this columns, indicate the parent(s) of the enabling competency by providing the stage, EPA, role, and key competency (e.g., C-C1-ME-ME1)

• Code: Indicate the enabling competency code (e.g., ME1.1, CL2.3, HA3.4)

• Name: Provide the enabling competency text.

• Description: Not required but complete with CanMEDS information as you wish.

• Detailed Description: Not required.

• Save your file as a CSV.

When working with tag set in the context of the Curriculum Framework Builder, an administrator must configure the settings for each tag set. These settings tell Elentra which tag sets to show on the learner and program dashboard, which tag sets should be accessible as filters and in the Assessment Plan, etc.

Framework Specific Options

Show on Dashboard

Select this to have a tag set display on the learner dashboard.

When this option is selected, a dashboard scale can also be selected. The dashboard scale will display and allow progress reviewers with permission to set a status for the objective (when clicking the status circle). If a user doesn't have permission to set the status for an objective, they will only be able to see the status.

In this example, the tag set "Direct Observations" was set to show in dashboard.

Display Under Parent on Dashboard

This tag set option will display the objectives under their parents as categories on the dashboard.

"EPAs" are displayed under their parent, "Stages", on the Learner Dashboard

Allow tag set to be used as a filter on the dashboard

This option will add the tag set as a filter on the learner dashboard.

Allow tag set to be triggered

This option should be selected if the tags will be used when triggering on-demand assessments.

Allow tag set to be mapped to clinical experiences

This option allows the tag set to be mapped to clinical experiences (i.e., rotations).

Allow tag set to be used with Assessment Plans

This option should be selected if the tag set is to be used in the assessment plan builder.

Allow tag set to be displayed on the Program Dashboard

This option will allow the tag set to be displayed on the program dashboard.

Group Program Dashboard progress by this tag

This option will group children of this tag set on the program dashboard.

Allow tag set to be used as a filter on the Program Dashboard

This option will use the tag set as a filter on the program dashboard.

Allow editing of objective text

This option does not currently impact the user interface in any way.

The intention is to allow users to edit curriculum tags at the Course level to accommodate unique course/program needs. This has not yet been implemented.

Form options

Allow tag set to be shown on a smart tag form

This option will add this tag set as a smart tag item on the smart tag form templates. Smart tag items will display the mapping of the triggered branch after the form has been generated.

Allow tag set to be added to form templates

This option will allow this tag set to be used on CBE form templates (Supervisor Form, Procedure Form, Field Note Form).

Make available when any parent tag set is added to a supervisor form template

This option will add this tag set as a mapped objective on Supervisor form templates. You would primarily use this option when you have children of a parent and you want to add the parent tag to a Supervisor form and have the child tags automatically pulled into the form for use.

Advanced Options

This objective set is a primary competency

This is meant to show an EPA; where we expect to show EPA related information, this option allows the objective set to be used in its place.

This is also important to select as the child of a primary objective (example: Parent - Stages, Child - EPAs).

You will want to select this to ensure all children and grandchildren of this tag set/objective set will be displayed in the objective tree mapping for your CBE course.

Allow tag set to be used as a filter in the triggering interface

This option sets the tag set as a filter when initiating tasks on-demand.

If the objective is a primary competency, this filter will display the set of objectives the learner is currently in-progress (e.g., Display EPAs by the current stage). When this option is selected, name the filter.

This objective set is a container of its related children

This option may be used if your curriculum uses stages. For example, your learners must complete a foundations stage before they move into a core stage.

Apply ordering at this objective set's hierarchical depth

This option determines that ordered objectives must start at the depth of this tag set. This is relevant when multiple types appear on the same depth. The tree in the example below is the Framework and not actual branches of objectives. If the order for B is set as a value of 2, and the order for C is set to 1 and D is left unset, then, the relevant interfaces (currently, only Smart Tag Triggering) would render as such: C, B, D

Use Case

When two objectives live on the same level, both are triggerable and you would like to identify which order they should be displayed in. Relevant to smart tag form triggering.

This objective set utilizes objective ordinality

Objective code list (order of objectives in this set)

• Clicking this option allows you to enter the order of the objective codes on each tag in this tag set, in the order that the learner will complete it. In the case of the Stages tag set, enter D,F,C,P. This indicates that the learner would complete the D, F, C, P objective codes in this tag set, in this order.

• This applies to curriculum versioning.

Uploading Templates

All templates you upload to the system must be in .csv format.

If you are working in Excel or another spreadsheet manager use the “Save as” function to select and save your file as a .csv

To upload your files, either search for or drag and drop the file into place. You'll often see a green checkmark when your file is successfully uploaded.

If you receive an error message make sure that you have:

• Deleted any unused lines. This is especially relevant in templates with pre-populated columns including the contextual variables template, and enabling competencies mapping template.

• Completed all required columns. If a column is empty for a specific line the file may fail to upload.

Viewing Curriculum Maps

If you've imported all CBME data for a program but you are not able to see EPA maps in the EPA Encyclopedia or in the Configure CBME tab, double check that you've uploaded your files without spaces between the EPA Code letter and number, nor between the CanMEDS Role and Key Competency number. Having spaces in the incorrect places will prevent the system from retrieving the required information to produce maps.

Mistakes When Mapping Relationships

While you can correct minor typos and add additional mapping info. through the user interface you can not delete, nor undo mapping between tag sets.

The option to reset all CBME data for a program was removed in a previous Elentra version.

What do I need to do to prepare?

Please ensure that you have documented any changes that will need to be made, in addition to creating (or modifying) new CSV templates for upload. From the user interface, you will be able to indicate:

• Whether an EPA is changing, not changing, or being retired

• Within each EPA that has been marked as changing, indicate if any KC, EC, or Milestones will be changing, not changing, or retired

• If you are adding milestones to an EPA, mark it as changing so that the uploader will add the new milestones

• Entirely new EPAs will be detected by the uploader without you needing to indicate anything. For example, if you currently have D1, D2, and D3, but will be adding a D4 and D5, the system will detect these in your spreadsheet and add them to the new curriculum.

• Please ensure that all of your learners are in the correct stage (on their CBE Dashboards) prior to publishing a new curriculum version. Remember: a green checkmark on the stage indicates that the learner has completed that stage. A learner is currently in the stage that comes after the last green stage checkmark.

Which CSV files do I need to have ready?

Assuming that new EPAs are being introduced or EPAs are changing, you'll need the following:

1. Stages Template (if adding new EPAs)

2. EPA Template

3. Milestone Template

4. Any new program-specific Key and Enabling Competencies if application

Create a New Curriculum Version

Navigate to the CBE Sub-Module

1. Log in to Elentra.

2. Click "Admin" at top right

3. Click "Manage Programs"

4. Select your program.

5. Click "CBME"

6. Click "Configure CBME".

Add New Version

1. Click "Actions"

2. Click "Add New Version"

Step 1: Configuration

1. Indicate which versioning method to use.

   For existing Royal College Programs, select "Use an existing tree version as a base."

2. Click "Next Step"

Step 2: Select Course Tree Version

1. Choose a tree version from the dropdown selector.

2. After you make a choice, you'll be presented with a preview of the existing tree.

3. Click "Next Step"

Note: Each program can only have one version "in progress" at a time. You can continue editing that new version, or reset the progress.

Step 3: Select Tree Status

1. Set the status of curriculum tags as needed. Note the option to apply a parent objective's status to its children.

   1. If you are adding milestones to an EPA, mark the EPA as changing so that the uploader will add the new milestones

   2. Entirely new EPAs will be detected by the uploader without you needing to indicate anything. For example, if you currently have D1, D2, and D3, but will be adding a D4 and D5, the system will detect these in your spreadsheet and add them to the new curriculum.

2. Click "Next Step"

Not Changing

The objective will remain unchanged. This exact version of the objective will be carried-forward into the new curriculum version. Note that selecting this option will stop any objectives with the same code from being uploaded.

Changing

The objective will be changing. This will allow you to upload new objective text. For a child objective (e.g. milestones), if you select “Changing” for that objective under one EPA, the system will update all other instances of that objective to “Changing”. This will ensure that you only have one version of that objective.

If there are any children in a Changing parent objective that you want removed, you MUST mark them as Retired. (For Royal College programs, this is with respect to the Milestone code - if "C PR4.3.2" will no longer be in an EPA, mark it as retired.)

Retired

The selected objective and all of its children will not be included in the next version. Any status changes for any of this objective's children will be ignored.

If you include an objective with the retired code in the spreadsheet, it will not get uploaded.

For Royal College programs, you are unlikely to use this status for EPAs unless there is an EPA at the end of your numbering that is being removed. For example, you have D1, D2, D3, D4 currently. You are retiring D4 from the next version and no new D4 will be uploaded.

For child objectives, a “Retired” status will remove that objective from only its parent in the new version. This means that there will be no new version of that child for that parent. Elentra will not retire the child from other parents unless you explicitly tell it to.

Step 4: Upload Objectives

1. Upload files for any tag sets with changing or retired status or where new tags will be added.

   1. You typically do not need to re-upload files for tag sets that aren't changing (e.g., stages, roles, key and enabling competencies).

2. If your files are missing information, Elentra will present you with a warning and ask you to re-upload your information.

3. If your file upload is successful, you will see a preview of your new course tree.

4. Click "Next Step"

Step 5: Confirmation

1. You will be presented with a preview of the course tree.

2. After reviewing all information is complete, click "Publish"

Build and Publish Assessment Tools for the New Version

After you publish a new curriculum version, you will need to build assessment tools for all of the new or changing objectives before learners can be assessed on them. Even after the published curriculum version is live, learners will not be able to be assessed on any new/changed objectives until the new assessment tools have been built.

For Royal College programs, remember that in most cases this will have minimal impact, since the learners only get the new version for the stages beyond the one they are currently in.

Please do not delete forms or form templates from previous versions unless you are certain that there are no longer any learners using that version.

Periodically an organization or course's CBE curriculum may be updated. Elentra can store multiple versions of a CBE curriculum and associate different learners with different versions as needed.

When a new curriculum version is introduced, administrators have the option of versioning an organization tree or a course tree.

For organizations using CBE outside the context of a Royal College curriculum framework, if a new curriculum version is added, you'll need to use the Modify User-Tree Versions option to assign the new version to any existing user whose user-tree you want to update to point to the new curriculum version.

The remainder of this information is for programs using a Royal College (Milestones) curriculum framework.

For Royal College Programs, new curriculum versions will be applied to each CBME-enabled learner at the stage level. This means that if a learner is currently in Foundations, they will retain the previous curriculum version in Transition to Discipline and Foundations of Discipline, but will be given the new curriculum version in Core and Transition to Practice. Please ensure that all of your learners are in the correct stage (on their CBE Dashboards) prior to publishing a new curriculum version. Remember: a green checkmark on the stage indicates that the learner has completed that stage. A learner is currently in the stage that comes after the last green stage checkmark.

After an administrator has published a new version, they will need to build tools for all of the new or changing EPAs before learners can be assessed on them.

Main Steps in Creating a New CBE Curriculum Version

1. Prepare required CSV files

2. Add new curriculum version

3. Create any new Contextual Variable responses as needed and update Procedure criteria (per EPA) if applicable

   1. Contextual variable responses are not specific to curriculum versions, with the exception of procedure criteria uploaded per specific EPA. When a new curriculum version is added you’ll see a version picker display on the CV responses tab, but edits made to CV responses in any version will be reflected across all versions.

4. Build new assessment tools for changed or added curriculum tags

5. Build an assessment plan for the new curriculum version

6. Update mappings, and priority and likelihood ratings on rotations if applicable

   1. If a course uses the Clinical Experience Rotation Scheduler and has mapped curriculum tags to specific rotations and assigned priority and likelihood ratings, these will be copied forward for all unchanging curriculum tags. If a new curriculum tag has been added in a version, you’ll need to map it and provide a priority and likelihood rating if required.

7. Reset any user-trees as needed

Expectations After Versioning

For Royal College programs, learners will be assigned the new curriculum version for any upcoming stages they still need to complete.

Learner Dashboard

• Completed and current stages for a learner will retain their previous curriculum version(s).

• Future stages for a learner will be updated to the new curriculum version.

• The version applied to each stage and viewed to the right of the stage name (small grey badge) should be updated to reflect the new curriculum version for future stages

• Any assessment tasks completed on a learner in a future stage for EPAs that have been updated in the new curriculum version should move to "Archived Assessments"

• The "What's Left" modal showing the Assessment Plan requirements per EPA will only update for a learner after a new assessment plan is published.

Program Dashboard

• Each learner's list of EPAs will reflect their curriculum version (so, one user may show D1, D2, and D3 and another user may show D1, D2, D3 and D4 if they are on version 2 for stage D and D4 was added in version 2).

Visual Summary Dashboards

• More information coming soon.

EPA Encyclopedia

• Updates in Elentra ME 1.26 mean that learners should see their unique user-trees when viewing the EPA Encyclopedia (i.e., they'll see different curriculum versions applied to different stages).

Completing Assessments

• When initiating an assessment, only the EPAs and associated forms relevant to a specific learner will be displayed. Faculty or admin will not have to choose between multiple versions of on-demand forms for a given learner.

The process to build new assessment tools after curriculum versioning is relatively straight-forward. Administrators need to build new assessment tools for new EPAs or EPAs that have changed. Assessment tools will be carried over for all EPAs that were marked as "not changing."

Building Form Templates for New EPA Versions

1. Navigate to Admin > Assessment and Evaluation.

2. Click ‘Form Templates’ on the tab menu.

3. Click the green ‘Add Form Template’ button in the top right and a pop-up window will appear.

4. Type in a form name and select the form type from the dropdown menu. Select the appropriate form template and course (e.g., ‘Supervisor Form’, Pediatrics).

   1. Now that you have two (or more) curriculum versions in the system, the Form Template Builder will default to loading the most recent version.

   2. If you want to build new forms for learners using a previous version, change the EPA Version to what you want, click 'Save', and Elentra will load the appropriate EPAs.

5. Complete the sections of the form builder. This is the same as any previous form building but see details below as needed.

1. Publish Form Template

   1. Click 'Publish' to make your template available for use. The forms will be available within the hour.

On each form template you create you’ll notice a greyed out area at the bottom including Next Steps, Concerns, and a place for feedback. This is default form content that cannot be changed.

Once a form template has been published, you can rearrange the template components for each form; however, you cannot makes changes to the scales or contextual variables. To make these changes, copy the form template and create a new version.

Building Rubrics and PPA Forms for New EPA Versions

1. Click Admin > Assessment & Evaluation.

2. Click on Forms from the subtab menu

3. Click Add Form.

4. Provide a form name and select PPA Form or Rubric/Flex Form from the Form Type dropdown menu; then click Add Form.

   1. Now that you have two (or more) curriculum versions in the system, the Form Editor will default to loading the most recent version. Under "EPA Version", simply select the appropriate version. Click Save.

   2. If you want to build new forms for learners using Version 1, simply change the EPA Version to Version 1 and it will load the appropriate EPAs.

5. In order to use the "Programs" filter in the form bank, you need to add Program-level permissions to each form so it is recommended you do so.

   1. Click "Individual", change to "Program"

   2. Begin typing in your program name in the "Permissions" box.

   3. Click on your program to add it.

6. Complete the sections of the form builder. This is the same as any previous form building but see details below as needed.

1. Publish Form Template

   1. Click 'Publish' to make your template available for use. The forms will be available within the hour.

The default Feedback and Concerns sections will be added when the form is published.

Within a given contextual variable, you are able to create groups of responses. This is leveraged in the assessment plan builder to allow you to specify exactly what requirements learners must meet.

You must be in an administrative role to manage contextual variables.

• Click Admin > Manage Courses

• Beside the appropriate program name, click the small gear icon, then click "CBME"

• Click on the "CV Responses" tab

• Click on any contextual variable category to expand the card. To add a new group within that contextual variable, click on the green "Manage Groups" button.

• To add a new group, click "Add Group". To edit an existing group, click on the group title.

• Add a title for the contextual variable group and an optional description. Check off all responses that you wish to add to the group and then click "Save Group".

• After saving, you can now use the Group contextual variable types within the assessment plan builder.

Contextual Variable Responses are used to describe the context in which a learner completes something. Examples of contextual variables include diagnosis, clinical presentation, clinical setting, case complexity, patient demographics, etc. For each variable, courses must define a list of response options. For example, under clinical presentation, a course might include cough, dyspnea, hemoptysis, etc.

Elentra will autosetup a list of contextual variables in the Manage Curriculum interface. Institutions can also add contextual variables (e.g., assessor's role) to this list before uploading contextual variable responses (e.g., nurse, physician, senior resident) via each course CBE tab. Elentra provides access to the same Contextual Variables for all courses. Courses can customize their list of contextual variable responses, but all courses will all see the same list of contextual variables. For this reason we strongly recommend that you work with your courses to standardize the list of contextual variables loaded into Elentra. If you do not, you risk eventually have hundreds of contextual variables that all course administrative staff have to sort through, whether they apply to their course or not.

Elentra will auto-create the following Contextual Variables for a CBE-enabled organization. Do not delete any of these or your users will be prompted to run the auto-setup tool again.

Add Additional Contextual Variables to an Organization

Institutions can add additional contextual variables to make available to their programs through Admin > Manage Curriculum. Group and role permissions of medtech:admin or staff:admin are required to do this. If you add a contextual variable to the organization wide tag set, courses will be able to upload their own contextual variable responses for the tag.

• Navigate to Admin > Manage Curriculum.

• Click on 'Curriculum Tags' from the Manage Curriculum Card on the left sidebar.

• Click on the Contextual Variables tag set.

• Click 'Add Tag' or 'Import from CSV' to add additional tags (more detail regarding managing curriculum tags is available here).

• Any new tags you add to the Contextual Variable tag set (e.g. observer role, consult type, domain) will be visible to and useable by all programs within your organization.

• When you add new tags to the tag set, you'll be required to provide a code and title. It is recommended that you make the code and title the same, but separate the words in the code with underscores. For example: Title: Observer Role Code: observer_role

• Note that there is a 24 character limit for curriculum tag codes and a 240 character limit for curriculum tag titles. If you enter more characters than the limit, the system will automatically cut off your entry at the maximum characters.

• After you have added Contextual Variables to the existing tag set, programs will be able to add the new response codes (and responses) to the contextual variable response template and successfully import them.

Import Contextual Variable Responses per Course

Once you have built out the list of all contextual variables you want included in the system you can import specific contextual variable responses for each course.

First, build a spreadsheet that includes the CV response category and individual CV responses. You can use this file as a starting place:

The contextual variable response spreadsheet should have the following information:

• Response Code: This column should include all contextual variables applicable to the course/program (e.g., assessor’s role, basis of assessment, case complexity, case type). Make sure to use the exact response code all contextual variable tags in the response_code column.

• Response: In this column, you can add the response variables required for a course (e.g. Case complexity response variables: low, medium, high). To add more than one response variable per response code, simply insert another line and fill in both the response code and response columns.

• Description (optional): This field is not seen by users at this point and simply serves as metadata.

• Save as a CSV file.

Upload A Completed Contextual Variable Response Spreadsheet

• Navigate to Admin > Manage Courses.

• From the cog menu beside the course name, select 'CBE.'

• From the tab menu below the Competency-Based Education header, click 'CV Responses'.

• Click 'Upload CV Responses'.

• Drag and drop or search your computer for the appropriate file.

• Click 'Save and upload Contextual Variable Responses'.

• When the upload is complete you'll be able to click on any contextual variable and view the responses you've added.

When importing data to create EPA maps, programs are required to upload a contextual variable template to provide contextual variable response options (e.g. case complexity: low, medium, high). In addition to this information, programs will need to add specific details about any procedures included in their contextual variable response options. This additional information, called procedure attributes, plays an important part in building procedure assessment forms. Think of the procedure attributes as assessment criteria (e.g. obtained informed consent, appropriately directed assistants, etc.) for each procedure .

Required Information for Procedure Attributes CSV File

For each procedure in your program, you must define headings, rubrics and list items that may be used to assess a learner completing the procedure. Headings appear at the top of a form, rubric becomes the subtitle of a rubric, and list items are the things that will actually be assessed on the rubric.

All this information must be stored and uploaded in a CSV spreadsheet that uses two columns: Type and Title.

Within ‘Type’ there are three things you can include: H to represent heading (e.g. Participate in Surgical Procedures, NG Insertion) R to represent rubric (e.g. Procedure, Pre-Procedure) L to represent list items (e.g. Apply knowledge of anatomy)

The three procedure criteria form a hierarchy. A heading can have multiple rubrics, and a rubric can have multiple list items. Arrange the criteria in your spreadsheet to reflect their nesting hierarchies.

In the 'Title' column enter the information to be uploaded.

When complete, save the file in a CSV format.

Sample Procedure Form On this sample form, the following information was uploaded as procedure attributes: H: Participate in Surgical Procedures R: Procedure L: (ME1.3.2) Apply knowledge... (ME3.4.2) Perform procedural tasks... Use common surgical instruments...

Uploading Procedure Attributes

• Navigate to Admin > Manage Courses.

• From the cog menu beside the course name, select 'CBME.'

• From the tab menu below the Competency-Based Medical Education header, click **'**CV Responses'.

• From the list of contextual variables, click on ‘Procedure’.

• Before uploading procedure attributes, make sure you are working with the correct CBME curriculum version and change the version as needed.

• Beside each procedure you will see a small black up arrow under the Criteria column.

• Click on the arrow to upload a .csv file of information for each procedure.

• You must indicate an EPA to associate the procedure attributes with (note that you can select all as needed).

• Either choose your file name from a list or drag and drop a file into place.

• Click ‘Save and upload criteria’.

• You will get a success message that your file has been successfully uploaded. Click 'Close'.

• After procedure attributes have been uploaded for at least one EPA you will see a green checkmark in the Criteria column.

• Click the green disk in the Save column to save your work. You will get a green success message at the bottom of the screen.

• Repeat this process for each procedure and each relevant EPA. Remember, a program can use the same procedure attributes for multiple procedures and EPAs if appropriate.

Managing Existing Procedure Attributes

• You can view the procedure attributes already uploaded to a procedure by clicking on the green check mark in the criteria column.

• You will see which EPAs have had procedure attributes added and can expand an EPA to see specific details by clicking on the chevron to the right of the EPA.

After a program has uploaded an initial set of contextual variable responses, they can be managed through the CBME tab.

• Navigate to Admin > Manage Courses/Programs.

• Search for the appropriate course as needed and from the cog menu on the right, select 'CBME'.

• Click on 'CV Responses' from the tab menu below the Competency-Based Medical Education heading.

• To modify the contextual variable responses, click the title of the contextual variable or click 'Show' to the right of the one you want to edit.

• To edit an existing response, make the required change and click the green disk icon in the Save column.

• To delete an existing response, click the red minus button beside the response.

• To add a new contextual variable response, click 'Add Response' at the bottom of the category window. This will open a blank response space at the end of the list. Fill in the required content and save.

Troubleshooting

If you get a yellow bar across the screen when you try to modify contextual variables it means none have been uploaded for the program you are working in. Return to the Import CBME tab and complete Step 4.

This template organizes the information about Enabling Competencies and allows the information to be uploaded to Elentra.

Completing the Milestones Template

• Parent(s): In the parent column you must indicate the full parent path for all milestones. This should include stage, EPA, role, key competency and enabling competency (e.g., C-C1-ME-ME1-ME1.1)

• Code: Codes should be recorded in uppercase letters. The format for the milestone code is: Leaner Stage letter, followed by a space, CanMEDS Role letters, Key Competency number, followed by a period, Enabling Competency number, followed by a period, Milestone number.

  • Note that there should be no space between the CanMEDS Role letter and the Key Competency number.

  • Creating and confirming your Milestones codes takes patience. You'll likely notice that in some Royal College (RC) documents there is only a two digit milestone code. For the purposes of mapping your curriculum in Elentra, you must have three digit milestone codes. We recommend you add the third digit in the order the milestones appear in the RC documents you're using. Make sure you check for duplication as you go so that unique milestones have their own codes but different codes aren't applied to repeating milestones (within one stage). Using the data organization tools to reorder the milestone code columns and title columns can help you identify unneeded duplication.

  • You may also notice that the RC allows programs to use milestones coded from one stage in another stage (so you may see an F milestone in a C stage EPA). How programs and organizations handle this is ultimately up to them but we recommend that you align the milestone code with the stage that it is actually being assessed in/mapped to. For example, if it’s a “D” milestone being mapped to an F EPA, rename it as an “F” milestone. This is because you likely have a different expectation of performance on the milestone in a different stage, even if it’s the same task.

• Name: Provide the text of the milestone as provided by the Royal College.

• Description: Not required but complete with CanMEDS information as you wish.

• Detailed Description: Not required.

• Save your file as a CSV.

This template organizes the information about Key Competencies and allows the information to be uploaded to Elentra.

Completing the Program-Specific Key Competencies Template

• Parent(s): This column is optional because you will provide the full parent path in the Milestones template.

  • If you do chose to populate this columns, indicate the parent(s) of the enabling competency by providing the stage, EPA, and role (e.g., C-C1-PR).

• Code: Indicate the key competency code (e.g., ME1, CL2, HA3)

• Name: Provide the key competency text

• Description: Not required but complete with CanMEDS information as you wish.

• Detailed Description: Not required.

• Save your file as a CSV.

Reordering Contextual Variable Responses

• Navigate to Admin > Manage Courses/Programs.

• Search for the appropriate course as needed.

• From the cog menu on the right, select 'CBME'.

• Click on 'CV Responses' from the tab menu below the Competency-Based Medical Education heading.

• Click on a contextual variable to show its existing responses.

• Click on the double arrow in the Order column to drag and drop a response to a new location.

• You'll get a green success message that your change has been saved.

Reordering Contextual Variables List

If users want to reorder the overall list of contextual variables they can do so from Admin > Manage Curriculum. To change a tag's display order you need to edit the tag by clicking on the pencil icon beside a tag name. Then you need to adjust the display order for each individual tag.

After sufficient information has been added to the system, a user can generate a map showing the connections between EPAs, roles, key competencies, enabling competencies, and milestones.

EPA Encyclopedia

Some schools opt to include a link to the EPA Encyclopedia from Helpful Links. Otherwise users can access the EPA Encyclopedia when initiating an assessment.

There are several filter options when viewing the EPA Encyclopedia.

1. Search for a specific learner. After you select a learner the page will refresh to show that learner's program(s).

2. Switch between multiple programs as needed.

3. Search for a specific EPA by typing in an EPA code or key word. Elentra will search the EPA title, detailed description and entrustment for a match.

4. Switch between CBME Curriculum versions as needed.

After clicking on an EPA, click on Detailed Description, Entrustment or Program Map to view details about the EPA.

Viewing Maps from the CBE page

This option is only available to users with Admin > Manage Courses access (e.g. program directors, curriculum coordinators, program coordinators).

• Navigate to Admin > Manage course/program and select a course.

• Click CBME and the Map Curriculum tab.

• Scroll down to click on an EPA or type the beginning of the EPA code and title into the dialogue box and click on the relevant EPA when it appears below.

• Hover the mouse over a point on the map to view the complete text for the mapped item.

Please see information .

Elentra allows you to map EPAs to specific rotations and indicate for each rotation whether an EPA is a priority and how likely a learner is to encounter the EPA. For this information to be useful for learners, you must be using the Elentra Rotation Scheduler.

From the CBME dashboard, EPAs can display their priority and the likelihood of being encountered within a learner's rotation. Additionally, EPAs relevant to the learner's current rotation are outlined.

When learners and faculty trigger assessments they will also have the option to apply pre-set filters (e.g. priority EPA, current stage EPAs). All of these tools can help learners quickly identify EPAs to focus on in their clinical work.

Adding Priority and Likelihood Levels

• Navigate to Admin > Clinical Experience.

• Click on the Rotation Schedule tab.

• Create a draft schedule or open a published schedule. Note that if you are creating a new rotation schedule, you will also need to add rotations to the schedule.

• Once rotations exist within a schedule a small Objectives badge will appear beside the rotation name.

• Click on the CBME Objectives badge to open a list of EPAs tagged to the rotation.

• Click the plus sign beside any EPA you'd like to label with priority or likelihood.

• Indicate the likelihood by clicking on the appropriate button in the Likelihood.

• Set an EPA as a priority by clicking the exclamation mark in the priority column.

• Repeat as necessary.

• Return to the rotations list using the Back to Rotations button in the top right. \