AAMC CI Reporting
Purpose
This page is intended to outline the configuration and setup requirements for an Elentra organization to generate compatible AAMC CI reports for submission via the AAMC CI Portal.
Current supported version of the Medbiquitious CI Standard: V. 10
Background
The AAMC encourages participitating schools to it regularly report on the school’s offered curriculum (Curriculum Inventory) by submitting a generated curriculum data file.
Schools may generate this file a number of ways, including:
Using an in house system to create the file
Using a vendor supplied curriculum management system to create the file
Schools may submit the file a number of ways, including:
Using an in house system to automatically upload the file to the AAMC
Having the vendor upload the file on behalf of the school using the AAMC Vendor CI Portal
The school themselves uploading the file using the AAMC CI Portal
The submitted curriculum data file is of XML file type.
References
Setup and Configurations
Organization Settings
To generate AAMC CI Reports, Elentra requires that the Organization containing the information to export have certain AAMC required fields set in the Organization settings:
Curriculum Mapping and Hierarchy
AAMC Physician Competencies Reference Set (PCRS) Mapping
The AAMC CI report requires that Program Level Curriculum Tags (referred to as Learning Objectives by the AAMC) used and set in Elentra are mapped to a corresponding AAMC Curriculum Tag. By default, the AAMC Curriculum Tag Set is included by default, labelled ‘AAMC Physician Competencies Reference Set’.
In addition, the mapping must be done from the domain level AAMC Curriculum Tag (lowest level Curriculum Tags in Elentra).
Mapping MUST be done FROM the AAMC Curriculum Tag Set. That is, this AAMC Curriculum Tag Set selected, then for each low level item, mapped to the Curriculum Tags assigned to the Courses outputted in the report.
NOTE: Ensure that NO Map Version is selected. Elentra will not output Curriculum Tags if mapping is done using a Map Version.
Curriculum Hierarchy Overview
The AAMC also strongly recommends that a three level hierarchy exist, and as above, AAMC domain level Curriculum Tags (i.e. AAMC PCRS) as follows:
AAMC Recommended Curriculum Hierarchy
NOTE: Not having the three level hierarchy underneath the AAMC PCRS will generate a valid CI file that passes AAMC validation, however the generated AAMC validation report will be missing certain data.
Curriculum Hierarchy Setup
The above mentioned Curriculum Hierarchy can be setup in Elentra in two ways:
Individual Curriculum Tag Sets
Individual Curriculum Tag Sets can be created in Elentra, and the containing Curriculum Tags Mapped from the Curriculum Tag Set containing the Program Objectives, to the Curriculum Tag Set containing the Course Objectives, to the Curriculum Tag Set Containing the Event Objects
Hierachy Built into Single Curriculum Tag Set
Alternately, the hierachy can be built into a single Curriculum Tag Set, for example:
In the above example, ‘Application of Basic Sciences’ would be a single Program Objective, ‘ME1.1 Homeostatis & Dysregulation’ a single Course Objective, and ‘ME1.1a’ an Event Objective
Courses and Events Objectives
Once the Curriculum Map Hierarchy is setup, Courses and Events should be assigned the required objectives. Curriculum Tag Sets for Courses and Events should only be set for those specifically.
Curriculum Tag Sets are outputted to the AAMC CI Report and assigned only one of the following categories:
program-level-competency: If the parent Curriculum Tag Set was selected as a ‘Program Level Objective’ OR if the individual Curriculum Tags in the CompetencyObject was mapped from an AAMC PCRS Curriculum Tag
sequence-block-level-competency: Not a program-level-competency, and the Curriculum Tag was assigned to the Course (whether or not it was assigned to an Event)
event-level-competency: Not a program-level-competency or a sequence-block-level-competency, and the Curriculum Tag was assigned to an Event but not to any Course
Therefore, if a Course Level Objective Curriculum Tag was assigned to both Courses and Events, it will only be set a category of sequence-block-level-competency. Although this type of issue will pass AAMC validation, the generated report will not contain the required information mapping Events to a Learning Objective if the Event is not associated to an Event Level Objective, and if that Objective is not mapped from a Course Level Objective, and if that Course Level Objective is not mapped from a Program Level Objective, as described above in the Curriculum Hierarchy section.
Course Objectives
Course Objectives are set in the ‘Curriculum Tags’ section of Course Administration. From this view, any Curriculum Tag can be assigned as a Course Objective:
Event Objectives
Event Objectives are set in the ‘Curriculum Tags’ section of Event Administration. From this view, any Curriculum Tag can be assigned as an Event Objective:
NOTE: On first use, the Filter for the Curriculum Tag Set menu may be set to ‘Course’, which limits the selection of Curriculum Tag Sets to those set in as Course Objectives only. This filter must be cleared to allow selection of Event Objectives from other Curriculum Tag Sets not set for the Course (i.e. if the Program-Course-Event hierarchy consists of multiple Curriculum Tag Sets).
Event Medbiquitous Methods
Elentra can assigned three types in Medbiquitous Methods when writing data to the AAMC CI report for each Event:
Instructional Method
Mapped for each Elentra Event Type, such that the Instructional Method written for the Event in the CI report corresponds to that set for the Event’s Event Type in Elentra.
Results in the Event containing sub element ‘InstructionalMethod’ for each Medbiquitous Instructional Method for each of the Event’s Event Types.
Assessment Method
Mapped for each Elentra Gradebook Assessment Characteristic if gradebook assesments are assigned to the Event, otherwise may be set manually for each Event
Results in the Event containing sub element ‘AssessmentMethod’ for of the Event’s selected or assigned Medbiquitous Assessment Methods.
Resource Method
Set manually for each Event
Results in the Event containing sub element ‘ResourceType’ for each selected Medbiquitous Resource Method.
Medbiquitous Methods can be viewed, and the Assessment and Resource Methods set manually, in the Elentra Event Content page:
Note that one of Instructional or Assessment Method is required for the Event to be written to the AAMC CI Report.
If a Learning Event has:
Event Type mapped to a Medbiquitous Instructional Method AND
No Assessment Method assigned THEN
Then it will appear in the AAMC CI Report with only an Instructional Method
If a Learning Event has:
Event Type NOT mapped to any Medbiquitous Instructional Method AND
Assessment Method assigned THEN
Then it will appear in the CI Report with only an Assessment Method
If a Learning Event has:
Event Type mapped to a Medbiquitous Instructional Method AND
Assessment Method assigned THEN
Then it will appear in the CI Report with BOTH an Instructional Method and Assessment Method
Event Assessment Methods
Elentra has two ways in which an Assessment Method is set in the AAMC CI report for an Event:
If a Gradebook Assessment is assigned to a Learning Event, then:
The AAMC CI report will contain the Event with the Assessment Method set to that mapped for the Gradebook Assessment set Characteristic
The Event Title in the AAMC CI report will contain the Assessment’s Name instead of the Event Title
Any Assessment Methods set in the Event’s Content page will be added to the AAMC CI report for the Event as additional Assessment Methods
If no Gradebook Assessment is assigned to a Learning Event, then:
Any Assessment Methods set in the Event’s Content page will be added to the AAMC CI report for the Event as additional Assessment Methods
These two ways are made available due to the two different assumptions some schools make, where the first of the above options assumes a Learning Event is itself an Assessment in that Learners are being assessed on what they learned in the past, whereas the second assumes that the Learning Event is an Instructional one and will be assessed by the set Assessment method at some point in the future.
Report Generation
Elentra AAMC CI Report Generation Process
The Elentra platform allows the AAMC CI report to be generated by selecting Admin → System Reports → AAMC Curriculum Inventory Reporting, which opens the following page:
Selecting to create a new report displays the following:
AAMC CI XML Report Structure
The generate AAMC CI XML Report will contain the following elements:
\
Troubleshooting Submission Errors
Errors with AAMC CI files fall into the following main categories:
File Structure Validation
This is the first check done by the AAMC CI portal upon submission and ensures that major required elements exist in the CI XML file. The portal checks against a defined XSD available here.
Errors appear as a modal on submission, for example:
These errors can be validated before submission by validating the generated CI file against the XSD using an XML validator, or via command line:
xmllint --noout --schema curriculuminventory.xsd <AAMC_CI_XML>.xml
Business Rules Validation
This check is done after submission to ensure the file contents meet the AAMC’s defined CI Business Rules
Details on errors with a submission can be found by selecting ‘Submission error: AAMC CI Business Rules’ in the Activity History for the required school, then clicking the ‘Export’ Button.
Data Issues
Even if the above two validations pass, depending on the data in the file, the AAMC may not process the file in a way to produce the required information for AAMC accreditation. This form of error is harder to detect and depends largely on the Elentra Curriculum Mapping configuration
Possible specific issues include:\