Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
A variety of system reports are available to different users in Elentra. Some reports can be accessed from other screens, but most reports are accessed via Admin > System Reports.
Not all reports will be visible to all users and learners have no access to system reports (learners can access some reports on themselves depending on how you use Assessment and Evaluation).
Please note there are some specific reporting options for Courses, Course Websites, and Assessment and Evaluation. Please see the relevant help section for additional information on those reports.
The Curriculum Inventory Report can be used to submit your organisation's information to the AAMC curriculum portal. There is an Elentra Learn webinar about the CIR available on collaborate.elentra.org.
Note that before using your curriculum inventory reporting, it is recommended that you map your event types and assessment methods (aka assessment characteristics) to the MedBiquitous taxonomies. If you don't do this, unmapped event types will be excluded from the report and unmapped assessments will be reported as "Exam - Institutionally Developed, Written/Computer-based".
You can review an organisation's event types and assessment characteristics via Admin>System Settings. More information is in the System Settings help section.
Navigate to Admin>System Reports.
Scroll down to External Reports and click 'AAMC Curriculum Inventory Reporting'.
Click 'Create New Report'.
Complete the required information, noting the following: Reporting Period: There is no user interface to configure the reporting period. Report Title: This will be the display name in the list of reports in Elentra. Academic Levels: Indicate the curriculum layouts to be included in the report. When you provide the id of a proxy learner the system will only pull events for which that learner is an audience member.
Click 'Create New Report'.
Navigate to Admin>System Reports.
Scroll down to External Reports and click 'AAMC Curriculum Inventory Reporting'.
Click on the title of the report you wish to view.
Click 'Save XML'.
Save the file.
Upload file to the appropriate location.
For detailed AAMC CI Reporting Configuration documentation, proceed to the AAMC CI Reporting page.
A report showing the duty hours recorded by learners based on the selected course and date range.
Go to Admin > System Reports.
Under Clerkship Reporting, click Duty Hours Report.
Select one or more courses.
Set a report date range.
Click Download CSV(s).
The resulting CSV will show you the course, student first and last name, date, number of hours logged, type of hours (e.g., on call), and any comments entered.
Results will be separated by course if more than one course is selected.
A teaching report that shows how many hours faculty are teaching across all courses.
Set the reporting start and finish date and time.
Assign session time equally to instructors - Checking this box will divide the total event time between all listed teachers.
Click Create Report.
Reports will generate for each course. Information included is:
Course Details (director, curriculum coordinator, program coordinator, evaluation rep and student rep)
Course Description
Course Objectives
Course Event Types (shown in a pie chart across multiple curriculum periods)
Teachers and the number of events and hours taught. Note that only associated faculty assigned the teacher type 'teacher' will be included in this report.
Click on a number in the Total Events column to see the events associated with that teacher.
A teaching report that shows how many hours and events faculty are teaching.
Set the reporting start and finish date and time.
Assign session time equally to instructors - Checking this box will divide the total event time between all listed teachers.
Click Create Report.
Reports will generate. Information included is:
Teacher name and the number of events and hours taught. Note that only associated faculty assigned the teacher type 'teacher' will be included in this report.
Click on a number in the Total Events column to see the events associated with that teacher.
A teaching report that shows how many hours faculty are teaching in each Course, including data about event types.
Set the reporting start and finish date and time.
Select a course.
Click Generate Report.
Reports will generate. Information included is:
Teacher name, number of events, affiliated department (if any), course name, the number of hours per event type, the event total, and the hours total. Note that only associated faculty assigned the teacher type 'teacher' will be included in this report.
Click on a number in the Event Total column to see the events associated with that teacher.
The legend helps identify what each learning event is.
A teaching report that shows how many hours faculty are teaching different Event Types broken down by department and division.
Note that only associated faculty assigned the teacher type 'teacher' will be included in this report.
If you associate a faculty user with multiple departments please note that reports that rely on departments will attribute that faculty user effort to each department they are associated with.
Contact information for teachers who have taught between the selected time period.
Note that only associated faculty assigned the teacher type 'teacher' will be included in this report.
This report lists all learning events in a Course and indicates if they are incomplete (meaning they do not have curriculum tags assigned).
Go to Admin > System Reports.
Under Learning Event Reports click Learning Events by Course Missing Objectives.
Set the reporting start and finish date and time (required).
Organization should be set to the organization you are currently working in. Adjust if needed.
To add a course click the "Show List" button.
Click on the name of a course and click 'Add'.
To remove a course click on the course name, then click 'Remove'.
You can add and remove multiple courses at once by using your keyboard and mouse to select multiple from the list.
Click Generate Report and results will display inline.
Events with an IC in the far left column do not have curriculum tags assigned.
Events with a C in the far left column have curriculum tags assigned.
Note that an overall status of events with curriculum tags assigned (shown as a fraction and a percentage) is included.
Results can be downloaded as PDF or CSV.
For CSV downloads, information will download in one file per course, in the case that multiple courses are in use.
For PDF downloads, information for multiple courses will be in one file.
A report containing a list of all learning events and the associated Faculty Member.
Go to Admin > System Reports.
Under Learning Event Reports click Learning Events by Faculty Member.
Set the reporting start and finish date and time (required).
Organization should be set to the organization you are currently working in. Adjust if needed.
Check the 'Show child events' box if you want your report to include any recurring events that also had the parent-child flag applied to them (e.g., a recurring small group event where the content was identical for each group of learners but each event was taught by a different teacher).
Click Generate Report and results will display inline.
Teacher name, role, institutional id, event title, course code, course name, and event duration will be displayed.
Results can be downloaded as PDF or CSV.
This report will include all teacher types assigned to events (e.g., Teacher, TA, Auditor, Tutor).
New in ME 1.25!
Curriculum Tag Minutes and Mapping report updated to allow you to exclude child events from a recurring event series in the report data
There are several curriculum reporting tools available in Elentra. These can be used to help provide feedback to the people or committees responsible for curriculum planning and review, to see a summary of linkages between curriculum tags, and to get an overview of a course's learning events.
To access system reports navigate to Admin > System Reports. Not all users have access to all reports and some reports are accessible from other locations. For example, the Curriculum Reports are available to some users from the Curriculum tab, and a modified version of the Learning Event Types report is accessible from the Admin > Manage Courses > Content page in the left sidebar.
The Curriculum Tag Mapping Report shows you globally mapped relationships between individual curriculum tags. This means if you have mapped one tag to another in Admin > Manage Curriculum, you can see the results here.
This report can be access from the Curriculum tab on the main menu or from Admin > System Settings.
Go to Admin > System Reports.
Under Curriculum Reports click Curriculum Tag Mapping Report.
Choose a curriculum tag set using the dropdown selector.
Switch views as needed to see "Mapped To" and "Mapped From" relationships.
If you have Tag A, and you went into Manage Curriculum and opened Tag A and linked other objectives to it, those relationships will show as "Mapped To" Tag A. Whereas if you opened Tag 26, and mapped Tag A to it, Tag 26 would show up under the "Mapped From" list when you look at Tag A.
Click on a tag to drill through a hierarchical tag set and to view any mapped tags.
The resulting list is available to print by clicking 'Print Report'.
Please note that the print option will only print what is shown on the screen. You must expand each mapped tag to include its details in the print report. There is currently no expand/collapse all button.
If you have a hierarchical tag set, and different levels of the hierarchy are mapped to different tag sets this report will not be able to show you everything. It will only show you the highest level of the hierarchy to which you have mapped another tag set.
This report works best for hierarchical tag sets if only the children or bottom level of the hierarchy is mapped to another tag set.
Also, this report does not have a curriculum map version selector at this time.
This report displays curriculum tags used in events and how much time can be attributed to each. The report divides the total event time by the number of curriculum tags assigned to the event and attributes an even amount of time to each assigned tag. If an event is 60 minutes and two curriculum tags were assigned to the event, each tag will be credited with 30 minutes. If an event is 60 minutes and three curriculum tags were assigned to the event, each tag will be credited with 20 minutes.
If you select one curriculum tag set and don't apply any additional setting options, you'll get a report like this:
The "Group By Additional Curriculum Tag Set(s)" option only applies if you have context-based linkages on the tags assigned to learning events in the selected course(s). The report can only support context-based linkages that are one level (e.g., Course Objective to Discipline). Additionally, the time attributed to each contextually linked tag will be half the amount of time attributed to the directly mapped tag.
If you apply different report options, your report will change. You can select more than one option.
As of Elentra ME 1.21, you can click on a number in a cell to view a list of the events where a specific tag was applied.
Report on Learning Event Types: displays a table listing all event types in a course, and displays how much time in minutes within that event type was spent on each curriculum tags.
Report on number of mappings: displays a list of curriculum tags in a course, their total count in a course and their total time in minutes and hours
Report on percentages: displays a list of all curriculum tags in a course and their total time represented as minutes, hours, and a percentage (of total course time allotted to curriculum tags)
Show pie charts: displays results of the applicable result in a pie chart (by default will show curriculum tags with minute and hour count). If you are filtering by an individual tag the pie chart view will be less useful since it will show 100% for the individual objective.
Exclude child events: If a course includes recurring event series where the parent-child event feature was used (e.g., clinical skills sessions or labs that repeat with identical content for different audiences), check this box to exclude child events in the report data.
Click Generate Report.
Download a CSV or PDF.
The Curriculum Review Report displays the event title and description, free-text objectives, curriculum tags directly mapped to an event, curriculum tags indirectly mapped to an event (either contextually or through organization-level mappings), and hot topics assigned to events in a course. The curriculum tag column displays curriculum tag titles.
Hot Topics is a different feature than Curriculum Tag Sets and can be configured via Admin > System Settings. It acts like another taxonomy with which to tag learning events but is not available in all areas of the platform as a filter or reporting option. We no longer recommend the use of hot topics, however we have left them is this report for those that already use them.
This report respects the parent-child id if it has been applied to recurring events and therefore displays course information from the perspective of one learner enrolled in the course.
This report can be access from the Curriculum tab on the main menu or from Admin > System Settings.
Go to Admin > System Reports.
Under Curriculum Reports click Curriculum Review Report.
Enter a start and finish date for the report.
Include child Learning Events - tick this box if you want to include a recurring event series that was also flagged as having parent-child relationships (e.g. a recurring small group event where learners do the identical thing).
Click 'Show List', click on one or more courses as needed, and click 'Add'.
Click Create Report to see your results inline.
Optionally download your results as a CSV or PDF.
This report is designed to help monitor the learning event types used within a course. It provides a summary in pie chart and table view that includes a list of event types, an event count, and an hour count displayed in hours and as a percentage. For each course you select you will also see an appendix where you can view each learning event title, type, date, and duration.
This report respects the parent-child id if it has been applied to recurring events and therefore displays course information from the perspective of one learner enrolled in the course.
Introduced in ME 1.22, this report is designed to help monitor the learning event types used across multiple courses so you can get a picture of the curriculum delivery across more than one course.
For each course included there is a column per event type to display the event count, percentage (within the course), hour count, and hour percentage (within the course).
Note that there is currently no "Total" column but depending on how a school wants to use this data, you can export a csv file and add additional calculations.
This report allows you to report on the estimated times to complete resources attached to learning events. An oragnization must have a database setting enabled to input event resource time estimates: events_resource_display_time_estimate.
Select one or more courses
Click on the 'Course' bar and type in a course title to search as needed
Click on a course title to add it to the report
Remove a course by clicking it and pushing delete on your keyboard
Enter Report Start and End Dates
Indicate whether to include Required, Optional, or All resources types
Select the desired resource categories and resource types by checking off boxes
Click 'Create Report' or Download CSV
The resulting report will show you event dates, titles, and course and all the combinations of categories and resource types with the associated time for attached resources.
Please note that these reports refer to course gradebook assessments, not the tasks administered through the Assessments and Evaluations module.
This report provides an overview of all assessments entered into a course gradebook for a specific cohort. It provides assessment titles and descriptions for assessments grouped in the following ways: all formative assessments, all summative assessments, all narrative assessments, all narrative assessments that are also formative assessments, and all narrative assessments that are part of the final grade.
This report was created to help provide data for LCME Standard 9: Teaching, Supervision, Assessment, and Student and Patient Safety.
This report provides a table showing assessments, their descriptions, and the curriculum tags associated with those assessments for a defined course and curriculum period.
This report was created to help courses review their assessments and create blueprints to ensure that all curriculum tags assigned to a course are being appropriately assessed.
Note that this report displays the curriculum tags assigned to assessments via the gradebook edit assessment page in the Assessment Objectives section. If you have an exam entered into the gradebook and have used the exam module to build and tag assessment items, the system does not automatically mine exams and collect their tagged assessment items and apply those tags to the gradebook assessment entry. You'll still have to tag the gradebook assessment entry with the appropriate tags.
Additionally, this report shows only direct mappings (i.e., the tags assigned to a gradebook assessment, not those tags linked contextually or globally mapped to those tags).
Use the drop down selector to choose a curriculum period.
In the Courses Included section, click Show List to view additional courses. Click on a course title and click Add to include that course in your report.
You can select multiple courses at once by using your keyboard and mouse. (command and click on Mac)
Click Generate Report.
View results inline or download a CSV or PDF as desired.
Updated in ME 1.21 to allow you to select any existing tag set (instead of relying on a tag set defined in the language file as existed before).
This report shows Gradebook assessments by tag set for each learner selected in the selected cohort and the learner's grade on each assessment to assist with understanding a learner's performance by curriculum tag. Optionally, choose to include the average score per assessment by tag set for the selected cohort as well.
This report relies on the direct tagging of assessments within course Gradebooks. Only those tag sets assigned to gradebook assessments will provide results.
Report on one cohort of learners at a time (at the moment, this report does not permit reporting on course list type cohorts).
Select one or more curriculum tag sets to report on. They will be collapsed for the cohort and learner at first to permit you to choose which tag set you'd like to review first.
Choose whether or not to report on only those learners who achieved a score below your identified threshold by placing a checkmark in the Failing Students checkbox, then identify the threshold you wish to apply. Failing grades will be highlighted in red.
Download the results to a PDF or CSV file.
A report show course gradebook assessments that have not been tagged with any curriculum tags.\
A report containing a list of curriculum tags assigned to a course and an indication of whether they were also assigned to events in the course. Report also includes a list of additional curriculum tags assigned to events in the course but not assigned to the course itself.
Note that this report is most useful if your curriculum framework has you assign curriculum tags to a course and those same tags to specific events. If you actually have separate tag sets for course and event objectives, you will only see useful information in the Non-Assigned Tags section of this report.
Go to Admin > System Reports.
Under Course Reports click Course Objectives by Events Tagged (COBET).
Set the reporting start and finish date and time (required).
All courses will be listed on the "Courses Included" list. Click on a course to highlight it which means it is selected.
You can use your keyboard and mouse to select multiple courses if needed.
Click Generate Report and results will display inline.
Tags in the Assigned Course Objective list are those tags that were assigned to a course.
Click the number under the Tagged column to see a list of the events where the curriculum tag was also assigned.
Tags in the Non-Assigned Tagged Objectives list are those tags that were not assigned to the course but were assigned to specific learning events.
Results can be downloaded as PDF or CSV.
For CSV downloads, three separate files may download (Assigned MCC Presentations, Attached Objectives, and Non-Attached Objectives).
For PDF downloads, information may be separated into Assigned MCC Presentations, Assigned Tagged Objectives, and Non-Assigned Tagged Objectives.
The student report card provides an overview of overall progress for an individual student. Please note that the information included in the report comes from gradebook assessments, not the Assessment and Evaluation module.
To use the Student Report Card:
Admin>System Settings Reports.
Scroll to the bottom of the list and click 'Student Report Card'.
Select a cohort.
Select a learner from the list.
Click 'Create Report'.
View the results inline or opt to Print Report as needed. The print version provides a pdf file.
Course Credit Available: This is populated based on the information provided on a course set up page under Course Credit.
Course Credit Received: If an overall grade of a course is equal to or greater than 50%, full credit will be received. If an overall grade less than 50%, no credit would be received. Note: A developer can set the appropriate passing grade for your installation of Elentra in the settings table (setting shortname: gradebook_passing_grade).
This page is intended to outline the configuration and setup requirements for an Elentra organization to generate compatible AAMC CI reports for submission via the AAMC CI Portal.
Current supported version of the Medbiquitious CI Standard: V. 10
The AAMC encourages participitating schools to it regularly report on the school’s offered curriculum (Curriculum Inventory) by submitting a generated curriculum data file.
Schools may generate this file a number of ways, including:
Using an in house system to create the file
Using a vendor supplied curriculum management system to create the file
Schools may submit the file a number of ways, including:
Using an in house system to automatically upload the file to the AAMC
Having the vendor upload the file on behalf of the school using the AAMC Vendor CI Portal
The school themselves uploading the file using the AAMC CI Portal
The submitted curriculum data file is of XML file type.
To generate AAMC CI Reports, Elentra requires that the Organization containing the information to export have certain AAMC required fields set in the Organization settings:
The AAMC CI report requires that Program Level Curriculum Tags (referred to as Learning Objectives by the AAMC) used and set in Elentra are mapped to a corresponding AAMC Curriculum Tag. By default, the AAMC Curriculum Tag Set is included by default, labelled ‘AAMC Physician Competencies Reference Set’.
In addition, the mapping must be done from the domain level AAMC Curriculum Tag (lowest level Curriculum Tags in Elentra).
Mapping MUST be done FROM the AAMC Curriculum Tag Set. That is, this AAMC Curriculum Tag Set selected, then for each low level item, mapped to the Curriculum Tags assigned to the Courses outputted in the report.
NOTE: Ensure that NO Map Version is selected. Elentra will not output Curriculum Tags if mapping is done using a Map Version.
The AAMC also strongly recommends that a three level hierarchy exist, and as above, AAMC domain level Curriculum Tags (i.e. AAMC PCRS) as follows:
AAMC Recommended Curriculum Hierarchy
NOTE: Not having the three level hierarchy underneath the AAMC PCRS will generate a valid CI file that passes AAMC validation, however the generated AAMC validation report will be missing certain data.
The above mentioned Curriculum Hierarchy can be setup in Elentra in two ways:
Individual Curriculum Tag Sets
Individual Curriculum Tag Sets can be created in Elentra, and the containing Curriculum Tags Mapped from the Curriculum Tag Set containing the Program Objectives, to the Curriculum Tag Set containing the Course Objectives, to the Curriculum Tag Set Containing the Event Objects
Hierachy Built into Single Curriculum Tag Set
Alternately, the hierachy can be built into a single Curriculum Tag Set, for example:
In the above example, ‘Application of Basic Sciences’ would be a single Program Objective, ‘ME1.1 Homeostatis & Dysregulation’ a single Course Objective, and ‘ME1.1a’ an Event Objective
Once the Curriculum Map Hierarchy is setup, Courses and Events should be assigned the required objectives. Curriculum Tag Sets for Courses and Events should only be set for those specifically.
Curriculum Tag Sets are outputted to the AAMC CI Report and assigned only one of the following categories:
program-level-competency: If the parent Curriculum Tag Set was selected as a ‘Program Level Objective’ OR if the individual Curriculum Tags in the CompetencyObject was mapped from an AAMC PCRS Curriculum Tag
sequence-block-level-competency: Not a program-level-competency, and the Curriculum Tag was assigned to the Course (whether or not it was assigned to an Event)
event-level-competency: Not a program-level-competency or a sequence-block-level-competency, and the Curriculum Tag was assigned to an Event but not to any Course
Therefore, if a Course Level Objective Curriculum Tag was assigned to both Courses and Events, it will only be set a category of sequence-block-level-competency. Although this type of issue will pass AAMC validation, the generated report will not contain the required information mapping Events to a Learning Objective if the Event is not associated to an Event Level Objective, and if that Objective is not mapped from a Course Level Objective, and if that Course Level Objective is not mapped from a Program Level Objective, as described above in the Curriculum Hierarchy section.
Course Objectives are set in the ‘Curriculum Tags’ section of Course Administration. From this view, any Curriculum Tag can be assigned as a Course Objective:
Event Objectives are set in the ‘Curriculum Tags’ section of Event Administration. From this view, any Curriculum Tag can be assigned as an Event Objective:
NOTE: On first use, the Filter for the Curriculum Tag Set menu may be set to ‘Course’, which limits the selection of Curriculum Tag Sets to those set in as Course Objectives only. This filter must be cleared to allow selection of Event Objectives from other Curriculum Tag Sets not set for the Course (i.e. if the Program-Course-Event hierarchy consists of multiple Curriculum Tag Sets).
Elentra can assigned three types in Medbiquitous Methods when writing data to the AAMC CI report for each Event:
Instructional Method
Mapped for each Elentra Event Type, such that the Instructional Method written for the Event in the CI report corresponds to that set for the Event’s Event Type in Elentra.
Results in the Event containing sub element ‘InstructionalMethod’ for each Medbiquitous Instructional Method for each of the Event’s Event Types.
Assessment Method
Mapped for each Elentra Gradebook Assessment Characteristic if gradebook assesments are assigned to the Event, otherwise may be set manually for each Event
Results in the Event containing sub element ‘AssessmentMethod’ for of the Event’s selected or assigned Medbiquitous Assessment Methods.
Resource Method
Set manually for each Event
Results in the Event containing sub element ‘ResourceType’ for each selected Medbiquitous Resource Method.
Medbiquitous Methods can be viewed, and the Assessment and Resource Methods set manually, in the Elentra Event Content page:
Note that one of Instructional or Assessment Method is required for the Event to be written to the AAMC CI Report.
If a Learning Event has:
Event Type mapped to a Medbiquitous Instructional Method AND
No Assessment Method assigned THEN
Then it will appear in the AAMC CI Report with only an Instructional Method
If a Learning Event has:
Event Type NOT mapped to any Medbiquitous Instructional Method AND
Assessment Method assigned THEN
Then it will appear in the CI Report with only an Assessment Method
If a Learning Event has:
Event Type mapped to a Medbiquitous Instructional Method AND
Assessment Method assigned THEN
Then it will appear in the CI Report with BOTH an Instructional Method and Assessment Method
Elentra has two ways in which an Assessment Method is set in the AAMC CI report for an Event:
If a Gradebook Assessment is assigned to a Learning Event, then:
The AAMC CI report will contain the Event with the Assessment Method set to that mapped for the Gradebook Assessment set Characteristic
The Event Title in the AAMC CI report will contain the Assessment’s Name instead of the Event Title
Any Assessment Methods set in the Event’s Content page will be added to the AAMC CI report for the Event as additional Assessment Methods
If no Gradebook Assessment is assigned to a Learning Event, then:
Any Assessment Methods set in the Event’s Content page will be added to the AAMC CI report for the Event as additional Assessment Methods
These two ways are made available due to the two different assumptions some schools make, where the first of the above options assumes a Learning Event is itself an Assessment in that Learners are being assessed on what they learned in the past, whereas the second assumes that the Learning Event is an Instructional one and will be assessed by the set Assessment method at some point in the future.
The Elentra platform allows the AAMC CI report to be generated by selecting Admin → System Reports → AAMC Curriculum Inventory Reporting, which opens the following page:
Selecting to create a new report displays the following:
Reporting Period
Auto generated to display four calendar year periods, each from July 1st to June 30th, where the first year is calculated as follows, the the other three period being for the previous years before it:
If the current month is before July
First Period = July 1st in Previous Year to June 30 Current Year
Else
First Period = July 1st in Current Year to June 30 Next Year
Y
Report Title
Title of report being generated. Outputed to the Report itself (Title element), and displayed for the Report in the above AAMC Curriculum Inventory Reports pages
Y
Report Description
Description of report being generated. Outputed to the Report itself (Description element), and displayed for the Report in the above AAMC Curriculum Inventory Reports page
N
Supporting Link
Supporting Link describing the Curriculum. Outputed to the Report itself (SupportingLink element).
N
Academic Levels & Learners
Used to select a representative learner for each academic level. Courses and Events assigned to the representative learner will be exported to the report generated, for the selected academic level (i.e. curriculum period).
Y
Program Level Objectives
Selected curriculum tag sets as program level objectives will include them (if also selected in ‘Allowed Curriculum Tag Sets’ as program level objectives in the generated report (i.e. corresponding Competency Object containing a Category attribute 'program-level-competency’)
N
Allowed Curriculum Tag Sets
Used to limit what curriculum tag sets are included in the report as objectives. Selected curriculum tag sets must contain curriculum tags mapped FROM ALL AAMC Curriculum Tags (i.e. AAMC Physician Competencies Reference Set).
N
The generate AAMC CI XML Report will contain the following elements:
Element
Description
CurriculumInventory
Top level element. Must be the only top level element and contain the attributes indicating specific versions.
ReportID
Contains a uniquely generated identifier for the generate report
Institution
Contains attributes describing the institution generating the report: - InstitutionName: Contains the set organization’s ‘AAMC Institution Name’ in System Settings - InstitutionID: Contains the set organization’s ‘AAMC Institution ID’ in System Settings - Address: Contains the set organization’s address in System Settings
Program
Contains sub elements for describing the Program
Program/ProgramName
Contains the set organization’s ‘AAMC Program Name’ in System Settings
Program/ProgramID
Contains the set organization’s ‘AAMC Program ID’ in System Settings
Title
Report title as set in the AAMC CI report generation form
ReportDate
Date the report was generated
ReportingStartDate
Start date of the selected Reporting Period
ReportingEndDate
End date of the selected Reporting Period
Language
Report language. Set to ‘en-us’ by deafult in the Elentra database for each created report.
Description
Report description as set in the AAMC CI report generation form
SupportingLink
Supporting link as set in the AAMC CI report generation form
Events
Contains sub elements for each Event included in the report, corresponding to the Events assigned to the selected representative learner in the AAMC CI report generation form
Event
Contains an attribute for a Learning Event’s ID, and sub elements describing the Learning Event. Note: The ID will be in one of the following formats: - E#: Single occurance of this Event where # corresponds to
Event/Title
Learning Event’s Title
Event/EventDuration
Learning Event’s Duration, as set in the Learning Event’s Content page (Duration field)
Event/Description
Learning Event’s Description, as set in the Learning Event’s Content page
Event/Keyword
Event/CompetencyObjectReference
Contains a reference to a CompetencyObject in the AAMC CI file under element Expectations. Competency Objects correspond to Curriculum Tags. Event/CompetencyObjectReference therefore refer to Curriculum Tags assigned to Events in the Learning Event’s Content page
Event/ResourceType
Medbiquitous Resource Code corresponding to set Medbiquitous Resources in the Learning Event’s Content page
Event/InstructionalMethod
Medbiquitous Instructional Method corresponding to assigned Medbiquitous Instructional Method for the Learning Event’s Event Type
Event/AssessmentMethod
Medbiquitous Assessment Method corresponding to assigned Medbiquitous Assessment Method for the Learning Event’s assigned Gradebook Assessment, or manually set in the Learning Event’s Content page (see Event Assessment Methods section above)
Expectations
Contains sub elements for each CompetencyObject and CompetencyFramework.
Expectations/CompetencyObject
Correspondonds to a Curriculum Tag. Will include each Curriculum Tag in all Curriculum Tag Sets enabled for the Organization if selected in the AAMC CI report generation form’s ‘Allowed Curriculum Tag Sets’ field. In addition, each Curriculum Tag assigned to Courses and Events will also be included, if not already included in the above retreived Curriculum Tag Sets, as long as they also belong to the allowed Curriculum Tag Sets selected during report generation. This is to ensure we don’t have a CompetencyObjectReference elsewhere in the AAMC CI xml file without a corresponding CompetencyObject here, which will result in errors on submitting to the AAMC CI portal. Each CompetencyObject is also assigned a Category: - program-level-competency: If the parent Curriculum Tag Set was selected as a ‘Program Level Objective’ OR if the individual Curriculum Tags in the CompetencyObject was mapped from an AAMC PCRS Curriculum Tag - sequence-block-level-competency: Not a program-level-competency, and the Curriculum Tag was assigned to the Course (whether or not it was assigned to an Event) - event-level-competency: Not a program-level-competency or a sequence-block-level-competency, and the Curriculum Tag was assigned to an Event but not to any Course If none of the above conditions are met, the category defaults to sequence-block-level-competency Note: Each Curriculum Tag’s nested Curriculum Tags will also be included recursively.
Expectations/CompetencyFramework
Includes sub elements for cf:Includes and cf:Relation depending on Curriculum Tag mappings to AAMC Curriculum Tags.
Expections/CompetencyFramework/cf:Includes
Corresponds to: - An AAMC domain level Curriculum Tag (i.e. lowest level Curriculum Tag in the Curriculum Tag Set ‘AAMC Physician Competencies Reference Set’) that has been mapped to a Curriculum Tag in the included Events and Course (i.e. Event and Course objectives) OR - Curriculum Tags belonging to a Curriculum Tag Set selected as ‘Allowed’ in the AAMC CI report generation form
Expections/CompetencyFramework/cf:Relation
Corresponds to a mapping from the AAMC Curriculum Tag to a Curriculum Tag set for Courses and Events
AcademicLevels
Corresponds to the selected Academic Levels (i.e. Curriculum Layouts) in the report generation form. Note: Only Academic Levels for Curriculum Layouts containing Learning Events included in the report for the selected representative learners will be included here
AcademicLevels/LevelsInProgram
Number of Academic Levels as described above
AcademicLevels/Level
Corresponds to a specific Academic Level, as described above
AcademicLevels/Level/Label
Label for Academic Level as set for the Curriculum Layout
AcademicLevels/Level/Description
Description for Academic Level as set for the Curriculum Layout
Sequence
Parent element for SequenceBlock elements
Sequence/SequenceBlock
Corresponds to a Course containing the included Learning Events in the report
Sequence/SequenceBlock/Title
Corresponds to the Course Title set in the Elentra Course Management
Sequence/SequenceBlock/Description
Corresponds to the Course Description set in the Elentra Course Management
Sequence/SequenceBlock/Timing
Contains the Course Timing elements
Sequence/SequenceBlock/Timing/Duration
Sequence/SequenceBlock/Timing/Dates
Corresponds to the Course Period
Sequence/SequenceBlock/Timing/Dates/StartDate
Corresponds to the Course’s Start Date, as described above for the Sequence/SequenceBlock/Timing/Duration element
Sequence/SequenceBlock/Timing/Dates/EndDate
Corresponds to the Course’s End Date, as described above for the Sequence/SequenceBlock/Timing/Duration element
Sequence/SequenceBlock/SequenceBlockLevels
Contains the references to the Academic Levels (i.e. Curriculum Layout) for the Course, defined in the AcademicLevels element above
Sequence/SequenceBlock/SequenceBlockLevels/StartingAcademicLevel
Reference to the Starting Academic Level (i.e. Curriculum Layouts) for the Course, defined in the AcademicLevels element above
Sequence/SequenceBlock/SequenceBlockLevels/EndingAcademicLevel
Reference to the Ending Academic Level (i.e. Curriculum Layouts) for the Course, defined in the AcademicLevels element above
Sequence/SequenceBlock/ClerkshipModel
Set for Clerkship courses (i.e. Courses with ‘clinical_course’ field set, determined by the selection to the ‘Clinical Experience’ setting in Elentra’s Course Administration page). In Elentra, set to ‘rotation’ for these Courses, otherwise this element is not included at all.
Sequence/SequenceBlock/CompetencyObjectReference
Contains a reference to a CompetencyObject in the AAMC CI file under element Expectations. Competency Objects correspond to Curriculum Tags. Sequence/SequenceBlock/CompetencyObjectReference therefore refer to Curriculum Tags assigned to Courses in the Course Adminstration page.
Sequence/SequenceBlock/SequenceBlockEvent
Contains a reference, for a containing Learning Event for the Course, to an Event defined in the Events element in the report.
\
Errors with AAMC CI files fall into the following main categories:
File Structure Validation
This is the first check done by the AAMC CI portal upon submission and ensures that major required elements exist in the CI XML file. The portal checks against a defined XSD available here.
Errors appear as a modal on submission, for example:
These errors can be validated before submission by validating the generated CI file against the XSD using an XML validator, or via command line: xmllint --noout --schema curriculuminventory.xsd <AAMC_CI_XML>.xml
Business Rules Validation
This check is done after submission to ensure the file contents meet the AAMC’s defined CI Business Rules
Details on errors with a submission can be found by selecting ‘Submission error: AAMC CI Business Rules’ in the Activity History for the required school, then clicking the ‘Export’ Button.
Data Issues
Even if the above two validations pass, depending on the data in the file, the AAMC may not process the file in a way to produce the required information for AAMC accreditation. This form of error is harder to detect and depends largely on the Elentra Curriculum Mapping configuration
Possible specific issues include:\
File Structure Validation
One of ‘../CompetencyObject’ expected
CompetencyObject references to a Curriculum Tag. Reason why this error might occur when generating a CI from Elentra include: - In the Elentra AAMC report generation form, the Course assign Curriculum Tag was not selected as a ‘Program Level Objective’ or in the selected ‘Allowed Curriculum Tag Sets’, or the Course does not have the expected Curriculum Tags assigned - Elentra does not output Curriculum Tags mapped to an AAMC Curriculum Tag, if mapping is done with a Map Version selected.
File Structure Validation
A ‘SequenceBlock’ corresponds to a Course. This errors may refer to the Course not containing any included Events, possibly due to: - The Course being a Clinical Experience one, and no Events existing within the Learner’s Rotation periods This may also refer to the the Course not being assigned any Course Objectives (i.e. Curriculum Tag assignments in Course Administration within Elentra)
Business Rules Validation
The program-level competency object ... does not have a corresponding 'Relation' tag that relates it to a PCRS.
- Course assigned Curriculum Tag has not been mapped from an AAMC domain level objective, which in Elentra correspond to the lowest level Curriculum Tag in the ‘AAMC Physician Competencies Reference Set’ Curriculum Tag. - Elentra does not output Curriculum Tags mapped to an AAMC Curriculum Tag, if mapping is done with a Map Version selected.
Data Issues
Verification Report’s Tables 6/7/9 Empty or Missing Data with Learning Objectives linked to Events or Courses
In the AAMC Verification Report, tables 6 and 7 require that the Events are assigned Event Level Objectives, and that the three level hierarchy of Learning Objectives have been set. See section ‘Curriculum Hierarchy**’** above for more details.
Data Issues
Course marked as ‘Clinical’ does not contain expected Events
Learning Events in Clinical Experience Courses are only included in the AAMC CI report if they fall within a Rotation period of the representative learner selected. If an Event falls outside that range, it will not be included in the report. Additionally, if a Clinical Experience Course does not contain any Rotations, it and it’s containing Learning Events will not be included in the AAMC CI report at all.
Elentra Setup
Unable to find Event Objectives to assign to Learning Events
Ensure the Curriculum Tags filter for the Event is cleared, as opposed to being set to ‘Course’ which only displays Curriculum Tag Sets set for the Event’s Course.
Elentra Setup
Specific Events not found in generated CI data file and Verification Report
Events are included if they have either an Assessment or Instructional Method assigned to them. Event’s without a valid Assessment or Instructional (i.e. Assessment or Instructional method with a valid Medbiquitous code) will not be included in the generated AAMC CI file as it would generate an error on submission to the AAMC portal.
Elentra Setup
No option to set Event Keywords in Elentra for inclusion in the AAMC CI Report.
The resulting Curriculum Tag Mapping Report may then look like the following, where each of the bottom three levels corresponding to a single Program Objective mapped to a Course Objective mapped to an Event Objective, as examples.
MeSH keyword assigned to the Event in the Learning Event’s Content page Note: To be able to set Keywords to Events, ensure the optional Course keywords feature has been enabled by following the steps outlined .
Corresponds to the Course Duration in number of days. E.g. P120D refers to 120 days. Duration is calculated as follows: - Non Clerkship Course or Clerkship Course without Rotations: Duration between earliest and latest containing Learning Events - Legacy Clerkship Course with Rotations: Duration between earliest and latest Clerkship events (i.e. events in events table of legacy Clerkship database), for the Course’s rotations, within the repoting period - Clerkship Course with Rotations: Duration between earliest and latest rotation Note: : Start and end dates. The AAMC CI collects curriculum from the previous academic year, so to upload your CI data in August 2021, your course start and end dates will generally fall between July 1, 2020 and June 30, 2021. While your CI reporting dates will be July 1, 2020 through June 30, 2021, it is acceptable if some content within your CI (e.g., academic levels, courses) fall outside those bounds. For example, while the academic year begins July 1, 2020, you may have clerkship courses which begin in May 2020, and you should go ahead and include this in your CI.
cvc-complex-type.2.4.b: The content of element 'SequenceBlock' is not complete. One of '{"":CompetencyObjectReference, "":Precondition, "":Postcondition, "":SequenceBlockEvent, "":SequenceBlockReference}' is expected.
Ensure the optional Course keywords feature has been enabled by following the steps outlined .
