Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
A variety of system reports are available to different users in Elentra. Some reports can be accessed from other screens, but most reports are accessed via Admin>System Reports.
Not all reports will be visible to all users and learners have no access to system reports (learners can access some reports on themselves depending on how you use Assessment and Evaluation).
This report provides an overview of all assessments entered into a course gradebook for a specific cohort. It provides assessment titles and descriptions for assessments grouped in the following ways: all formative assessments, all summative assessments, all narrative assessments, all narrative assessments that are also formative assessments, and all narrative assessments that are part of the final grade.
This report was created to help provide data for LCME Standard 9: Teaching, Supervision, Assessment, and Student and Patient Safety.
This report provides a table showing assessments, their descriptions, and the objectives and MCC presentations tagged to those assessments within a course gradebook and for a specific cohort. The Objective column displays curriculum tag titles and attempts to consolidate titles within a tag set to save display space. Instead of ME2.1a, ME2.1b, ME2.1c showing up you will see ME2.1a, b, c. The curriculum tag set defined with the tag set title MCC Presentations appears in the last column.
This report was created to help courses review their assessments and create blueprints to ensure that all curriculum tags assigned to a course are being appropriately assessed. Note that this report displays the curriculum tags assigned to assessments via the gradebook edit assessment page in the Assessment Objectives section. If you have an exam entered into the gradebook and have used the exam module to build and tag assessment items, the system does not automatically mine exams and collect their tagged assessment items and apply those tags to the gradebook assessment entry. You'll still have to tag the assessment entry with the appropriate tags.
The Curriculum Inventory Report can be used to submit your organisation's information to the AAMC curriculum portal.
Note that before using your curriculum inventory reporting, it is recommended that you map your event types and assessment methods (aka assessment characteristics) to the MedBiquitous taxonomies. If you don't do this, unmapped event types will be excluded from the report and unmapped assessments will be reported as "Exam - Institutionally Developed, Written/Computer-based".
You can review an organisation's event types and assessment characteristics via Admin>System Settings. More information is in the System Settings help section.
Navigate to Admin>System Reports.
Scroll down to External Reports and click 'AAMC Curriculum Inventory Reporting'.
Click 'Create New Report'.
Complete the required information, noting the following: Reporting Period: There is no user interface to configure the reporting period. Report Title: This will be the display name in the list of reports in Elentra. Academic Levels: Indicate the curriculum layouts to be included in the report. When you provide the id of a proxy learner the system will only pull events for which that learner is an audience member.
Click 'Create New Report'.
Navigate to Admin>System Reports.
Scroll down to External Reports and click 'AAMC Curriculum Inventory Reporting'.
Click on the title of the report you wish to view.
Click 'Save XML'.
Save the file.
Upload file to the appropriate location.
When uploading the report to the AAMC, you may receive errors. See the page below for tips and tricks to troubleshoot these errors.
When uploading the generated XML file from the Curriculum Inventory Report, to the AAMC's site, you may enounter a number of cryptic error messages. For each of these errors, here are some tips you can try that might shed light on them. Some of these may require database access.
If you get an error from the AAMC saying that the XML is invalid, you can use a Linux tool called xmllint to validate. There are other validators for a variety of operating systems or browsers. Regardless of what validator you use, you need to specify the following as the schema:
To validate using xmllint, run the following command:
To know what objective/tag is being referred to in an error, there will be an ID, such as 12385. To figure out what objective/tag is being referred to, go to Admin > Manage Curriculum > Curriculum Tags > (any tag set) > Export (button). The spreadsheet will have the ID of each tag under the curriculum_tag_id column (first column). This will be the same as the ID listed in the report, and should tell you what tag set it is in.
Tag sets included in the report must have the audience ("applicable to") all courses, or there will be either CF01 or CF07 errors.
Tags that are mapped at the event, course, or program level must have an objective description, or again there will be CF01 errors.
If a tag is mapped to any objective at the considered levels (event, course, or program), they themselves need to also be mapped at any of these levels or they will not be included, resulting in CF07 errors. For example, if SO01 is linked to an event and CO01 is linked to a course, and CO01 is mapped down to SO01, the XML will contain a competency object for both. But if WO01 is linked to SO01 and WO01 is not mapped to a course, event, or it's not in the specified program level objectives, then we will get a CF07 error because the objective will not have a competency object. (TL;DR, any objective will not have a competency object if it is not mapped at the course level, event level, or program level, and this will generate a CF07).
Keywords are only labeled as "keywords" in the report XML if they are mapped as mesh keywords or hot topics. The administrator guide currently says to not use hot topics as not all reports respect them. MeSH keywords are not visible to the administrator if they have not been manually added in the database in the mesh_terms and mesh_descriptors tables.
The "allowed_curriculum_types" column in reports_aamc_ci really means "allowed tag sets (objective IDs)". (And the program level objectives are defined in the program_level_objective_id of the same record.)
The desired tag sets to include (i.e. at the course, event, and program levels) must be specified on the form before generating the report. Don't forget to set the Program Level Objectives to the correct set of program level competencies. Sometimes you'll get CF07 errors because you're mapping from objectives at the program level, but you've specified the wrong program level objective set.
You will get CF09 errors if the mappings are not in conformance with the diagram in appendix A of this manual: https://www.aamc.org/media/33791/download Look at the CompetencyObject's Category descriptor to know what level the XML file is portraying the objective as. You may have to tag one of the lower level objectives at the level of the higher objective to fix it (e.g. to the course).
PCRS objectives need to have a objective_code of the form "aamc-pcrs-comp-c0602", not "c0602" for example. If they do not match that format, the AAMC will ignore it and generate CF01 errors (and CF10).
If clerkship courses are showing the wrong duration, it is because it is using the earliest and latest events in those courses. To make it show actual length of the clerkship, you can create clerkship events in the old module (currently the Clinical Experiences module is not supported by the CIR). However, this may lead to the courses not being included for some reason, and you will get errors. So easier it may be to use vim to modify the duration of each clerkship course, and then save that interaction as a macro to use whenever the report is regenerated.
When looking at the linked_objectives table, each linked_objective record represents a mapping such that when you are adding a link in the Manage Curriculum > Curriculum Tags section by clicking the link button, you will be creating a linked_objectives record with the objective_id being the tag that you clicked first, and the target_objective_id being the tag that you added by using the drop down. The screen to map tags to a tag is incorectly saying that the tags will be mapped "to" this tag... Tags should be mapped downward, so when you add a tag using the dropdown, the tag you're adding should be "narrower" in scope. For example, you may map a program level objective down to a course level objective, and a course level objective down to an event level objective. In this case, a linked_objectives record will be created with objective_id being "broader" in scope than the target_objective_id.
If assessment methods continue to show in the XML when they have in fact been deleted, it is because of a bug (has been reported in JIRA). Run the following SQL to delete them so they do not show in the report.
When uploading the XML file, if you get the error "Legacy medbiquitous version not supported", preceded by a message saying the XML is invalid, it is because AAMC is now using version 10 of the XML schema, but the XML file we provide currently only adheres to version 1. In many cases, this does not result in an error, but there may be times when it does. One solution is to run an XML validator, but using a higher version of the XML schema. For example, use version 10 of the XML schema to validate your XML file. The file may have to be modified in order for this to produce meaningful error messages.
Go to Admin > System Reports > External Reporting > AAMC Curriculum Inventory Report
Add a new report or edit a report
Click on a curriculum level/layout that you'd like to add.
To add a student for this curriculum level, first go to Admin > Events, and filter by curriculum level/layout (it may be called "Term filter"). Do this in a separate tab and keep the CI report open.
Click on one of the events in the period of time you want to report on
Click on the Attendance tab
Ensure that the curriculum period selected is the one you want to report on
Note the name of one of the students
Back in the CI report, find the student by selecting their cohort, and clicking the plus (+) button beside their name.
A teaching report that shows how many hours faculty are teaching across all courses.
A teaching report that shows how many hours faculty are teaching in Clinical Skills, Expanded Clinical Skills, PBL, etc.
A teaching report that shows how many hours faculty are teaching different Event Types broken down by department and division.
Contact information for teachers who have taught between the selected time period.
There are several curriculum reporting tools available in Elentra. These can be used to help provide feedback to the people or committees responsible for curriculum planning and review, the see a summary of linkages between curriculum tags, and to get an overview of a course's learning events.
To access system reports navigate to Admin>System Reports. Not all users have access to all reports and some reports are accessible from other locations. For example, the Curriculum Reports are available to some users from the Curriculum tab, and a modified version of the Learning Event Types report is accessible from the Admin>Manage Courses>Content page in the left sidebar.
The Curriculum Tag Mapping Report shows you mapped relationships between individual curriculum tags.
Click the down arrow to select a curriculum tag set.
Switch views as needed to see "Mapped To" and "Mapped From" relationships. If you have Tag A, and you went into Manage Curriculum and opened Tag A and linked other objectives to it, those relationships will show as "Mapped To" Tag A. Whereas if you opened Tag 26, and mapped Tag A to it, Tag 26 would show up under the "Mapped From" list when you look at Tag A.
The resulting list is available to print by clicking 'Print Report'.
Note that if you have a tag set with hierarchies this report can currently only show the first level of the hierarchy if it's mapped to anything. If it's not mapped you'll be able to drill down to the next level of the hierarchy and view it's linkages. This report does not have a curriculum map version selector at this time.
The Curriculum Tag Minutes and Mapping Report
Report on Learning Event Types: displays a table listing all event types in a course, and displays how much time in minutes within that event type was spent on different curriculum tags Report on number of mappings: displays a list of curriculum tags in a course, their total count in a course and their total time in minutes and hours Report on percentages: displays a list of all curriculum tags in a course and their total time represented as minutes, hours, and a percentage (of total course time allotted to curriculum tags) Show pie charts: displays results of the applicable result in a pie chart (by default will show curriculum tags with minute and hour count). If you are filtering by an individual tag the pie chart view will be less useful since it will show 100% for the individual objective. Export CSV: displays results of the applicable result in a csv (by default will show curriculum tags with minute and hour count, if you want it to include other information click multiple checkboxes).
The Curriculum Review Report displays a table that lists the learning events and associated event description, freetext objectives, and curriculum tags in a course. The Objective column displays curriculum tag titles and attempts to consolidate titles within a tag set to save display space. Instead of ME2.1a, ME2.1b, ME2.1c showing up you will see ME2.1a, b, c. The curriculum tag set defined with the tag set title MCC Presentations appears in the last column.
This report respects the parent-child id if it has been applied to recurring events and therefore displays course information from the perspective of one learner enrolled in the course.
The Course Review Report was built prior to the units and context-based linkage options being available so under Objectives the report shows the objectives tagged to the event (but not additional objectives linked contextually).
The Course Summary Report is very similar to the Curriculum Review Report but excludes freetext objectives and includes a column to display Hot Topics tagged in a learning event. Hot Topics is a different feature than Curriculum Tag Sets and can be configured via Admin>System Settings. It acts like another taxonomy with which to tag learning events but is not available in all areas of the platform as a filter or reporting option. More information about Hot Topics can be found in the Curriculum help section.
The Objective column displays curriculum tag titles and attempts to consolidate titles within a tag set to save display space. Instead of ME2.1a, ME2.1b, ME2.1c showing up you will see ME2.1a, b, c. The curriculum tag set defined with the tag set title MCC Presentations appears in the last column.
This report respects the parent-child id if it has been applied to recurring events and therefore displays course information from the perspective of one learner enrolled in the course.
The Course Summary Report was built prior to the units and context-based linkage options being available so under Objectives the report shows the objectives tagged to the event (but not additional objectives linked contextually).
This report is designed to help monitor the learning event types used within a course. It provides a summary in pie chart and table view that includes a list of event types, an event count, and an hour count displayed in hours and as a percentage. For each course you select you will also see an appendix where you can view each learning event title, type, date, and duration.
This report respects the parent-child id if it has been applied to recurring events and therefore displays course information from the perspective of one learner enrolled in the course.