Faculty Development Dashboard

This dashboard organizes all of the EPAs that have been completed in a program by the assessor that completed them with the goal of informing faculty development. To get started, users need to first select the academic year in which the assessments were collected and click “GET RECORDS”.

Filters

There are three filters available in this dashboard. The first filter lets users select an assessor group to only look at assessments completed by users in that group. This filter can be used to remove or include student assessors. The second filter lets users select a department to only look at assessments completed by assessors from that department. This can be used to remove assessors from external programs. The final filter lets users select a specific assessor for their metrics to be highlighted. Alternatively, users can click on any of the bars in the charts below to select and highlight that assessor.

Acquisition Metrics

There are two sections each showing summarized metrics related to faculty assessments. The first section shows the amalgamated metrics for EPAs completed by all assessors in a given academic year. Users can mouse-over the EPA Rating visual to see the proportion of EPAs rated at each level of entrustment (EPAs completed on Supervisor Forms with 5-point O score scales are only considered for this metric). Users can also mouse-over the Training Stage visual to see the proportion of EPAs completed in each stage of training. The second section shows the metrics for EPAs completed by the selected Assessor. Like the section above, users can mouse-over the EPA Rating visual to see the proportion of EPAs rated at each level of entrustment and also mouse-over the Training Stage visual to see the proportion of EPAs completed in each stage of training.

The acquisition metrics panel is followed by four charts each visualizing a specific metric of an assessor relative to others in the program. The red highlighted bar represents the current selector assessor/faculty.

Total EPAs Observed

This chart displays the number of EPAs observed by each assessor. Users can mouse-over for each assessor's name and click to highlight that assessor's data. If an assessor is selected, their EPA count is shown in the chart title in red.

EPA Expiry Rate

This chart displays the percentage of EPAs sent to each assessor that expired before completion. If your school doesn't track expiry metrics of assessments, then the values in this chart would default to zero for all faculties.

Average Entrustment Score

This chart displays the average entrustment score of EPAs completed by each assessor. If an assessor is selected, their average entrustment score is shown in the chart title in red. This chart only considers assessments that have been completed on "Supervisor Forms" that have a standard 5 point "O score" scale.

Average Words per Comment

This chart displays the average number of words per comment included with the EPAs completed by each assessor. If an assessor is selected, their average words per comment metric is shown in the chart title in red.

The charts are followed by two tables that are only visible when a faculty is selected. The first table displays all the EPAs completed by the selected assessor. It is searchable (click the white box) and sortable (click the column header). The second table displays Expired EPAs that were not completed by the selected assessor. It is also searchable (click the white box) and sortable (click the column header). Both the tables can be exported as a CSV file.

Exports

The dashboard has two different types of exports that can be triggered by using the two buttons at the top of the page.

Download Assessor Report

This provides a CSV export with a list of all faculties and their related metrics. This can be used for downstream analysis that is beyond the scope of the dashboard. If a faculty is selected, the report contains their data alone. If a user wants the data of all the faculties in the export then they must select “All” in the “Assessor” filter.

This button is only visible when a faculty has been selected and it lets the user export the entire dashboard as a PDF file that can be shared with other users who don't have access to the dashboard. It prompts a “Save as PDF” popup as shown below.