Assessment & Evaluation

New in ME 1.19!

On the Admin A&E Dashboard

• Additional details viewed on deleted tasks and other tasks

Forms

• For forms with a course association, ability to apply embargo conditions to a task to prevent it from being viewed by target until certain conditions are met (database setting option). CBME option ONLY.

Distributions

• Summary Assessment Task support for minimum numbers of completion

  added to Learning Event based distributions

• New distribution type that allows for reciprocal distributions (e.g., you want a faculty evaluation task sent to the target of an assessment so that the learner can evaluate the assessor)

• For Rotation-based distributions, set up to allow the assessor/evaluator to specify the target when completing the task

• For delegation distributions, option to not specify assessors

On-Demand Workflows

• On-demand assessments can have expiry dates applied to them (database setting option, can apply to specific workflows, default is 7 days but schools can change that)

Reports

• New Form Responses Report to view all assessment and evaluation tools and their responses (somewhat similar to Assessment Tool Data Extract)

Notifications

• Prompted Responses notification emails will now include a red exclamation indicator showing the relevant response and will hide the name of the user

There are multiple tools available to facilitate assessment and evaluation through Elentra.

• To create items and forms to assess learner performance on tasks (e.g., clinical skills and workplace based assessment), use the Assessment and Evaluation Module.

• To create items and forms to have learners evaluate courses, faculty, themselves, and other activities, use the Assessment and Evaluation Module.

• To create assessment items to use in small, low-stakes assessments use the Exams Module. (Elentra does include a Quizzes Module but we recommend you use the much newer Exams Module instead.)

• To create assessment items to use for tests and exams use the Exams Module.

• To store learner grades and facilitate faculty grading of assignments use the Gradebook feature in each course. (To allow inline faculty grading using a rubric form or similar, please note that you will build the form in Assessment and Evaluation, then attach it to a Gradebook Assessment. Only specific item types are supported on forms attached to gradebook assessments.)

Elentra ME also includes a portfolio, which some organizations may choose to use for student assessment purposes. The portfolio can be connected to a course gradebook. For more detail about the portfolio please see the Portfolio help section.

Assessment & Evaluation Module

The Assessment & Evaluation Module in Elentra is predominantly used to assess learner performance in a clinical environment, and provide multiple user groups with the ability to evaluate faculty, courses/programs, and other activities within the context of your organization. Since the Assessment and Evaluation Module essentially allows you to create forms for people to complete you could even use it to do a pre-course survey, or as a way to collect information from a group about their work plans in a collaborative activity.

To use the Assessment & Evaluation Module users must create items (e.g., questions, prompts, etc.), and create forms (a collection of items). Organizations can optionally allow users to initiate specific forms based on a form workflow (e.g. to allow learners to initiate an assessment on themselves by a faculty member), or organizations can create tasks for individuals to complete using a distribution. A distribution defines who will complete a form, when the form will be completed, and who or what the form is about.

The Assessment and Evaluation Module users also have a quick way to view their assigned tasks and administrators can monitor the completion of tasks assigned to others.

Reporting exists to view and in some cases export the results of various assessments and evaluations.

The Competency-Based Medical Education module also includes a variety of form templates for use. There is no user interface to configure form templates at this point. For instructions specific to Competency-Based Medical Education, please see the CBME tab.

Database Setting Options

Database Setting	Use
flagging_notifications
include_name_in_flagged_notifications	defines whether or not to include names of users in prompted response notifications in Assessment and Evaluation items
enable_prompted_responses_comments_and_reviews	Controls the visibility of a Prompted Responses tab for staff and faculty users who receive prompted response notifications.
unauthenticated_internal_assessments	Impacts email notifications sent to assessors. If enabled, allows distributed assessments to be completed by internal assessors without logging in via a unique hash provided via email
disable_distribution_assessor_notifications	This goes hand in hand with unauthenticated_internal_assessments and enable_distribution_assessor_summary_notifications. When using unauthenticated distribution assessments, you probably want an single summary email with a link to each task rather than an email for each new task. This disables the per-task reminders.
enable_distribution_assessor_summary_notifications	This adjusts the emails for distribution assessments to have a nightly summary of all new tasks, and then a weekly summary of tasks that are still incomplete.
assessment_tasks_show_all_multiphase_assessments
assessment_delegation_auto_submit_single_target	On by default, controls whether or not a page will auto submit when there is a single target in a delegation task
assessment_display_tasks_from_removed_assessors	when enabled, will display assessment tasks from assessors that have been removed from the distribution
cbme_ondemand_start_assessment
cbme_ondemand_start_assessment_shortcut_button	optional, if selected a short cut icon will be displayed to learner in their cbme dashboard beside corresponding EPAs
cbme_ondemand_start_assessment_add_assessor	optional, if selected you will have the ability to add new assessors. By default these added assessor will be stored in the cbl_external_assessors table. If you want the added assessor to be an internal user you must also merge ME-1434 to get this complete feature
cbme_ondemand_start_assessment_director_as_staff_workflow	toggle whether faculty directors get the staff workflow view. Default is off (0) - all faculty get the faculty workflow view
cbme_ondemand_start_assessment_replace_admin_trigger	to toggle whether the “Trigger Assessment” button on /admin/assessments gets switched over to use the workflow view. Default is off (0).
cbme_ondemand_expiry	Enable to apply an expiry date for tasks generated from on demand workflows.
cbme_ondemand_expiry_offset	If cbme_ondemand_expiry is in use, define the period of time after which an on demand task will expire.
cbme_ondemand_expiry_workflow_shortnames	If cbme_ondemand_expiry is in use, define which workflow types it applies to.
cbme_assessment_form_embargo	For organizations with CBME enabled, the option allows you to hide rubric forms until certain conditions are met.
assessment_triggered_by_target	For adhoc distributions only, controls whether or not a target can initiate a form. Enabled by default.
assessment_triggered_by_assessor	For adhoc distributions only, controls whether or not a target can initiate a form. Enabled by default.
assessment_method_complete_and_confirm_by_pin	For adhoc distributions only, controls the available form completion method. Enabled by default.
assessment_method_send_blank_form	For adhoc distributions only, controls whether or not a target can initiate a form. Enabled by default.
housing_distributions_enabled
clerkship_housing_department_id