Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
The first step to using the exam module is to create questions or to create an exam. You can create questions while creating an exam, but if you have a large number of existing questions to import it may be more efficient to import all questions and then create an exam. For more information on importing questions please see the Exams>Imports help section.
Before you can create an exam you should create folders in which to store exams.
Only users with Admin roles can create exam folders. This is by design to limit the duplication of folders and promote consistent methods in storing exams. Note that non admin users will be able to add exams to existing folders.
Navigate to Admin>Manage Exams and click 'Exams' from the left sidebar.
If a new folder is needed, click 'Add Folder'.
Complete the required information, noting the following:
Click 'Select Parent Folder' if you want to create a subfolder within an existing folder. The permission settings of the subfolder will automatically match the permission settings of the parent folder. Click on the desired parent folder and click 'Move'. Folder Text: Provide the folder title here. This will display when you click 'Exams' and see a list of folders. Folder Description: You will only see this if you open the folder to edit it. Folder Color: The system requires you to select a color.
Click 'Save' to create the folder.
To copy, delete, edit and manage folder authors, or move a folder, click the the gear icon to the right of the folder name. You will only have the ability to do this if you created the folder or are listed as a folder author.
To add permission for other users to access a folder, select the user type (individual, organisation or course), begin to type in a name and click on the name you want. The selected user will appear on a list below. To remove a permission click the red x beside a name. If you make a folder accessible to an organisation it means anyone in that organisation with access to the exam module will be able to access the folder. If you make a folder accessible to a course, anyone listed in the course contacts section of the course setup page will be able to access the folder.
Hide the list of exam folders by clicking on the eye icon beside the Add Folder button.
Click on a folder to view its subfolders.
Navigate to Admin>Manage Exams.
Click on ‘Exams’ from the left sidebar Manage Exams section.
Click ‘Add Exam’ to create a new exam.
Provide an Exam Name, select a folder and click ‘Add Exam’.
You will be directed to the exam question page where you can add questions to the exam.
If you'd like to add permissions to the newly created exam, you can do so under the Information and Settings tab for the exam. Note that an exam will automatically inherit the permission settings of the folder in which it is stored.
After creating an exam you'll automatically be redirected to the Questions tab. If you've navigated away from Questions, click on the Questions tab to return.
To add existing questions, click 'Add Individual Question(s)'.
Adjust the question folder settings as desired. You can quickly select all questions within a folder by clicking the checkbox between the eye icon and the Actions dropdown menu. Note that the Advanced Search function is also available to help you locate desired questions.
Choose questions to add to the exam by clicking the checkbox beside each desired question and then clicking 'Attach Selected'. You should see the questions you chose show up in a list beneath the Exam Questions header. Also note that the Exam Data tracker in the bottom corner of the screen will reflect the total questions and points.
To create a new question while creating an exam, click 'Add Individual Question(s)', then click the down arrow beside 'Attach Selected' and choose 'Add and Attach New Question'.
Create your question (see instructions for creating questions in another section) and save it. This will add the the new question to the exam and create a new entry in the Questions folders.
When working in the exam module as with an admin role or pcoor role you will be able to add an individual question that is part of a Grouped Q and then replace that question with the entire group.
You can identify a question that is part of a Grouped Q because it will have the small chain or link icon beside it.
Click on an individual question to add it as you normally would. After that individual question has been added to the exam, click on the chain icon and you will be prompted to either click the group title to view additional questions in the group, or click 'Replace with Group' to substitute the full group of questions for the single question already added.
Once a Grouped Q has been added to an exam remember that the questions will appear with a blue border around them.
You can add free text space to an exam to provide instructions or additional details.
You can add a page break to an exam and when you create the exam post you'll have choices about how to display questions. One of the display options relies on page breaks.
To add either option, click on the down arrow beside the ‘Add Individual Question(s)’ button.
Select the item you want to add by clicking on it.
Note that any text entered into a free text space must be saved by clicking the Save button withinthe free text card. Find the Save button in the top right of the free text item beside the eye icon.
When creating an exam, you can group questions which will always keep the items in the group together, even if the question order is randomized. (Note that you can also create Groups Qs when creating questions if you have admin role permissions. Any user can add a previously created grouped question to an exam.)
To create a grouped question from an exam, click the checkbox beside each question you wish to include in the group, and then click on 'Question Actions'. Select 'Group Questions' and provide a group name when prompted and click 'Save'. Note that you can click an additional button in the popup window to add the selected questions to an existing question group. If you choose to do so, select the existing group from the dropdown menu and then click 'Save'. The questions you group together need to be stored in the same folder to successfully group them on the exam.
On an Exam Question page, grouped items will appear together with a blue border. Grouped questions will remain together, and in order, when an exam is posted, even if the other exam questions are randomized.
There are two ways to reorder questions on an exam. In the list view of questions you can also type in the desired question order in the second column, then click ‘Reorder’ to save your choices. In the card view of questions, click on the crossed arrows beside each question to drag and drop it to the desired location. Remember you will have the option to randomize the order of questions when an exam is delivered.
To delete questions from an exam before it has been posted, click the checkbox beside each question you wish to delete and then click on 'Question Actions'. Select 'Delete Questions' and the question(s) will be removed from the list.
Note that you'll have a blue message bar alerting you to whether any questions have been updated and has new versions available. You can choose to Update All questions or look at individual questions via the table or list view and see which have their forward back arrow icon blue. If it is blue it means you are not using the most recent version of a question. Click on the forward back arrow for any question to change which question version you want to use on this exam.
Also note that when viewing a list of exam questions the options available will depend on the question permissions. Not every user will be able to edit every question. Users should be able to see a preview of the question, view any linked questions (e.g., those in a group), move questions and view versions if applicable.
After an exam is posted and taken by learners it cannot be edited so copying it will be necessary if you want to edit and reuse the exam.
Navigate to Admin>Manage Exams.
Click on ‘Exams’ from the left sidebar Manage Exams section.
Search for and click on the name of the exam you want to copy.
Click on 'Exam Actions' and select Copy Exam.
Confirm your choice by clicking 'Copy'.
Adjust the exam questions as needed.
Click on the Information and Settings tab to adjust the exam title as desired.
Navigate to Admin>Manage Exams.
Click on ‘Exams’ from the left sidebar Manage Exams section.
Search for and click on the name of the exam you want to copy.
Click on 'Exam Actions' and select the appropriate action.
If you are previewing the exam you can choose to enable the calculator or self-timer to mimic the learner view.
If you are printing the exam you can customize which fields you include in the printout. Use the selector menu in the left sidebar to select what you want to include and set some other parameters and then click 'Print'.
After you've added questions to an exam and set your setting preferences you must create an exam post to actually distribute an exam to learners for them to take.
Navigate to Admin>Manage Exams.
Click on ‘Exams’ from the left sidebar Manage Exams section.
Search for the applicable exam as needed.
Click on the cog wheel to the right of the exam title; select 'Posts' from the dropdown menu.
Or, when viewing an exam, click the 'Posts' tab below the exam title heading.
Click ‘Add New Exam Post’.
You will be guided through a multi-step wizard to configure your exam post. Complete each section, noting the following:
Exam:
When posting an exam to an event, you will only be able to access courses and events with which you are affiliated. So, for example, a pcoor can only access events in the course for which s/he is the listed pcoor. Someone with an admin role will be able to access all events.
Click 'Browse Events'. Note that a search bar is included in the resulting window.
Click on a course title.
Click on the appropriate curriculum period or click 'Show All Events'.
Click on the appropriate event.
Select an event using the drop down menu.
To go back a step at any point in selecting an event, click on the breadcrumbs (three dots) near the top of the search box.
Exam Title: Modify the exam title if necessary.
Description: This is just for internal use.
Instructions: This field will be displayed to learners on the exam intro page.
Click 'Next'.
Settings:
Enter a Start and End date for the exam to be available as needed. (Click the small gray checkbox before you enter a date and time.)
Submission Deadline: This is an optional feature. If you set this, exams must be submitted by this time.
Time Frame: This determines where the exam will display in the resources section of a learning event page. Select from none, pre, during and post.
Time Limit: This allows you to limit the length of time a learner has to complete the exam (e.g. 60 minutes). Enabling this feature will also make a Time Left counter appear to learners during an exam.
Auto Submit: If using a time limit, you can also use the auto-submit feature so the exam is automatically submitted when the time expires, assuming the learner is still active in the exam. The auto-submit tools works only when a learner is still active on the exam screen to effectively cut them off when the time limit is reached. If a user logs out without submitting their exam, auto-submit will not submit it for them.
Hide Exam From Learners: If you hide the exam you’ll be able to post it but learners won’t be able to see the post and so won't see the exam in their My Elentra task counter.
Required: Click the box to make this exam required.
Attempts: Adjust this if you’d like students to be able to complete the exam more than once.
Backtrack: Enable this if you want learners to be able to view questions already completed.
Exam Security Mode: Apply as needed. If you apply this, the wizard will require you to complete Step 6 (Security) after completing the other steps.
Mark for Faculty Review: Enable this to allow students to make notes during the exam and mark them as viewable by faculty. Note that once exam is submitted students can’t add comments.
Calculator: Enable this to allow students access to an inline calculator during the exam.
Self Timer: Enable this to allow the learner to set a timer for him/herself during the exam.
Click 'Next Step'.
Audience: Based on the learning event the exam is attached to, an audience for the exam is automatically populated in the audience step. To exclude a learner, increase time for a learner if an exam has a time limit, extend the end date for an exam for a student with accommodations, etc. use this feature.
Click the pencil in the Edit column to adjust the settings for any individual student. For all fields, click the checkbox first and then enter information. Excluded: Clicking this checkbox will exclude the learner from the exam audience. Exam Start and End Date: Click this and provide modified dates to change when a learner can access the exam. Submission Deadline: Click this and provide a new deadline to change the deadline for a learner. Extra Time: Click this and enter a percentage increase in time for the learner to complete the exam. Max Attempts: Click this and enter a modified number of exam attempts for the learner.
Click 'Update'.
Your changes will be displayed in the table.
To delete an exception, return to the edit window for a specific learner on the list.
Click 'Next'.
Feedback:
Release Score: Click this to return scores to leaners after the submit an exam. Enable ‘Release Feedback’ if you want learners to access the information stored in the rationale section of the exam items when they get their scores; you can further modify whether to release rationale for all question or just incorrect questions. If you have included short answer or essay questions in an exam and you expect faculty to provide narrative feedback which you wish students to view, you must set the exam to release feedback for ALL questions for learners to be able to see the narrative comments from the grader.
Set the release start and end dates to delay feedback if required. This might be useful if two sections of a class are completing the exam at different times and you don't want any learners to see their results until all learners have completed the exam.
Re-Attempt Threshold: Set a minimum score to merit completeness, then set an allowable number of attempts to attain the minimum score. For example you can specific that a learner must achieve 80% on this exam and has two attempts to do so. If the learner scores 50% on their first attempt the system will automatically let them take the exam once more.
Attach GradeBook: Select an existing gradebook entry to attach the exam to (the list will prepopulate based on the course and event selected in earlier steps and the contents of the gradebook for the relevant curriculum period). The results of this action are that once graded, the grades from this exam will automatically populate the gradebook entry.
Review:
This page provides a summary of all the choices you’ve made for this exam post. If you need to change something click on the Previous button to return to an earlier screen.
Click 'Save Post and Continue' and if you are using security settings you will be redirected to complete the Security information.
Security Settings:
When creating security settings you can create a basic password, use Safe Exam Browser, or use RP-Now by Software Secure. Basic Password: Set (or generate) a password that you’ll distribute to learners in order for them to access the exam.
To use Safe Exam Browser or PR-Now you do need some additional setup from a development side. Only use these options if you know your organisation has them configured.
Safe Exam Browser: Follow the instructions on the screen to use SEB. RP-Now by Software Secure: Follow the instructions on the screen to use RP-Now. * Click 'Save Security Options'.
You will be redirected to the list of exam posts.
On the Posts tab, click the cog in the Actions column for a specific exam post.
Click 'Edit Post' to reopen the exam post wizard and make any required changes.
When on the Posts tab of an exam note that you can adde and remove columns from the list of exam posts to see more or less information.
Click 'Show/hide columns' to add or remove the columns you'd like to be able to view.
In order for faculty to access exams and grade them, the faculty must be added as graders to an exam post. Additionally, you must have groups within a course (to configure groups go to Admin>Manage Courses). Make sure you have groups configured before you try to add graders as the only was to successfully save grader names is for them to be attached to a group. (If you are attaching an exam to a gradebook entry there is the option to add graders to the gradebook entry. This will not allow faculty to access the exam to grade. To allow someone to grade an exam they must be added as a grader to the specific exam post.)
Navigate to Admin>Manage Exams.
Click on ‘Exams’ from the left sidebar Manage Exams section.
Search for the applicable exam.
Click on the cog wheel to the right of the exam title; select 'Posts' from the dropdown menu.
Or, when on an exam page, go to the Posts tab.
Click on the cog under the Actions column and select 'Edit Graders' from the dropdown options.
If you cannot see the Actions column, click 'Show/hide columns' to add the Actions column.
Add Graders by typing a name in the text box, and clicking on the appropriate name. To attach a grader to an exam, the grader must be associated with the course through the course setup page. Navigate to Admin>Manage Courses>select course>Course Setup. In the Associated Faculty section, add any faculty you want to make graders.
Any existing Course Groups will appear (if you need to create course groups go to Admin>Manage Courses>Groups). Assign groups to a grader or allow the system to randomly distribute groups to graders.
Click 'Save Grader Settings'.
Navigate to Admin>Manage Exams.
Click on ‘Exams’ from the left sidebar Manage Exams section.
Search for the applicable exam.
Click on the cog wheel to the right of the exam title; select 'Posts' from the dropdown menu.
Add or remove columns from the display by clicking 'Show/hide columns'. You will need to see the Actions column to proceed.
Click on the cog under the Actions column and select 'View Activity' from the dropdown options. The resulting page will show you which learners have completed an exam, their scores, start and submission dates, etc.
From here you can delete progress records as needed (this will allow you to delete an exam post, and an exam if necessary).
Options exist to copy and paste existing questions into a text box, or migrate questions, images, and responses from another exam management tool.
Navigate to Admin>Manage Exams.
Click on ‘Questions’ from the left sidebar Manage Exams section.
Click on the Import sub-tab.
Select a destination folder from the dropdown menu.
Paste in the question(s) text. Note that specific formatting required.
Question type is required for each question. To format your question types, begin with “type:” followed by a space and then one of the following question type codes: mc_h Multiple Choice Horizontal mc_v Multiple Choice Vertical short Short Answer essay Essay match Matching text Text mc_h_m Multiple Choice Horizontal (multiple responses) mc_v_m Multiple Choice Vertical (multiple responses) fnb Fill in the Blank
You can also indicate the following information for any question, although it is optional:
description (this is short description or title of the question)
rationale
correct_text (this can be used for short answer or essay questions)
code
locked response(s) - this allows you to lock a response option on a question if you intend to randomize question response options when you post the exam
Example: 1. Which are vowels? a. a b. e c. i d. All of the above answer: d type: mc_v folder: /some/folder locked: d
curriculum tags - this allows you to import curriculum tags with your questions. To use this feature you need to know the curriculum tag id. These can be found in Admin>Manage Curriculum. When you open a curriculum tag set, toggle to the table view of curriculum tags (use icons beside 'Add Tag'), and if ID is not a visible field, add a column by clicking the columns selector (under the Import from CSV button) and adding the ID column. To the question text add a line formatted like this: curriculum_tags: 1024, 1025
Each question shows the minimal amount of information required. It is recommended that you also provide description, rationale, etc.
Multiple Choice Vertical Multiple choice vertical questions have a type of "mc_v". They include one or more answer choices, and an attribute "answer" for the letter of the correct answer. An example is shown below.
What is your favorite color? a. red b. green c. blue
answer: a type: mc_v folder: /some/folder
Multiple Choice Vertical (multiple responses) Multiple choice vertical questions with multiple responses have a type of "mc_v_m". They include one or more answer choices, and one or more "answer" attributes for the letter(s) of the correct answer(s). An example is shown below.
Which of these are blue? a. sky b. ocean c. trees
answer: a answer: b or answer: a, b type: mc_v_m folder: /some/folder
Multiple Choice Horizontal Multiple choice horizontal questions follow the same format as multiple choice vertical, but with a type of "mc_h". They can have at most 5 answer choices. An example is shown below. Note that questions presented in horizontal view to learners will not have the strikethrough feature available when learners take an exam.
What is your favorite color? a. red b. green c. blue
answer: a type: mc_h folder: /some/folder
Multiple Choice Horizontal (multiple responses) Multiple choice horizontal questions with multiple responses have a type of "mc_h_m". They include 1-5 answer choices, and one or more "answer" attributes for the letter(s) of the correct answer(s). An example is shown below. Note that questions presented in horizontal view to learners will not have the strikethrough feature available when learners take an exam.
Which of these are blue? a. sky b. ocean c. trees
answer: a answer: b or answer: a, b type: mc_h_m folder: /some/folder
Short Answer Short answer questions have a type of "short" and require only the question stem although it is recommended to provide correct text and rationale. An example is shown below.
Where is your favorite color? type: short folder: /some/folder
Essay Essay questions have a type of "essay" and require only the question stem although it is recommended to provide correct text and rationale. An example is shown below.
What is your favorite color and why (3-5 sentences)? type: essay folder: /some/folder
Matching Matching questions have a type of "match". They have one or more answer choices, one or more item stems, and the same number of correct answers as item stems. The answer choices are shown as options for each item stem. The item stems are a piece of text or a question that corresponds to one of the answer choices. The correct answer for an item stem is identified by the answer choice's letter. The correct answer attributes are assumed to be in the same order as the item stem attributes. An example is shown below. Note that when learners answer this type of question the system does not automatically eliminate responses (i.e., a learner can put answer c as a match for multiple stems). When scoring a matching question the system uses an all or none system (for questions where you can give partial scores use multiple choice, multiple responses).
This is the matching question stem. a. This is the first answer choice. b. This is the second answer choice. c. This is the third answer choice. item: This is the first item stem, its correct answer is choice C. answer: c item: This is the second item stem, its correct answer is choice A. answer: a type: match folder: /some/folder
Text Text questions are not questions at all; they are generally used as instruction text for further questions. Text questions have a type of "text" and require no other special attributes. An example is shown below.
The next three questions cover the following scenario: A patient arrives at your family medicine clinic at 2:30 on a Friday afternoon... type: text folder: /some/folder
Fill in the Blank Fill in the blank questions have a type of "fnb". The blanks are indicated by the string "?" in the question stem. Fill in the blank questions can have an "answer" attribute for each blank indicating possible correct answers for that blank; the possible correct answers are separated by pipe characters, "|". These "answer" attributes refer to the blanks in order. An example is shown below, in which the first blank has possible correct answers of "woodchuck", "beaver", or "marmot", and the second blank has possible correct answers of "woodchuck", "hamster", and "groundhog".
How much wood could a ? chuck if a ? could chuck wood? answer: woodchuck|beaver|marmot answer: woodchuck|hamster|groundhog type: fnb folder: /some/folder
Migrate Questions (only available to Medtech Admin) To import existing questions from another exam management tool, navigate to Admin>Manage Exams>Questions and click on Migrate Q’s. Indicate a folder you wish to populate and attach the appropriate file noting the requirement for plain text format. (See additional migration instructions here.) Then, click ‘Import Questions.’
Migrate Images (only available to Medtech Admin) To import existing images from another exam management tool, click on the Migrate Images tab. Attach the appropriate file noting the requirement for HTML format (should they select a folder or is there a question id it looks for?). Then, click ‘Import Question Images.’
Migrate Responses (only available to Medtech Admin) To import existing responses from another exam management tool, click on the Migrate Responses tab. Attach the appropriate file noting the requirement for plain text format (should they select a folder or is there a question id it looks for?). Then, click ‘Import Responses.’
If you are in an admin role and have imported questions from ExamSoft you may see some questions display under Flagged Questions. If you tried to import any questions from ExamSoft which were NOT multiple choice you'll need to review them in the Flagged Questions tab. Similarly, questions with images attached will also appear here. Non multiple choice questions are flagged because the import system can't tell if they were supposed to be matching, fill in the blank, or essay type questions. By default they are given a type of essay but this will need to be changed for matching or fill in the blank question types.
If the question is correct, you can click the flag icon in the top right corner to unflag it.
If the question needs to be edited, you can click the pencil icon in the top right corner. Saving an edited question automatically unflags the question.
The Exam Module allows users to create and store a variety of assessment items (e.g., multiple choice items, essay questions, matching items, etc.), import existing assessment items (from text documents or ExamSoft), create and post exams, have learners complete exams in a secure online environment, allow faculty to grade exam questions, and report on exam results.
Only users with appropriate permissions can access the Exam Module by navigating to Admin>Manage Exams. Note that only users with Admin roles can migrate questions from another exam software tool.
There is now an account option to allow for a student user to be a 'Student Admin.' This allows for a student to access Manage Exams, but they only have access to question folders where they have permission as a folder author. To set up a student as a Student Admin, navigate to Admin>Manage Users, select the user, and in the Account Options section, set the Student Admin field to 'Yes'.
From the Exam Dashboard, users will see recent exams to which they have access, and any exams to grade (click on either tab to switch screens). Recent Exams will show exams from the previous 30 days. Access Questions or Exams from the Manage Exams card on the left sidebar.
Frequently used features: Randomization of questions must be set in an exam's information and settings. Adding resources to an exam (e.g. PDF) must be completed on an exam's information and settings page. Enabling tools for exam takers like calculator, self-timer, etc. is completed when making an exam post. Security for an exam is set when you create an exam post. Adding graders to an exam is set after an exam has been posted.
If you want to use Safe Exam Browser to provide security for your exams, follow these instructions.
Login to the computer with a user account that has admin rights
Download Safe Exam Browser 2.1.x for Windows: http://safeexambrowser.org/download_en.html
Run the Safe Exam Browser Installer (SafeExamBrowserInstaller.exe). After the installation a Safe Exam Browser shortcut should be placed on the desktop
Copy the provided SEB Client Configuration file (SEBClientSettings.seb) to the following location: PROGRAMDATA\SafeExamBrowser\ (typically C:\ProgramData\SafeExamBrowser)
Reboot the computer
Launch SEB by double-clicking on the desktop shortcut and verify that the Elentra login screen loads.
After clicking on the exam link, if it tries to install SEB again
Select "Do not close application..."
No to "Restart computer"
Ok to the error with reading the tmp directory.
Try to launch the exam again, it should open and prompt you to login again.
Note: DO NOT upgrade on top of an existing version, always uninstall the old version before installing the new version.
To apply Safe Exam Browser to a posted exam, navigate to the exam post and go to Step 6: Security
Edit the post and on Step 6: Secure Settings, copy the URL that is provided in the blue box in the "Safe Exam Browser (SEB) File” section. (Tip: Leave the browser window open as you complete the remaining steps)
Launch the "SEB Config Tool” from the Windows Start Menu (Start->Safe Exam Browser->SEB Config Tool)
Paste the URL copied in Step 10 in the “Start URL” field
Password-protect the SEB Exam file by creating a password in the “Administrator password” section.
Switch to the “Config File” tab
Under “Use SEB settings file for…” select the option “starting an exam"
Switch to the “Exam” tab
Check the checkbox that reads “Send Browser Exam Key in HTTP header
Under the “Link to quit SEB after exam” enter https://yourschool.edu/secure/secure-logout
Switch to the “Hooked Keys” tab
Check that checkbox that reads “Enable Right Mouse” and uncheck everything else
Switch to the “Config File” tab
Click the button “Save Settings As…” and save the SEB Exam file
If prompted to save an unencrypted SEB file, choose Yes.
Switch to the “Exam” tab
Copy the SEB Browser Exam Key under the “Browser Exam Key” section
Switch back to your web browser that is currently on the Post Exam settings page
Upload the SEB Exam file you just created by clicking the “Browse” button, selecting the file you named in Step 22. After the file finishes uploading, it should appear in the “Safe Exam Browser (SEB) File” section
Under the “Secure Key” section, click the “+” button toward the top-right corner
Paste the SEB Browser Exam Key that you copied in Step 25 in the “Browser Key” field
Enter the version of Safe Exam Browser that you used to create the SEB Browser Key and the Operating System (e.g. Win 2.1.2)
Click “Next Step” and continue through each step. When you reach the last step, click “Save Exam Post"
Launch SEB and login to Elentra
Navigate to the Exam you wish to take and verify that you can login and that the exam loads
Navigate to Admin>Manage Exams and select a recent exam or click on Exams on the left to select an older exam.
Open the selected exam and click on the Reports tab to see a selection of available reports.
Curriculum Tags Report: Filter by curriculum tag, exam post and learner (optional) to view learner performance across curriculum tags. You can also view one learner’s performance compared to the class average (can be turned on or off).
Item Analysis Report: View a variety of statistics relevant to an exam post. View results on the screen or download as a CSV.
Learner Comments Report: View a compilation of all learner comments from an exam post. The report shows questions, responses, and comments.
Learner Responses Report: Download a list of all learner responses (by question number and point value) from an exam post.
Print View: Access a printable copy of the exam including questions and correct answers.
Score Report: See an overview of learner performance on the exam. Modify columns to view as needed and download the results as a CSV.
Summary Report: Generate a report that includes exam performance, curriculum tag performance, the lowest 27% of learners, and item analysis.
Learner Curriculum Tags Report: This tool allows you to release exam results, based on performance on specific curriculum tags, to the learner. You can customize when learners can access results, which tag sets they should see, and to which learners this applies. If you set this up, the learner will see an additional 'Category' tab when viewing their submitted exams and if they click on it will see a personalized report showing their performance for specific curriculum tags.
You can view the history of an exam including changes to the exam items, posts, score adjustments, etc. from the History tab of an exam page.
There are two ways to view student scores.
Navigate to Admin>Manage Exams, and select the relevant exam.
Click on the Posts tab, and from the cog on the right side, select View Activity for the appropriate post.
You can show or hide different columns, click on a column header to sort the list, adjust the number of learners shown on the screen, search for a specific learner and download the results as a CSV.
You can also access student scores from a learning event where an exam is a posted resource. From a learning event content page, scroll down to “Posted Exams” and click on view results. This will take you to the Assessment Activity page.
Once an exam has been created, you can control some options for the delivery of the exam.
Navigate to a list of your exams and click on the name of the exam you'd like to work with.
Click on the Information & Settings tab just below the exam title heading.
Complete or adjust the sections as desired, noting the following:
Exam Information:
Title and description: Adjust as needed. The description is not made visible elsewhere.
Parent Folder: You are required to add the exam to a folder. Click 'Select Parent Folder', click on the required folder, and click 'Done'.
Adding someone to the permissions list will give them access to edit the exam and view its statistics. To add permission for other users to access an exam, select the user type (individual, organisation or course), begin to type in a name and click on the name you want. The selected user will appear on a list below. To remove a permission click the red x beside a name. If you make an exam accessible to an organisation it means anyone in that organisation with access to the exam module will be able to access the exam. If you make an exam accessible to a course, anyone listed in the course contacts section of the course setup page will be able to access the exam.
Exam Settings:
Set how questions will be displayed to learners (note that you can add a page break to an exam from the Exam>Questions tab).
Randomize questions: If you want questions to be delivered in a random order to the audience of the exam, set this to on. Remember, grouped questions will be kept together.
Randomize answers: If you want the answer responses for questions to be delivered in a random order to the audience of this exam, set this to on.
Exam Data: This section shows you the total number of questions and points and shows you how curriculum tags have been applied to this exam. There is nothing you can edit here but you can search for specific curriculum tags to see their use across the exam.
Exam PDFs: Use this space to upload any resources you want learners to be able to access during the exam (e.g., dosage chart, x-ray image). During an entire exam learners will be able to click on a small paperclip icon to access these resources.
Exam items include the questions, prompts, etc. that are included on an exam. Items are stored in folders and can be created through the Questions tab, while creating an exam, or can be imported. To allow other users to access questions to edit them or use them on exams, you must add permissions to the questions. This is done after the question is created.
Only users with Admin roles can create question folders. This is be design to limit the duplication of folders and promote consistent methods in storing items. Note that non admin users will be able to add questions to existing folders.
Navigate to Admin>Manage Exams and click 'Questions' from the left sidebar.
If a new folder is needed, click 'Add New Folder'.
Complete the required information, noting the following:
Click 'Select Parent Folder' if you want to create a subfolder within an existing folder. The permission settings of the subfolder will automatically match the permission settings of the parent folder. Click on the desired parent folder and click 'Move'. Folder Text: Provide the folder title here. This will display when you click 'Questions' and see a list of folders. Folder Description: You will only see this if you open the folder to edit it. Folder Color: The system requires you to select a color.
Click 'Save' to create the folder. You will be redirected to the list of folders but in the dialogue box that pops up you can also click to go to the Edit Folder page and add permissions to the folder.
To copy, delete, edit and manage folder authors, or move a folder, click the the gear icon to the right of the folder name. You will only have the ability to do this if you created the folder or are listed as a folder author.
To add permission for other users to access a folder, select the user type (individual, organisation or course), begin to type in a name and click on the name you want. The selected user will appear on a list below. To remove a permission click the red x beside a name. If you make a folder accessible to an organisation it means anyone in that organisation with access to the exam module will be able to access the folder. If you make a folder accessible to a course, anyone listed in the course contacts section of the course setup page will be able to access the folder.
Hide the list of question folders by clicking on the eye icon beside the Add New Folder button.
Click on a folder to view its subfolders.
Elentra currently supports a variety of question types: Multiple Choice (vertical and horizontal – use ‘multiple responses’ to allow for multiple correct answers), short answer, essay, matching, text, and fill in the blank. Different question types have different templates for their layout.
A ‘text’ question can be used to provide instructions.
Note that questions presented in horizontal view to learners will not have the strikethrough feature available when learners take an exam.
Within a folder, users can manually add individual questions, import questions in bulk through a free text box, or migrate questions, images, and responses from another exam management tool (this last tool is only available to Medtech Admins). This section addresses how to manually create individual questions; please see additional tabs for information on importing questions. Note that the system stores a record of who created a question and displays this information in the question detail view.
Navigate to Admin>Manage Exams and click 'Questions' from the left sidebar. You will automatically be working under the Questions tab.
Click 'Add New Question'.
Complete the required information noting the following: Question Stem: Type the question text in this section and edit it using the rich text editor. Insert images, tables, horizontal lines, hyperlinks, etc.
To insert an image into a question stem, click the landscape icon in the rich text editor. In the Image Properties popup window select ‘Browse Server,’ drag and drop or choose a file from your computer to upload. After you’ve added the image you can change the name in the Alternative Text field; additionally, you can adjust the Width and Height fields (it is recommended that you click on the lock icon to change the aspect ratio of the image).
To insert media into a question stem, click the film strip icon and paste the embed code into the popup window.
Question Information:
Question Type: Select the required question type. (Note: use ‘multiple responses’ questions if you want to have multiple correct answers.)
Question Description: Add a descriptive title. This will display in the list view of exam items and is helpful when scanning a list of items within a folder.
Rationale: Add a question rationale. Rationale is shown to learners when they get feedback on their exam and can explain a question answer or provide additional detail.
Correct Text: This option will display only when creating essay and short answer questions. It is a space to provide sample answers or list what should be included in an answer. This text is notvisible to learners and is intended to provide information to graders. When a grader corrects a free response question, they will see the correct text on the screen to help them grade the response. If you use this question type and have faculty provide narrative feedback when they grade the questions, you must set the exam to release feedback for ALL questions for learners to be able to see the narrative comments from the grader.
Question Code: This optional code field can be completed according to the guidelines set by your institution. (Every question will also automatically be given a unique identifier within Elentra and that unique id displays when viewing a list of questions within a folder.)
Parent Folder: If you were already in a folder when you clicked 'Add A New Question' this will automatically list that folder. If you were not already in a folder, it is mandatory to assign your question to a specific folder. Click 'Select Parent Folder', click on a folder name, and click 'Done'.
Question Answers:
To add more answer options, click the green 'Add Answer' button. To reduce answer options, click the large checkbox beside the correct response, crossed arrow and lock icons, then click the red 'Delete' button on the left.
Click the existing red checkmark beside a response to turn it green and indicate a correct answer; depending on your question type you can have multiple correct answers for one question.
You can create Rationale for each answer option by clicking on the eye icon beside the Add Answer button. This will open a free text rationale space below each answer option. This does not currently display to learners so is just for information storage at present.
Reorder answer options by clicking on the crossed arrows and dragging and dropping the response item in the appropriate place.
If you intend to later randomize the answer response options for all questions on an exam post and want to lock an answer in place, move it to the appropriate location and click on the lock icon to close it and turn it red. An example for using this might be a multiple choice question where an answer option is "All of the above" and you always want this option to appear last in the list of answer options. (A reminder that you will set up randomization of questions and/or response options when you create an exam post.)
Curriculum Tags: You can add curriculum tags to any question based on the tag sets configured through Admin>Manage Curriculum. Click 'Add Curriculum Tag', click on tag set names to drill down to the tag you require, click on it and it will appear in the list on the right. Some of the exam reporting tools rely on curriculum tags so in addition to mapping your curriculum and assessments, this can be useful to do for reporting on assessment results. Note that you can apply curriculum tags to multiple questions at once using the Actions options after questions have been created.
For certain question types, additional fields and information may be required:
Fill in the Blank Questions: When creating the item text for a fill in the blank question, create a blank by inserting underscore, question mark, underscore. You must have the same number of question answers as you do blanks (you can have multiple correct answers in each question answer if needed). Please note that fill in the blank answers are case sensitive. You may wish to include two answers (e.g. cardiac arrest and Cardiac Arrest) to ensure learners are properly credited for their answers.
Matching Questions
When you create matching questions, please note that the place to provide the correct answer is at the top of each Item Stem option.
When the learner sees the question, they'll get a list of stems and then each stem will have the same dropdown options that they can match to the stem.
Multiple Choice Vertical and Horizontal (multiple responses): Grading Scheme
For these question types you can set the grading scheme as partial, all or none, or partial with penalty. Partial: This will give partial credit for every correct reaction (e.g. selecting a correct answer AND not selecting an uncorrect answer). It divides the total point value across the number of response options and awards credit for each response option which is correctly responded to (selected if correct, not selected if not correct). All or none: A learner must answer all correct answers correctly. If they miss an answer (whether they select an incorrect answer or miss selecting a correct answer), the learner will get 0 points. Partial with penalty: This will give partial credit for every correct reaction and will penalize a learner for an incorrect answer. The system divides the total point value across the number of response options and awards credit for each response option which is correctly responded to (selected if correct, not selected if not correct) and deducts credit for an incorrect answer.
Click 'Save' to save your question.
To add permissions to individual questions, navigate to a list of questions and click the pencil icon beside the question title.
Click the greyed out Question Information heading to open it.
In the Question Permissions section, select the user type (individual, organisation or course), begin to type in a name and click on the name you want. The selected user will appear on a list below. To remove a permission click the red x beside a name.
Only users with admin roles can create grouped questions through the Manage Exams Question menu. Other users will be able to create grouped questions when creating an exam.
The function of a grouped question is to bind a number of items together and have them appear together on an exam. Grouped questions will be stored in the Grouped Q’s tab.
Navigate to Admin>Manage Exams and click 'Questions' from the left sidebar.
Click the Grouped Q's tab just above the Questions heading.
Click ‘Add Group’.
Provide an appropriate group title and then add a description if desired. This will display in the list of Grouped Q's.
Provide an optional description for the grouped question.
Add permissions to allow another user to edit this group if applicable. A user must have permission to a question to add it to an exam at a later date.
Click Attach Questions to search for and add existing questions. o Click the checkbox beside each desired question (or select all by clicking the checkbox beside the 'Actions' dropdown menu above the list of items). o Click ‘Attach Selected’ in the top right.
Click the down arrow beside Attach Questions to create a new question in the question bank and add it to your grouped item at the same time. o Create a question and click ‘Save’ when done. You will return to the Edit Grouped Question page and can add another question.
After attaching the required questions, reorder them as desired by clicking the crossed arrows and dragging and dropping the questions, and then click the blue ‘Save’ button.
You will see a green success message on the screen and then can navigate to a new location.
To edit an existing grouped question, click on the question title to reopen it. To delete questions from a grouped question, open the question, click the checkbox above the question ID number and click 'Delete Questions'.
To delete entire grouped questions, from the Grouped Q's list click the checkbox beside the grouped Q title and click 'Delete Group'.
You can also group questions from an exam. For more detail on that process, see the Exams>Create help section.
View all questions or questions within a folder in list form or detail form by selecting the different grid icons.
In Question Detail View, quickly show details for all questions by clicking on the eye icon to the left of the 'Add A New Question' button. To review details or make edits to a question click the eye or pencil icon respectively. Note that if an item is part of a grouped Q you will also see a chain icon. Click on it to see the details of the grouped Q.
In Question List View, click the pencil icon to edit a question, click the magnifying class to preview a question, click the chain icon to view grouped Q details, or click the forward back arrows to see an overview of question versions.
An important aspect of viewing questions is the ability to turn subfolder view on or off. If subfolder view is off, you'll only see questions in a folder when you've clicked on that folder. If subfolder view is on you'll see all questions within all applicable folders. If you click on a folder that has multiple subfolders this allows you to quickly see all the contents of all subfolders at once.
Select questions by clicking on the checkbox beside their title (or select all by clicking the checkbox beside the 'Action' dropdown menu).
To delete a question, click the checkbox beside the question, from the Action dropdown menu select Delete. Confirm your choice by clicking 'Delete'. The question will be removed from the list.
To move a question to a new folder, click the checkbox beside the question, from the Action dropdown menu select Move, click on the appropriate destination folder, and click 'Submit'. You will see a green success message at the top of the screen.
To change the curriculum tags applied to multiple questions, click the checkboxes beside the questions, from the Action dropdown menu select Tag Questions, choose how you want to change the question tags, click on tag set names to drill down to the tag you require, click on it and it will appear in the list on the right, and then click 'Apply'.
Any time you make a change to a question, a new version will be recorded. A new version will be created for any change—correcting a typo, linking the question to additional curriculum tags, altering a response option, etc.
When creating exams, you can add a question with multiple versions and actually select an older version if desired. Do this by clicking on the forward/back arrow icon. If a question has changed since you created an exam you will be given a notification for that and can update your exam, however you can still elect to use the old version of the question if you prefer. If the forward back arrow icon is blue it means you’re not using the most recent version of a question on an exam.
Click on a folder title to look for questions within a specific folder. Turn sub-folder view on or off to see more or fewer questions.
Type in a word or phrase to retrieve any questions with matching terms. The search feature looks within question descriptions and stems.
Use Advanced Search to further refine your results by filtering by a curriculum tag, question permissions, or exams. You can apply multiple tags to one search. To use the Advanced Search feature, click 'Advanced Search', click your desired filter type, click through hierarchies and type text within a hierarchy to find your desired filter, scroll down within the advanced search window and click 'Apply Filters'. The tags you've applied will display under the search bar. Remember to clear your filters as needed when you begin a new search. You can click on the x beside a filter name or open Advanced Search and click 'Clear All Filters'.
Toggle between a list view and question detail view of your search results using the icons on the left (beside the subfolder on-off control).
In list view, edit, preview, or view groups for a question by using the pencil, magnifying glass, and chain icons respectively.
In question detail view, quickly view the expanded details of all question by clicking on the eye icon to the left of the Actions button.
When faculty are assigned as graders on an exam, they will be able to access exams to grade from Admin>Manage Exams. On the Exam Dashboard they should click on the Exams to Grade tab. Users will see a list of any exams where they are assigned as a grader.
By clicking on an exam title the user will be taken to count of exams they have not started grading, are in progress, or are completed. Graders can switch from grading by student to grading by question, depending on their preference. Clicking on any status card (e.g. Not Started) will show a list of the exams that remain in each category.
By clicking on a student name (or question number if grading by question), the user will be taken to a screen where they can view exam answers and provide feedback and a grade. If a 'Correct Answer' was provided with the question, the grader will be able to see it to use as a guide when grading. Graders can also type feedback that will be visible to the learner depending on the exam post settings.
If you are using RPNow to provide exam security, note that after an exam post is created you'll have the option to automatically email learners their exam codes, or to email a course director with the exam code for each learner. From the posts screen, look in the Actions column for an email icon.
Click the email icon.
Check off whether to email the course director or students. If you choose to email students the default email text will display.
Edit the email subject line as required.
Edit the email content as required, noting the available variables.
Click 'Send'.
If you email the course director, s/he will receive a csv file listing student names, emails, and exam codes. The email will have RP-Now Exam Codes as the subject line but will not include any text in the body of the email.
For additional information about how to use security settings, please see the Exams>Information and Settings help section.
The history tab of an exam page provides you with an overview of who created and edited the exam over time. The History tab will be accessible to any user with permission to access the exam.
