Exam and Invigilation Platform Constraints

Exam Platform Constraints 

  Instructor Constraints Student Constraints
Canvas - Classic Quiz
  • Only multiple choice, true/false, and multiple answer question types have the option for regrading.
  • If multiple graders are grading the same quiz, they may override each others’ grades and comments.
  • If multiple “file upload” questions are displayed on the same page and students upload video files (or large files), the files will not upload successfully.
  • To view the files students have attached to “file upload” questions, the instructor must download the files.
                         
  • If an exam is timed, the timer continues running even if the student loses internet connection.            

            

Canvas - Assignment (file upload) submission
  • Cannot grade by individual question.
  • If multiple graders are grading the same assignment, it may override each others’ grades and comments.
                 
  • File size cannot exceed 5GB per upload            

            

Crowdmark - Assigned Assessment
  • Instructors have to manually create each question.
  • Certain email servers (e.g. xxx@163.com) block Crowdmark emails, hence students cannot receive the assignment link. Instructors need to ask students to update their email address in Canvas and request the LT Hub do a resync of the class roster.
  • Students need to have access to a mobile device that can take pictures or scan their work.
  • Low quality cameras make it difficult to take clear images
  • Submission by mobile device is not currently supported.

            

Gradescope - Exam/Quiz
  • Instructors need to distribute the exam template to students outside of Gradescope (e.g. email, post on Canvas, etc.)
  • Students need to have access to a printer to print the exam.
  • Students need to have access to a mobile device that can scan their work to a PDF.
  • Low quality cameras make it difficult to scan clear images.

            

Gradescope - Homework/Problem Set
  • Instructors need to distribute the exam questions to students outside of Gradescope (e.g. email, post on Canvas, etc.)
  • Students need to have access to a mobile device that can take pictures or scan their work.
  • Low quality cameras make it difficult to take clear images
  • During submission, students have to tag their image/pdf uploads with the corresponding question number in the exam.

            

*For all the tools listed above, if used in a large enrolment course, it is recommended to stagger your exam start times to mitigate potential load issues.

Gradescope/Crowdmark Mitigation Strategies for Exams:

  • If possible, consider creating a "practice exam" with similar format and requirements for students to complete beforehand.
  • For any course with more than 150 students, use a staggering approach when implementing exams in GradeScope/Crowdmark. The staggering intervals should be at least 5 minutes apart.
  • Have a back-up plan (an alternative technology) in place with the exams configured and set to switch over to, in the event of major server failure.
  • Notify Skylight LT in advance that you will be using Gradescope/Crowdmark for your exam to coordinate support and communication.

Proctorio Constraints

Instructor Constraints

Student Constraints

No built-in consent form feature

Proctorio can only be used on Chrome. Students will need to download the Chrome browser and the Proctorio Chrome extension. Chrome and Proctorio extension may push out updates before the exam and students are unaware until the exam.

Proctorio does not force students to close these items before they take the quiz:

  • Incognito Chrome windows

  • Private and non-private windows from other Internet browsers

  • Other Applications (such as note or calculator applications)

If the Chrome extension is not installed, students will receive an error message.

  • If they click  “click here”, students will go to the download page to download the extension.

  • If they ignore the message, they will be prompted to enter an access code.

Proctorio can only be used with Canvas (Classic) Quizzes

Equipment requirements:

  1. Proctorio does not work on mobile devices (e.g. iPad, iPhone, tablets, etc.).

  2. To record video of students during the exam, students MUST have an external/built-in webcam

  3. To record audio of students during the exam, students MUST have an external/built-in microphone

A time limit must be set on a quiz in order for Proctorio to work

Students are recommended to have at least 2GB of RAM available on their computer, otherwise a warning will appear indicating that the program could crash.

The recordings are not processed immediately and can take some time before it gradually appears in the Proctorio gradebook (especially for large courses).

When students do the room scan, it takes a few seconds for the “Record Room” scan to start. The timer on the quiz does not pause during the room scan.

It can be challenging for students to do a room scan with built-in webcams since it cannot be easily rotated.

The Proctorio “Exam Settings” cannot be changed once the first student has started the exam.

Proctorio support (support@proctorio.com) flags emails with a .gmail domain as spam. Students are recommended to contact support at 1-866-948-9087 or inside an active exam, access live chat by clicking the shield icon located in the Chrome browser address bar, then clicking Live Chat.

Disabling Proctorio for one student leads to other students seeing two options when taking the exam: “Take the Quiz” and “Take with Proctorio”

The “Basic Whiteboard” (In-Quiz tool) is only one page long. If students clear the whiteboard, they cannot recover what they deleted. Limited space if using it as scrap paper.

 

If students click “stop sharing” (at the bottom of the screen) during the exam, they will be kicked out of the exam, without any warning.

Recommended Proctorio Settings

The following Proctorio exam settings are recommended to be disabled:

  1. Recording Options:

    • Disable “Room Scan: Intelligent Scan” - students may be required to redo their room scan multiple times during the exam

  2. Lock Down Options: 

    • Disable “Force Full Screen” - this setting requires students to stay on the exam the whole time, which makes troubleshooting technical issues difficult

    • Disable “Prevent Re-entry” - this setting locks students out of their exam for potentially benign behaviour, requiring administrative work by the instructor to resolve

Note: Proctorio Exam Settings cannot be changed after a student has started the exam so it is important to verify that you have the correct settings before the exam starts (only Behaviour Settings can be changed after the exam has started). 

Please review the Proctorio Instructor Guide on the Keep Teaching website for additional recommended settings.

 

Zoom Constraints

Instructor Constraints Student Constraints
If Zoom is used for exam invigilation, it would be difficult to identify where the noise is coming from if all the students have their audio enabled. Students need to have a webcam and microphone if Zoom is used for invigilation purposes.
The video quality is unpredictable and is dependent on internet connection. The video feed on Zoom can be blurry and pixelated if there is poor connection. Students may have privacy concerns.
Breakout Rooms:
  • A maximum of 50 breakout rooms can be created for each session.
  • Only the host of the meeting can assign participants to the breakout rooms.There can only be one host per meeting.
When joining a session using the web client (e.g. joining from your browser), certain browsers do not support all the features in Zoom. The recommended browser is Chrome (see this link for details on what is supported)
Anyone who has the meeting join URL will be able to join the session. When joining a session using the Zoom desktop application, students cannot private message the host/co-host (works if joining via web browser) in the breakout room. They can only send a message that will be visible to everyone in the breakout room.

Blackboard Collaborate Ultra Constraints

Instructor Constraints Student Constraints

The number of attendee videos that can be displayed at once depends on the browser and device one is using (ranges from 2-4 video feeds):

  • Chrome, Safari, Microsoft Edge (Chromium): 4 videos 

  • FireFox: 2 videos 

  • Sessions greater than 250: 2 videos

Students need to have a webcam and microphone if Blackboard Collaborate Ultra is used for invigilation purposes.

If used for exam invigilation, it would be difficult to identify where the noise is coming from if all the students have their audio enabled.

The dial-in phone number is a US number and may incur long distance charges, depending on the student’s phone plan

The video quality is unpredictable and is dependent on internet connection. The video feed can be blurry and pixelated if there is poor connection.

It can be distracting to other students if the instructor/teaching team asks each student to share their screen after they are made Presenters

Breakout Groups:

  • You can create up to 20 groups. 

  • Breakout groups are only available in sessions with 250 or fewer attendees.

  • What is said or viewed in a breakout group isn't captured in recordings. 

  • Collaborate stops recording your session if all attendees leave the main room to join breakout groups.  

 

If you want to supervise private chats or allow participants (students) to only chat with moderators (instructors/teaching team), you must select each option in Session Settings BEFORE the session starts.

 

When the moderator (instructor) removes an attendee, the participants (students) are not allowed to rejoin the session if they joined from Canvas.

 

Only Moderators (instructors/teaching team) and Presenters can share screens. Only one screen can be shared at a time.

 

Learning technology support

If you have any questions or if you would like to report an issue regarding a learning technology, please don’t hesitate to contact us at LT.support@science.ubc.ca. For in-person support, please join our LTRs at one of our drop-in sessions.