Learning Technologies for Online Exams and Invigilation

Exam Platform Feature Comparison

PLATFORM CANVAS GRADESCOPE CROWDMARK
ASSESSMENT TYPE (Classic) Quiz Assignment
(file upload)
Exam/Quiz Homework/Problem Set Assigned Assessment
INSTRUCTOR
Set-up & Access Log into Canvas and click into your Canvas course to create a new (Classic) Quiz. Log into Canvas and click into your Canvas course to create a new Assignment. Make sure the submission type is set to file upload. Submit a request form to the LT Hub to request for a Gradescope course.

Once set-up, you can access Gradescope from your Canvas course.

Submit a request form to the LT Hub to request for a Gradescope course.

Once set-up, you can access Gradescope from your Canvas course.

Submit a request form to the LT Hub to request for a Crowdmark course.

Once set-up, sign in at https://app.crowdmark.com/sign-in/ubc.

Assessment creation & delivery Instructor creates a quiz on Canvas and adds questions to the quiz.

Instructor publishes the quiz and students will access it within Canvas.
 

*Extra time or additional attempts can be granted to students with accommodations.

Instructor creates an assignment in Canvas with the submission type set as “file upload”.

Instructor publishes the assignment and students will access it within Canvas.

Instructor creates a question template which students will print and write answers in a designated space or annotate on the document using their device (similar to filling out a worksheet).

Instructor needs to distribute the assessment to students outside of Gradescope (e.g. post on Canvas or email)

Instructor lists out all the questions on a document.

Instructor needs to distribute the assessment questions to students outside of Gradescope (e.g. post on Canvas or email)

Instructor creates the assessment questions in Crowdmark. The questions can be typed directly, embedded as images/PDF or a combination of both.

Crowdmark sends an assignment link to students via email.

Question type(s) Multiple choice, fill in the blanks, fill in multiple blanks, numeric answer, true/false, matching, multiple answers, multiple dropdown, formula, essay, file upload question Can include any question type which students can answer on paper or annotate on the document using their device. Can include any question type which students can answer on paper or annotate on the document using their device. Can include any question type which students can answer on paper or annotate on the document using their device. Can include any question type which students can answer on own paper
Grading
  • Automatic grading for questions that have a correct answer (e.g. multiple choice, true/false, fill in the blanks, etc.)
  • Can grade by question using Speedgrader.
  • Can grade by rubric.
  • View student’s submissions and grade directly in Speedgrader (supports annotations)
  • Grade offline by downloading all submissions in bulk, annotate them, and re-upload to Canvas
  • Grade by question
  • Grades by rubric (add additional rubric items as you grade)
  • Rubric is shared across graders
  • Supports positive and negative grading
  • Can make changes to rubric and regarded retroactively
  • Can group similar answers and grade as a group
  • Students can request regrade
  • Supports multiple graders
  • Grade by question
  • Grades by rubric (add additional rubric items as you grade)
  • Rubric is shared across graders
  • Supports positive and negative grading
  • Can make changes to rubric and regrade retroactively
  • Can group similar answers and grade as a group
  • Students can request regrade
  • Supports multiple graders
  • Grade by question
  • Supports multiple graders
Providing feedback
  • Provide general comments or question level comments (using Speedgrader)
  • Supports automatic item level feedback based on correct/incorrect answers.
  • Provide general comments for the assignment or annotate directly on the document (using Speedgrader)
  • Include comments in rubric items.
  • Annotate directly on the document
  • Supports LaTeX in comments and rubric items
  • Include comments in rubric items.
  • Annotate directly on the document
  • Supports LaTeX in comments and rubric items
  • Can attach multiple files to the same comment
  • Annotate directly on the document
  • Supports LaTeX in comments
  • Can attach files or images to comments
Managing Student Submissions
  • Can see who submitted and at what time.
  • Can include late submission penalties.
  • Can see who submitted and at what time.
  • Can include late submission penalties.
  • Can see who submitted and at what time.
  • Can include late submission penalties.
  • Ability for instructor to submit on behalf of a student
  • Can see who submitted and at what time.
  • Can include late submission penalties.
  • Ability for instructor to submit on behalf of a student
  • Can see who submitted and at what time.
  • Can include late submission penalties.
  • Ability for instructor to submit on behalf of a student
Statistics/Results
  • Overall quiz statistics for the whole class
  • Question level statistics
  • Student level statistics
  • Students’ quiz results can be downloaded to excel
  • Overall assignment statistics for the whole class
  • Overall quiz statistics for the whole class
  • Question level statistics
  • Add tags to questions and view question statistic by tags
  • Overall quiz statistics for the whole class
  • Question level statistics
  • Add tags to questions and view question statistic by tags
  • Overall quiz statistics for the whole class
  • Question level statistics
STUDENT
Print assessment No No Yes
(or annotate directly on the document using your device)
No No
Submission process Select or fill in their answers within the quiz on Canvas. Write answers on paper (i.e. for math or chemistry equations) or type answers in a word doc (i.e. research paper). Upload file(s) to Canvas.

Students can re-submit up until the end date.

Print the assessment and write answers on the template or complete it online by annotating the template. Upload PDF to Gradescope.

Students can re-submit up until the due date.

Complete the assessment on paper or on the computer in a word doc. Upload PDF or image of answer to Gradescope. In Gradescope, identify answers for each question.

Students can re-submit up until the due date.

Complete the assessment on paper or on the computer in a word doc. Upload PDF or image to Crowdmark, one response per question.

Students can re-submit up until the due date.

Submission file type and size limits
  • “File upload” question types can take a long time to upload, depending on network connection (~120 MB = 10 min)
  • Accepts media files, image files, PDF, docx, weblinks
  • Size limit per upload is 5GB
  • Only accepts PDF
  • Can only submit one PDF file per assessment
  • Accepts images or PDF
  • Accepts images or PDF
  • Does not accept .docx files
  • Size limit per image file (JPG/PNG) is 12 MB and PDF file is 25 MB

Invigilation Platform Feature Comparison

PLATFORM PROCTORIO ZOOM BB COLLABORATE ULTRA
Set-up & Access Log into your Canvas course, go to settings and enable Secure Exam Proctor. Create a classic quiz with proctorio enabled.

Set Proctorio Exam Settings and Behaviour Settings.

Request for a Zoom account by contacting av.helpdesk@ubc.ca​. Log into your account at https://zoom.us/ and create a Zoom meeting.

Create waiting rooms and breakout rooms.

Log into your Canvas course, go to settings and enable Collaborate Ultra. Create a Collaborate session.

Create multiple sessions or use breakout groups.

Type of Invigilation Instructors review proctorio gradebook (video and screen recordings) after the exam. Real-time invigilation - Instructors monitor video feeds of students during the exam. Real-time invigilation - Instructors monitor video feeds of students during the exam.
Compatibility Can only be used with Canvas classic quizzes Can be used with any exam tools. Can be used with any exam tools.
Recording Options Video, audio, screen, web traffic, and room Video and audio Video and audio
Max video feeds Unlimited (videos are recorded) Depends on your computer capacity 2 - 4 (depending on browser)
Max participants Unlimited (all students in the course)

300 participants

(Check your Zoom Profile for meeting capacity. Contact av.helpdesk@ubc.ca if you need to increase)

250 participants
Lockdown Options Force full screen, only one screen, disable new tabs, close open tabs, disable printing, disable clipboard, block downloads, clear cache, disable right click, prevent re-entry Prevent re-entry (using waiting room and breakout room) Prevent re-entry (moderator removes a student from the session)
Verification Options CWL authentication to log into Canvas. Also, students cannot start the exam until they pass the verification requirements (verify video, audio, desktop, ID, signature). No verification required. CWL authentication to log into Canvas.
Detecting abnormalities Proctorio compares one test taker’s actions to the rest of the exams in the class and highlights statistically significant differences in a test taker’s behaviour (e.g. analyzes computer, environmental, and technical abnormalities). Abnormalities are observed by instructors by monitoring the video feed. Abnormalities are observed by instructors by monitoring the video feed.
Breakout rooms/groups N/A

Maximum of 50 breakout rooms per session.

Only the host can move co-hosts/participants to breakout rooms.

Maximum of 20 breakout groups per session.

Moderators (and students, if enabled) can switch between breakout groups themselves.

Learning technology support

If you have any questions or if you would like to report an issue regarding a learning technology, please don’t hesitate to contact us at LT.support@science.ubc.ca. For in-person support, please join our LTRs at one of our drop-in sessions.