Markbox: Difference between revisions

From DAG
Jump to navigation Jump to search
Line 143: Line 143:
# [https://wiki.math.uwaterloo.ca/DAG/index.php?title=Markbox#TA-Marked_Coversheet '''TA Marked Coversheet''']
# [https://wiki.math.uwaterloo.ca/DAG/index.php?title=Markbox#TA-Marked_Coversheet '''TA Marked Coversheet''']
----
----
=== Deleting a MarkSet ===
=== Deleting a MarkSet ===
1. Open the MarkSet that needs to be deleted.
1. Open the MarkSet that needs to be deleted.

Revision as of 13:56, 15 July 2020

Markbox is one of the five ways to administer a multiple choice assessment. Three are paper based (Akindi, Markbox and Crowdmark) and two are on-line (LEARN and Mobius)

Difference between the paper-based solutions

Features of Markbox

Classic Bubble Sheet

The Classic Bubble Sheet is a scannable coversheet that can be simply handed out or attached to the test.

To configure, complete the following Actions by clicking on them sequentially:

1. Select Page Size

  1. Choose the correct paper size to fit all questions on one page.
    • Letter (8.5 x 11inch) will fit a maximum of 180 questions
    • Legal (8.5x14inch) will fit a maximum of 264 questions
To only download the coversheet, click Download Coversheet after selecting a page size.

2. Upload Student List

  1. Upload a .csv of the classlist by clicking Choose File.
  2. If there are headings in the classlist table, click the checkbox next to "Skip the first row (remove headers)" near the bottom of the hovering window.
    • NOTE: If there are not table headers, clicking the checkbox next to "Skip the first row (remove headers" will remove the first student from the classlist.
  3. Click Upload Students to input the classlist into the MarkSet.

3. Answer Key and Test Versions

Classic Bubble Sheets can support up to 10 different versions of the test (A, B, C, D, E, F, G, H, I, and J).
  1. Type your answer into the text field or manually enter answers by clicking the correct option on the bubble sheet.
    • If an incorrect answer is inputted, clicking on the correct choice or by typing the correct choice in place of the incorrect one in the text field will replace it.
  2. To create multiple versions of the same test, click Add Version.
  3. To delete versions of the test, click Delete Version.
  4. To adjust the value of each question, click Edit Weighing at the bottom right. Then, type in the desired value of the question within the text field next to it or by clicking the up/down arrows.
    • NOTE: Questions must have a minimum value of 0. The weight of test questions can also be adjusted later during the marking process.

Once you are done with the configurations, click Save Versions.

Click Download Coversheet on the right of the MarkSet page to download a PDF file of the coversheet.


Peer-Marked Coversheet

The Peer-Marked Coversheet is the scannable coversheet intended for in-class peer-marking exercises.

To return results to the students via email, the marker's name and ID will be removed from the page.

To configure, complete the following Actions by clicking on them sequentially:

1. Configure Coversheet

  1. Choose the correct number of columns to fit all questions on one page.
    • One Column will allow a maximum of 10 questions over one column, up to 15 points each.
    • Two Columns will allow a maximum of 20 questions over two columns, up to 5 points each.
  2. Choose the paper size for the coversheet by clicking on the drop down menu next to "Paper Size".
    • Letter (8.5x11inch)
    • Legal (8.5x14inch)
  3. Within the text field next to "Number of Questions", enter a number at or below the question limit to generate questions for the coversheet.
  4. To set a default maximum score for all questions, enter a value between 0-15 or 0-5 into the text field next to "Quick-set Max Scores" or by clicking the up/down arrows.
  • To add more questions, click Add Question at the bottom of the question list.
  • To delete questions, click the X on the far right next to the question under the "Delete" column.

Once you are done with the configurations, click Save Config in the bottom right corner to save.

2. Upload Student List For Peer-Marked Coversheets, it is recommended to add a "unknown" student to the classlist to handle cases where the marker fails to input their information, or a student not in the classlist acts as a marker.

  1. Upload a .csv of the classlist by clicking Choose File.
  2. If there are headings in the classlist table, click the checkbox next to "Skip the first row (remove headers)" near the bottom of the hovering window.
    • NOTE: If there are not table headers, clicking the checkbox next to "Skip the first row (remove headers" will remove the first student from the classlist.
  3. Click Upload Students.

3. Download Coversheet

  1. Click Download Coversheet from the "Actions" list to download a PDF file.

TestCreator/ Scrambled Multiple Choice Test

The TestCreator creates a hand-crafted test which supports a variety of scrambling and feedback options. To create a test with the TestCreator, please review the MarkBox 1.0 user guide.

To create a Scrambled Multiple Choice Test, the TestCreator tool must be used to generate a .test file from MarkBox 1.0.

To configure, complete the following Actions by clicking on them sequentially:

1. Upload student list

  1. Upload a .csv of the classlist by clicking Choose File.
  2. If there are headings in the classlist table, click the checkbox next to "Skip the first row (remove headers)" near the bottom of the hovering window.
    • NOTE: If there are not table headers, clicking the checkbox next to "Skip the first row (remove headers" will remove the first student from the classlist.
  3. Click Upload Students.

2. Configure Questions and Answers

  1. To input the questions and answers, upload the .test file created in the TestCreator.
  2. To download the PDF file, click Download PDF to the right of "Test Preview". Only one copy of the test can be downloaded.
  3. Once satisfied with the configuration, click Confirm in the bottom right corner of the page.

3. Printing Options

  1. Choose the printing options (download type, bubble sheet location, double sided, and number of tests)

4. Generate Sheets/Download Test

  1. Once satisfied, click Generate Sheets from the Action list. It will download the printable test file based on the Download type setting.
  • Once you see the progress bar, the test will generate as a background process, so it is okay to close the browser.

TA-Marked Coversheet

The TA-Marked Coversheet is the scannable coversheet for use-cases where you'd like graders to fill out the bubbles.

Ex) Generate this cover sheets for a series of short-answer questions and attach them to the front of the test/quiz and have your students only fill out their name and student ID.

To configure, complete the following Actions by clicking on them sequentially:

1. Configure Coversheet

  1. Choose the number of columns over which the test questions will be listed.
    • Two Columns will allow a maximum of 60 questions over two columns, up to 15 points each.
    • Three Columns will allow a maximum of 90 questions over three columns, up to 10 points each
  2. Choose the paper size by clicking the drop down menu next to "Paper Size".
    • Letter (8.5x11inch)
    • Legal (8.5x14inch)
  3. Within the text field next to "Number of Questions", enter a number up to the question limit for the chosen column settings.
  4. To set a default maximum score for all the questions, enter a value between 0-15 or 0-10 depending on the number of columns into the text field next to "Quick-set Max Scores" or by clicking the up/down arrows.
  • To add more questions, click Add Question at the bottom of the question list.
  • To delete questions, click the X on the far right next to the question under the "Delete" column.

Once you are done with the configurations, click Save Config in the bottom right corner to save.

2. Upload Student List

  1. Upload a .csv of the classlist by clicking Choose File.
  2. If there are headings in the classlist table, click the checkbox next to "Skip the first row (remove headers)" near the bottom of the hovering window.
    • NOTE: If there are not table headers, clicking the checkbox next to "Skip the first row (remove headers" will remove the first student from the classlist.
  3. Click Upload Students to input the classlist into the MarkSet.

3. Download Coversheet

  1. Click Download Coversheet from the "Actions" list to download a PDF file.

Using Markbox

Before getting started, you must use Google Chrome as your browser which allows cookies.

Login to MarkBox: https://markbox.uwaterloo.ca

Creating New MarkSet

1. Click Create New MarkSet in the center of the page, the left navigation bar, or next to "All MarkSets".

2. Type in the title of the MarkSet under "MarkSet Title:". It is used for self-reference purpose. It is generally a good idea to include the current term and course number (e.g. Chem 120 Final Fall 2020).

3. Select one of the four types that will best suit the desired test:

  1. Classic Bubble Sheet
  2. Peer-Marked Coversheet
  3. Scrambled Multiple Choice Test
  4. TA Marked Coversheet

Deleting a MarkSet

1. Open the MarkSet that needs to be deleted.

2. Click Delete Markset on the left navigation bar.

Deleting a MarkSet will permanently delete all data associated with it, which includes:

  • Uploaded Scans
  • Processed Images
  • Error Correction
  • Final Grades
  • Annotated PDFs

Marking Your Test

After the test has been completed and collected, scan the completed pages.

Ideally, test scans should be compiled as a single PDF file for uploading.

Only the bubblesheets need to be scanned for MarkBox to mark them.

To scan full tests, ensure that they are in order.

To mark tests, complete the following Actions by clicking on them sequentially.

  • At any time during the marking process, it is possible to Adjust Scoring of the test questions and Re-Download Test.
  • To View / Mark Bad Tests and Scans, the scanned tests must first be uploaded and correlated.

1. Upload Scans

  1. Select whether Only Bubble Sheets or a Full Scan of the test will be uploaded.
  2. Click Upload in the bottom right corner of the hovering window.
    • After uploading the test scans, the MarkBox automatically matches students from the student list to their test scan.
  3. If you scanned your entire test, select the Full Test option and Markbox will attempt to group each page into a test. Please ensure that your test is scanned in the correct order.
    • It is generally recommended to only scan bubble sheets unless you want to return the full scanned test back to each student.

2. Correlate Scans

  1. Check "Un-correlated Students" table to see if a student incorrectly marked their student ID, or if a student who is not in the class submitted the test.
  2. To match these students or dismiss any submissions, click Correlate Scans.
  3. An image of the hand-written student number will be displayed and can be typed into the field under "Student:" to find and correlate them. You can also match their test version.
  4. To remove a student not in the class, confirm that by searching for their student ID and then click Student not in class list in the bottom left.
  5. To remove a test submission from being marked, click Remove test from automated marking in the bottom right.
  6. Click Done Correlating in the bottom right corner of the page.
  • NOTE: All tests should be correlated or removed from manual marking at this stage.

3. Correct Errors

  • MarkBox will process and highlight with a blue rectangle if it finds errors (markings outside of the bubbles, multiple answers for the same question, blank answers, or failure to properly erase answers). These errors must be manually corrected to ensure that grades are distributed accurately.
  1. Check the left navigation bar to see a list of test errors with the question number and type of error.
  2. If multiple selections are highlighted with the blue rectangle, click on selections that need to be removed. A circle will appear to the right of the question.
    • If a student clearly made a selection and it was not recognized by MarkBox, click on the surrounding rectangle to accept it as an answer.
    • If there is no error but MarkBox highlights it as a problem, click Ignore under that specific question in the left navigation bar or click the red circle next to the question number. If all questions are mis-marked as test errors, click Ignore All in the left navigation bar.
      • To unignore, simply click un-ignore in the left navigation bar or click on the circle next to the question number.
    • To view solutions while marking multiple versions, use the Manual Marking. Simply enter the test version of interest into the text field to display the answers.
    • If a test needs to be removed from grading, click Remove from Marking at the bottom right of the page.
  3. Click Save and go to next test to move on to correcting the next test.

4. View Test Stats

The statistics shown will be:

  • Answer Key Type - The version of the test
  • Number of Tests - Number of tests generated
  • Maximum Score - Total number of available points
  • Average Score - Average number of points scored
  • Standard Deviation - The extent of deviation for the class as a whole
  • Distribution of Grades (percent-based) - The percentile grade distribution that students achieved
  • Student Scores & Selections - The individual selections that each student made in their test, presented as a downloadable .csv table.
  • Question Analysis - Each question, its value, correct answer, PtB, percentage of correct answers (%C), number of students who chose each possible answer, marked errors, and blank responses, presented as a downloadable .csv table.

5. Download Gradesheet/Finalize Test

  1. Click Download Gradesheet to generate and download a .csv of results.
  2. After everything has been completed, click Finalize Test.
    • By finalizing the test, the ability to do the following will be lost:
      • Upload Scans
      • Correlate Tests
      • Alter Bubble Sheets (Correct errors)
    • The following will remain available:
      • View Bad Scans
      • Access Test Results
      • Send Results to Students via Email (Students will only be able to see their own marked coversheet, their selections, and the MarkBox selections.)
      • Adjust scoring, with some limited functionality
  3. If certain students need to be excluded from emails, click the checkbox under "Exclude" next to the student's name.

Integrating Markbox with Odyssey