Scantron Hints, P. Conrad, UD CIS Dept.
A picture is worth a thousand words
So here is the picture you need the most.
- The last number used column is the "last number" for the multiple choice part of your exam. (in this example, 7).
- Columns 7-8-9 under Extra Options represent "how many points the multiple choice part is worth" (in this example, 20).
- Fill in everything else exactly as shown (explanations are provided below.)
A picture of the full sheet is also available.
And now, several thousand words.
The IT department at UD will provide automated test scoring using
Scantron sheets (those "fill in the bubble with your #2 pencil" sheets).
The purpose of this document is to first explain my philosophy about the
role of such testing, and then with that out of the way, to provide
some quick hints and tips for getting started with using scantron sheets.
The IT department has a nice brochure that explains everything. You can pick it up at the counter in the basement of Smith Hall; it is called Test Scoring (for multiple choice examinations) There are also online instructions: here is a link to the main online web page, and a direct link to the detailed test scoring instructions.
However, the printed documentation is long, wordy, and can be a bit intimidating if you just want to
get something done quickly. This tip sheet is intended to hit the
high points, not to replace the full documentation.
First, philosophy: should we really be using multiple choice tests at all?
I've factored out the philosophy into a separate web page.
The following instructions are a simple way to get started fast. They do
not include every possible option; just a set of simple options that "works".
Later, there are tips for what to do if you need to deviate from simplicity.
Assumptions for this simple version:
- Either questions worth the same number of points (or varying
point values between 1 and 5).
- No omitted questions.
- Only one "big section" (scores not broken out by section).
- The multiple choice part need not be the entire test (it can be, for example 32% of the entire test.)
What to assemble
The "Test Scoring (for multiple choice examinations)" brochure from the basement of Smith.
3-4 blue sheets. You probably only need 1 or 2, but its good to have a few extra.
Enough brown sheets for all of your students, plus a few extra.
Preparing the instructor's blue sheets
See the picture for an example of a filled in sheet.
- Fill in your name (instructors name) in the first
16 columns (ignoring the division between last and first),
and your department in the last 4).
- Lower left, bubble in "Control and Key" and "First Section".
- Bubble in "last number used", showing the problem number of the
last problem on your exam.
- Bubble in a "5" for standard option 3. This will produce
a "narrow-format" computer file
containing all the students names, raw scores,
and all their responses to each question.
"narrow format" just means "no wider than 80 columns", a throwback to the old days of 80 column wide terminals, punch cards, etc.)
As an alternative, you can
use "4" for standard option 3 to get a "narrow-format" computer file
that you can use with the ITEMAL program (see:
http://www.udel.edu/topics/testscan/itemal.html.). The command to run the ITEMAL program is:
~consult/scanning/itemal < input_filename > output_filename
- Bubble in a "1" for standard option 5. This will produce a "grade file"
with section number, student names, "raw score" and "score"
- Bubble in a "1" for standard option 7. That way, even if some students
forgets to bubble in his/her name, the exam will still be scored.
- If the multiple choice part is only part of the total exam, bubble in
a "1" for standard option "10", and then bubble in the number
of points that the multiple choice part is worth in columns
7,8,9 of the "extra options".
Note: the instructions from User Services for
option 10 indicate that if you use a weight sheet, you don't need to
do this step, but that's a bit misleading. (The misleading instruction
is in the instructions
for the standard options. Scroll down past standard option 10,
and see the "Additional Note").
The instructions for
out the weight sheet) (which, to be fair, they instructions above
indicate that you should read for "more information") make it clear
that if your multiple choice part is only a portion of the exam
(e.g. 75 points on a 100 point test), you should fill this in anyway
(see the formulas such as X/Y, and Z*X/Y for details.) Otherwise the
total score will be reported as a percentage out of the total of the
weights, rather than as raw score (e.g. out of 75).
- Bubble in the answers on the blue sheet.
- Point Values (weights). If the questions have
different point values, or point values other than 1, fill in a second
blue form. On this form, fill in only the "weight" bubble at the
lower left, and fill in the A-E values for each question, A=1, B=2,
C=3, D=4, E=5.
You cannot assign point values other than 1
through 5. So keep that in mind when designing your exam.
(Actually, a single exam question worth more than 5 points with no
option for partial credit probably doesn't make sense anyway, so this
is no great loss.)
Giving the exam
- Tell the students to mark and bubble in only their names. They don't need to mark
anything else except their names and the answers. In particular, they don't need to mark the section, the course, the student id number, though if you want them to mark
in section number, that's fine.
- A Tip if you are using WebCT : Have them bubble in their UDelNet account (i.e. udel username) instead of their last name. This makes importing the results file into WebCT a bit easier
- Though you'll still have to do some manipulation in a program such as Excel or Emacs.
- Or, use my handy dandy C++ program: scantron2webct.cc
- Emphasize: NO SSNs!!! Soon the test scoring center will reject any pages with SSNs.
After the exam
- Put the blue control sheet on top. Write the word "CONTROL" in
the course/section area at the upper right hand corner.
- If there
is a weight sheet, put it second. If there is an alternate key, put
- Put the brown sheets stacked underneath all the blue sheets.
- Take the stack down to the basement of Smith.
- Obtain a Test Scoring Request Card at the desk. Fill it
out, and give it to the clerk. They will give you a receipt that you
can use to pick up the package when it is finished.
- If you requested it, a file with the results will show up in your
home directory on copland/strauss in files with names such as
won't get an email, so don't bother looking for that; you just have to
keep checking your home directory.
- After the file shows up in your directory, there may still be
some lag before the papers are available in the basement of Smith; the
actual scanning is done over on South Chapel Street, so there is some
The special HOW TOs
How to omit a question
- Leave each omitted question line blank on the answer key
- Mark a "1" for standard option 6.
- Fill in the number of omitted questions in extra option columns 4,5,6
- Include an extra blue sheet in your stack. On that sheet, bubble in
"alternate key". This blue sheet goes behind the main blue Instructor Control form and Weight Sheet (if there is one).
- Fill in one of the correct answers on the main Instructor Control form and the alternate answer on the Alternate Key sheet. Do NOT fill in answers on the Alternate Key sheet for questions that have only one correct answer.
A C++ program to import Scantron data into WebCT
The program scantron2webct.cc can be used to convert the file you get back from the scanner into a CSV files that can be imported into WebCT. See the program source code comments for instructions on how to use it.
You'll need to use "Unix redirection" to store the resulting output in a file with a
.csv extension, to make WebCT happy.
Sorry if these instructions are overly technical—they were originally written for an audience of Computer Science faculty. If the need arises, I can try to re-write them in a more accessible form.
Phillip T Conrad
November 15, 2006