CCRPI Assessment and Accountability Working Group
Online responses to Feedback form, Question 3:
Conducting tests on computers is becoming increasingly common in Minnesota and around the
nation. What are the implications of this trend for the schools and districts you are associated with?
What benefits and/or challenges do you foresee?
All summaries have edited responses to reduce duplication.
Business Representatives:
It can be a wonderful tool and resource as the 21st Century is becoming more and more technology reliant.
However, it is important to also look at the implications that will be placed onto schools if computer testing
is enforced and how this may place many districts into a conundrum in regard to budgets, staffing, and
computer availability. For large districts, there may not be ample computer space available for students to
complete testing. For online schools, there is a huge issue of being able to find computer space for
students across the state. It may behoove the state to have relationships with community/technical
colleges, business colleges, or 4 year colleges to use their computer space to assist schools who do not
have the available space. However this may not assist smaller districts who may also have concerns with
computer space and do not have options of local colleges in their area. Computer testing may be a more
eco-friendly option to reduce the paper waste that is involved with the paper-pencil. Also to consider is the
time needed for testing coordinators in setting up paper pencil testing and computer testing. Several
coordinators with whom I've spoken have shared that computerized testing takes less time overall in a
testing season, as testing booklets do not have to be sorted.
Benefits are many but so are challenges. We already have a strain on our resources so purchasing more
computers at this time is out of the question. However, not dealing with paper tests frees up other
previously locked space and a lot of the issues with security are diminished. Convenient: Testing using
paper/paper allows all students to test at once. Inconvenient scheduling: We will never have enough
computers to test all 600 students in one grade level at the same time so testing is spread out over several
days which messes up the schedule for the whole school.
The possibility of much quicker results with online testing is a huge benefit. .., but students are more
motivated to take online tests. Paper and pencil tests tie up space, take student time, and take personnel
to monitor tests also - those things don't change much with online assessments.
I have seen many benefits to conducting tests on the computers in my school. Being that technology is
such a huge part of life for these students, it has become something they are more accustomed to that
regular pencil/paper. It has been more time efficient for the actual alloted testing time, and is a great way
to incorporate more technology into their learning. The biggest challenge my school has faced is computer
lab time and space. With just a few computer labs and so many students, it is difficult to schedule times
for the tests to be taken. It also takes the use and availability of the computer labs away from any class
activities, assignments, or projects for a significant period of time.
Policy Maker
This is simply an expected progression... need to keep up with the technological requirements to run the
software.
Online tests require a much greater investment of time and resources than paper assessments. ….also the
problem of reliability. If a problem occurs with an internal server, than a system like TestNav is vulnerable.
If we move to an online system, which has been proposed, then a problem with internet access can
interfere with giving the test. A benefit is that many of this coming generation are more comfortable with
computers and feel less intimidated by this format. Also, it allows for results to be received much more
quickly. At the same time, there are still other students who feel more comfortable with a pencil/paper
test because there is less uncertainty.
1. Testing ties up the use of computer labs for weeks at a time, which means that the labs are then
unavailable for LEARNING, as they were originally designed.
2. Rural schools often do not have access to high speed internet, nor do they have budget resources to
establish connections and computer labs.
3. High stakes testing should be "glitch free"; I just took the ACCUPLACER test as part of a training session I
was involved with. At the end of the test, my results disappeared and could not be accessed by the
proctor. This happened to three other participants. It is patently unfair to students to use technology as
long as this sort of thing can occur.
My own school district has been successfully using computers …concern about moving the entire state
assessment program to computer adaptive testing. While it may be the correct goal, a capacity assessment
is definitely in order.
Challenges...We are becoming increasingly in need of new technology. We do not have enough computers
….we are not able to use those computers for other educational purposes…They are not as reliable as they
should be.
Benefits...scores are back sooner….
…Challenges will always be about keeping the technology current and keeping it working. I heard that some
kids trying to retake the GRAD test this past June could not do so because of some fault at the
programming level...kids all across the state lost out. ..
PreK-12 Education
benefits: faster scoring (possible contribution to student grades), engaging to students (less likely to skip
questions), flexibility in types of responses, opportunities for animation and manipulation.
challenges: computer availability and reliability, difficulties with constructed responses
As a district, we have spent precious dollars to secure technology for student instruction, only to see this
technology mandated for things we have no control over…it is unfair for these mandated tests to remove
technology experiences from our classroom students. These computer based/online assessments shouldn't
be mandated without the necessary funding to address the costs of the hardware, software, and personnel
necessary to implement them.
Again completely fund the initiative for public schools to provide the computers and the network
infrastructure to accomplish the task!!!
Benefits: students understand and expect the venue of online anything. ….expansive data warehousing and
excel documents so hefty no one in town can interpret them speedily).
Challenges: schools will state testing ties up computers too much. That is because schools see no value
added in testing.
Benefits--easy to manage (no test books, AD, boxes, numbers, etc)
Challenges--quality materials for students to practice the computer format. We purchase physical books to
prepare yet test on the computer. Students are testing in a different format than they have prepared.
The biggest challenge would be the districts that need to upgrade their technology to meet the demands of
the test.
We will need to move to using wireless laptops. Concerns - Making sure all schools are web-based,
securing enough laptops for student use, reliability of assessments over a wireless network.
biggest problem ..is one solution for all students…trying to make every student learn in the same manner.
Challenges may be supervision (how do you know the kid on the computer is the right kid and he/she is not
cheating) getting kids to be present on the right days.
Perhaps the state should pick a week in April and make it mandatory that there is no school that week.
Then all the Home School, Private, Charter school and PSEO students would be required to report to the
school in their home district to take a specific test at a specific time on a specific date.
Implications are that all testing programs should be able to operate on both Mac and PC systems, as well as
systems that are up to 10 years out of date.
Computer testing requires funding for tech specialists &for current technology…. at first, taking tests by
computers was novel and students were very motivated, but as it has become more common place, it has
become just another test.
some schools only have one small lab or 2/3 computers in each classroom so the testing window needs to
be wider. it would be easier for virtual students to take the tests as the schools could take laptops to sites.
This is an issue as we provide an online education. We would need to create mini-portable computer labs
to conduct tests. We have had technology problems with sites we have used. Then causing upset students
and parents because they took a bus to the site and were not able to complete the testing.
When a person takes their driver's exam, they go to a testing center... If they don't pass one day, they may
take the next week. They can study what they didn't well on and they would immediately know what they
failed. Also, these tests are on computers and questions are randomly offered.
We use the NWEA… For at risk kids, I particularly like this test. It adjusts to the students' abilities and it
immediately scores.
Challenges: trying to test three grades on the same day when there may be a lack of computer resources.
..we will have to test students on a number of days due to limited computer availability.
We do most of our testing with a computer and have found that it works a lot better if they are hardwired
into the Internet or system rather than through a wireless connection.
The issue is the continual financial need for computers. We can get about 5 years out of a computer so
some financial consideration would be necessary.
….our computers are not placed to limit the student's availability to the screen next to them.
We are past the point of thinking we can decide whether using computers for this is right or wrong. It just
is.
The computer testing has caused great hardships for our Area Learning Center …- our computer system
was not able to handle the programs. We need to definitely have paper/pencil tests available so that
students don't have to go to another school to take the tests.
fraud is easy
The benefit that I foresee are that there is an anxiety attached to filling out 'bubble sheets' that will be
eliminated.
..many students have difficulty focusing their attention on the screen. They cannot easily do the reading
techniques that have been taught by their instructors, such as underline, circle, and highlight.
Poor and ELL students have limited tech. skills (no computers at home) so they START at a disadvantage.
Some kids aren't computer savvy and we always tend to have computer glitches during testing.
Technology has become the biggest expense for schools and making it necessary for all MCA assessments
would create an added burden to schools.
Some students do not test well using the computer.
Because no school of any size has the computer capacity to give all of the sophs the science test at the
same time, classes are disrupted over a period of days and instruction time is lost
What are supposed to do with computer-dependent classes (word processing, composition, CADD) classes
who cannot operate without the computers if we are constantly using computers for testing??
Our digital-age students like computer testing better because the results are more immediate and content
can be adjusted according to level of attainment.
Computer based assessments are very difficult for online schools -- it is hard to travel the state and give the
test, when it has to be done in hotel conference rooms.
Often students can see other students answers. This challenges the validity of the test(s).
homes often still do not have computers but the libraries are packed with limited access times for families.
A challenge might be to set up more access to computers for the community and tutors.
In a small school, testing disrupts every classroom in the school-even those teachers whose students are
not testing. The online experience is much cleaner.
they limit the opportunity for interactive or extemporaneous answers such as can be derived with oral
exams or essay tests. I think we need a blend. ..the test can be adaptive, for example becoming
progressively harder, or more focused on a certain area.
1 - Simplify the tests in a technological sense to be completely in a single web-browser window and not
require any custom software at the workstation or server level, OR
2 - Have the tests administered at Pearson(or MDE) managed locations around the state, as is currently
done with tests like the GMAT, LSAT, GRE and others. District personnel would issue a 'ticket' for a student
to go take a test, and schedule an appropriate time and place for that student.
I do not like computerized tests nor do my students. For some it works, for the majority they just have not
liked it.
Not all students test well on a computer. Computer based and other types of tests should be a choice
based on preferred learning/testing style. While I think that students should be comfortable with computer
technology, forcing students to test in only one way is counter-productive in determining an accurate
picture of the student's knowledge.
Economic and cultural differences within school districts give some students an advantage over others.
Specifically, working with inner-city high school graduates, I have found that many of them have little to no
computer skills.
Currently post secondary schools are utilizing platforms such as BlackBoard to enhance classroom
experiences. Instructors are finding that if they proctor exams through electronic means, they gain more
time in the classroom for quality instruction. If students are comfortable with this type of instruction, then
they are better prepared to succeed in a post secondary setting.
A concern that less effort will be put in. Showing your work and how you arrived at your conclusion
becomes less important.
The skills most needed for the 21st Century are not discerned in this type of testing. The implications are
that students will in increasing numbers see school as having no value to their life. The benefits ..are to be
found in selected settings and most likely for formative assessments only.
Some (especially younger, disabled and lower SES) students are far less familiar with computers and lack
speed and accuracy in working with the format.
A huge benefit with a possible downside of MSWord correcting grammatical/spelling errors and students
not learning how to write.
what is the backup system?
Classroom teachers rarely have the time, or will take the time, to incorporate technology learning for their
student into their classroom curriculum…. Are the assessments truly valid and reliable if the students are
learning how to use a computer at the same time they are taking an assessment?
We are raising a generation of students who not only have superior knowledge of computers BUT who also
make higher demands on the quality of the computers. If a computer stalls, is too slow, or sends them an
error statement, the students have very little patience--- and it affects their ability to concentrate on the
test---dealing with the computer issues become a higher priority than the questions on the test.
The main challenge to testing on a computer is it means penmanship becomes even less important. People
need to be able to read what a student handwrites.
- does it truly reflect a child’s knowledge or regurgitation on facts that can be memorized / iterated in
keystrokes, vs. seeing the process their mind went through to come to a number, concept or idea with
their written words?
An alternative would be to use regional testing centers, funded by the state.
First, with new immigrants, there will be skill deficits in the application of the computer as an assessment
tool. Additionally, the state has not made the necessary investments (like South Dakota has) in the
necessary infrastructure to effectively manage the online assessment processes. Finally, the assessments
can't be simply transferring a paper and pencil test to a computer screen that now becomes a point and
click assessment.
I think a written copy of the test should be given to the student to supplement the computer version.
Students need to highlight, make notes, and cross out answers to be effective test takers. Perhaps having
students take the test in written form and then transcribe answers to computer would be a better way.
You do run the risk of wrong answers being clicked on the computer, however.
Computer testing is a great advantage for the retaking of testing.
Bandwidth will be a concern as we move to more innovative formats. However, the biggest factor is the
lack of sufficient computers to carry out assessment in a timely manner--a short testing window…..until the
state makes a large infusion of technology dollars. Even then, space limitations may well require the use of
mobile laptop-based systems that cannot be used for more innovative item types due to the lack of speed
in wireless connections.
In our experience the student who is having a difficult time passing the reading test, doesn't like taking it
on the computer. He would prefer to have a paper copy.
Not all of the school districts have the computing power that the twin cities do. Will the state fund
upgrades to the technology in all rural schools?
Benefits- Students are computer savvy, harder to cheat from neighbor, audio for those who need it,
animations, graphics
Challenges-computer technology problems, easier to cheat, lazy students will find it easier to pick random
answers, eye strain, some students absolutely hate computers ,lack of available computers for testing
More flexibility needs to be allowed for wireless lab use…, labs get booked for testing in the spring while
many final research projects etc. are being completed by students.
Students cannot go back and check work on exams
Some of my students don't understand a command to "click and drag" to even answer a question that they
might know the answer, but to not know how to exudate the commands to answer the question correctly.
Classes like Computer Aided Design, Web Design, and programming courses have at least 2 weeks in which
they cannot use the computer.
Shortfalls of using a computerized testing program is potential computer errors, the difficulty to read
passages on a computer screen and answer questions- students would not be able to highlight or underline
information and they may not be able to see the entire story/passage while answering questions, there is
also the chance of miscopying numbers for math equations when transferring information from a screen to
scratch paper.
Challenges = computer failure. Not enough options given on computers.
The technology is available to ensure a variety of appropraite accommodations are "built in" for learners
with a variety of disabilities.
Written responses on paper underestimate the performance of students who are accustomed to writing
with computers
In our district I know that when we had students taking the same test, our server stopped working because
it was overloaded.
for those students that have learning disabilities taking tests on computers can be very challenging.
A number or reading strategies involve students being able to look at large pieces of the text in a nonlinear
fashion which currently is not done on computer assessments. Further, some students who struggle with
reading are not able to easily employ the very comprehension strategies that we teach them to use with
hard copy such as checkmarking questions, crossing out potential answers, making notes in the text
margin.
One week ago today, I witnessed one unfortunate challenge of computerized testing. I had around 70
students logged in to computers to take the GRAD math test. After typing in their login and password, one
by one they encountered an error message. The system had crashed--it wasn't our local system. These
students were retaking the GRAD math test for the first time, they had just spent 2 weeks in summer
school reviewing. They were ready, we encouraged them for two weeks, had built them up and the test
needed to be delayed until another day. .
It is more difficult to develop assessment items that allow for problems solving skills to be demonstrated
(constructive response).
As a DAC I save hours of time not having to pack boxes and sort testing materials so I can work directly with
students and teachers.
Ongoing training is the key to making computer-based assessments effective and efficient.
Go with ACT and GED and let the private sector providers worry about how the tests are given and scored.
Get the state and districts out of the business of creating and managing testing infrastructure, please!
FIrst, it is not the typical way in which students are assessed, therefore may not be a true measure of their
skills without some practice ahead of time. Secondly, it presents issues when we are working with
students requiring accommodations to the testing environment, such as the test read aloud or small group
settings as most of our computers are set up in a lab format. It would be helpful to have assessments that
have an adapted version that would be read to students online (with both the question and possible
answers being read), eliminating the need for a human reader or a disk that can be confusing to match up
with the computerized version.
Students of the 21st century are taught to utilize all of the resources that are available, and should be given
the opportunity to be assessed in a manner that allows for all of the same resources that they have not
only been taught with, but also that they will be using daily as adults.
As the cost of computer laptops fall, MDE should consider providing classroom sets of netbook-type
computers as part of the assessment process. Large school districts would have multiple classroom sets
and smaller school districts could share. After a testing cycle is complete, school districts could be given the
opportunity to buy the netbooks for low cost.
do not go to computer only testing in grades 7-11 until SAT and ACT do - students need to practice paper
and pencil testing to be ready for these assessments, which are much more "high stakes"...
Research demonstrates that you should test students in a manner consistent with how they learned the
information. Most students in the state still have books from which they draw their information. To have
them practiciing on a paper-pencil format and then transistioning to an electronic format for the high
stakes test is just wrong. .
Higher Education
I like not having to spend time counting, collecting, and packaging test books. However, tests in the
computer labs also require prep work and they take significant amount of computer time away from
classes and students. I do think kids prefer the computer based assessments.
Technological glitches occur more often than paper and pencil glitches.
We are using our technology more and more as an instructional resource. Our labs and computers are
integral to instruction. Any time they are being used for testing it is a sacrifice to teaching and learning.
Assessments need to be computerized. Schools will need more computer labs and evaluating student
results will be complicated.
I absolutely think this is the way to go. And some districts will balk and refuse but they are the ones who
will probably also have to disappear. Technology is the testing avenue of the future, not to mention the
vehicle kids use to communicate. …
In our high school we have 5 computer labs, so if you look at black and white numbers, we should be fine.
But realize each lab is a different age because we can't afford to upgrade all 150+ computers at the same
time, they are on a rotational schedule. It also takes a knowledgeable person to manage the technical
needs of each test.
I have intimate knowledge of the MCA II in science, having served on several panels at MDE. This test
needs to either match the original goals (of truly testing if a student could manipulate the objects to make
an electromagnet, etc.) ….I suppose the multimedia aspect may help students with disabilities, but that is
all that can be said for them. The science test at least is in NO WAY helped by being on a computer, the
same test could just as easily be put as pencil and paper, with a student aid reading to the students with
disabilities.
Perhaps newer technologies can provide branching programs that allow for students to apply knowledge in
problem based situations that can identify the students' ability to think creatively and critically.
Currently, we have identified some concerns with the Praxis tests which are taken by pre-teacher
candidates. The scores on the tests taken on computer clearly are lower than those taken on paper. One
of the concerns is that a student may not go back and change an answer once it is submitted. ,,,Also, typing
skills can become a concern.
One of the strongest benefits is acquiring detailed knowledge of each student's specific strengths and
weaknesses while being assessed, which can be used to tailor future instruction and/or remediation to
individual students. Among the challenges are transferring performance data to school, district, and state
databases in aggregations that are useful to each entity but when that can be accomplished, it becomes a
significant benefit toward analysis of the systemic characteristics of the school and the district.
Computerized tests are problematic for us in southern rural Minnesota as computer access is very limited.
No Affiliation noted
We have access to computers about 1 per 10 students, so testing would have to be staggered or more $
for computers in classrooms.
We had several kids fail the first science test because a group of computers quit working,
Computers are not problem for us but the tests need to be internet based.
we do not have a computer lab- and the requirements of the testing is that they are in one room. It is
time consuming for us as we need to pull student computers and reset them up in another separate room
to control for all of the testing variables.
Negatives could be too much reliance on multiple choice questions instead of constructed response-type
of questions.
Challenges: …reading is difficult to track especially for those with special needs, difficult to change an
answer once entered
All testing should be open from October to May so we can test students throughout the school year so the
state test would match with classroom teaching.
, they also marginalize the students (refugee, migrant or low SES) and parents whose voice would be
stifled, special efforts need to ensure those voices are counted for the achievement of all.
The benefits with the NWEA tests we give are that the student knows their score right away…The tests
also take less time so I feel that the students actually focus more on the test material. They give up on the
last part of the MCAs.
I have also found that students who get bored with the test often skip through it. If we are using
technology I don't see why we can’t make the tests a little more exciting. It would also give us a chance to
assess what types of media students are able to gather information from which would be helpful in the
classroom.
Kids i think would be more able to stay focused taking the test on the computer. When they have to sit
for 4 hours and do it on paper and fill in the blanks, i think alot of them get bored and tired.
Observing teams of students conducting a lab experiment, problem framing and solving using a researchbased set of criteria...how does that compare to a single student answering science knowledge questions
on a computer?
Computer technology can not only improve effieciency of testing through selection of items based on
student responses (particularly useful in testing for formative purposes), but also greatly facilitate the
"information processing" functions that are impossible to accomplish manually (data capture, date
storage, data relationships, data manipulation, and meaningful reporting for different purposes to
different audiences.. A major obstacle is the cost of development of the tests.