AutoMark Questionnaire

Question/Response	Tabulation	Comments
1. Did you receive sufficient instructions and training on the AutoMark?
Yes	43	The County provided training. However, as with any type of equipment, testing, demonstrating and working with voters was the ultimate learning process. I would have appreciated a little better documentation. It was nice to have the Head Election Judges trained directly by the County/Vendor. I was intimidated by the new equipment at first. But I think we got excellent training. I was intimidated by the new equipment at first. But I think we got excellent training. However, my Head Judges seemed to be a little apprehensive so maybe a more "hands-on" training could be used. However, my Head Judges seemed to be a little apprehensive so maybe a more "hands-on" training could be used. We purchased additional training. We hired the company to come in for 2 days and required our Town and City Election Clerks and Head Election Judges to attend.
Somewhat	1
No
Unsure
Other	2	We did not rely on the vendor or the SOS office for training. Very little training actually provided. I received basic training from the county very minimal so I printed out booklets from disc received and worked with the sample ballot a lot until I understood the machine. But when testing – a lot of problems, book could not answer.
2. Who did the programming for the AutoMark? How long did it take to program? Were there any programming problems?
County	27	The county prepared the programming on the cards. Yes there were a few program issues, many with the primary – The ballot was arranged differently than the AutoMark so when you touch the candidate of your choice, it marked the ballot with someone else’s name . For no problems it seems it took a few days. Listed times that were more than that or else they did not respond to amount of time it took to program. I believe there were a couple of programming issues (i.e. flash cards with ballot styles that had multiple precincts had to be reprogrammed for the audio and screen to name all precincts not just the first one listed for that ballot style). Yes, the name of my City was incorrect for the Primary. And when my General flash cards arrived the name was still incorrect. I had to wait for them to be reprogrammed. the biggest issue was having to manipulate the voice files I don't know how long it took them, but I had a small problem with 2 precincts that needed to be redone and the county took care of it within 2 hours. Some of our flashcards for the General Election were missing some of our precincts but the matter was resolved prior to the election. we did have problems with the primary and general election to get the card to work in the AutoMark Programming problems were with the audio skipping or just stopping. It was random - sometimes it would go along just fine and then sometimes it would stop quite a few times in a row. Our flashcards had to be re-burned due to a section II error where AutoMark pronounced as "eye, eye" rather than "two.” We did the programming here are Ramsey county. ES&S played no role in the programming of our AutoMark equipment. It took roughly 5 days to program prior to both the primary and general. Programming problems were minor. The process is straight forward but time consuming. Much could be done to streamline the information that has to be submitted for programming. Entering the same information multiple times makes the process prone to errors. Programming problems were minor including name pronunciation issues which were resolved immediately. Some of the discs weren't programmed at all - they still had the primary programming on them. Luckily we had enough to go around - but no back ups. ESS & S Programming was not in time to meet State Law regarding availability of machine for public demonstration purposes Two machines at the general did not function properly. I have since been informed that in some jurisdictions, the judges bent the prongs on the machines when inserting the program card. I don't know that this was the case.
Auditors office
Not sure
Other	18	I did. I am the Deputy Clerk/Elections Coordinator for the City. (1) Synergy Graphics and ES&S ES&S
3. Did you have trouble with setting up or closing down?
Yes	5	Other than the cumbersome nature and weight of the equipment, the set up and closing was fairly easy. Synergy Graphics and ES&S We had two machines cause trouble. Synergy Graphics and ES&S Just a little Synergy Graphics and ES&S One machine refused to boot up. We used our backup machine in that precinct. Synergy Graphics and ES&S Setting up – a memory card broken
No	40
Blank	1
Other
4. How long did it take to complete testing of each machine?
Two hours	1	Testing took awhile. I would say each machine took two hours and also additional time to create test ballots for the accuracy testing.
One Hour to two hours
30 minutes to 1 hour	9	I made eight AutoMark ballots to incorporate into each of my test decks. We documented that we checked the audio ballot, the high contract and zoom screen, we checked the printer cartridge, the date and time and did a print all on each machine. Testing one AutoMark took approximately 45-60 minutes.
15 minutes to 30 minutes	4
10 minutes to 15 minutes	2
Under 10 minutes	2
?
Blank	1
Other	9 1	One hour per machine/13 machines. For general election to mark ballots for precinct counters, the printer did not always mark the oval in the right place. Thus, sometimes causing Accu-Vote not to pick up vote Not very long We tested both the audio and each ballot style. Testing was a slow process. Mostly due to the slow printing process on the machine and the long warm up time once the ballot has been inserted. Each machine was tested when delivered by a tech from ESS & S. I tested the programs for every ballot layout, then the elction judges were instructed to follow the procedures in the setup pamphlet. Initially all machines funcitoned properly. WAY TOO LONG IN WORK HOURS IT WOULD BE SIGNIFICANTLY LESS WORK TO MANUALLY COUNT THE BALLOTS ESPECIALLY FOR THE AUDITOR STAFF Testing was excruciatingly long because the machines are so slow. Because Cook County is predominantly mail ballot the auditor's office does all the testing. We did not keep records of the hours spent in testing. Testing the machines is just a part of the process. Marking test ballots and setting up the spread sheets took the most time and concentration for my self and staff. We have 13 AutoMarks and 13 M-100 Tabulators that serve 29 precincts in combined polling places. The entire process with no errors discovered takes about two weeks and that includes other Auditor Office work as well. Testing took about 40 hours 5 hours approximately Long enough to hear every race, candidate and ballot style. We had 60 candidates for the Primary and 204 candidates for the General Election, in 32 Precincts.
5. Were there any machine malfunctions, if so please describe?
Yes	26	Ballots would not feed at all. Ballot would feed and then be rejected. If any small mark w/in tracking area ballot would not load. Could go through whole ballot and print one side and then jam requiring voter to begin over. The calibrate button took you to the keypad, but would not allow any entry of the password or anything else. Machine wouldn't boot up One AutoMark, the printer cartridge was not put in correctly. MINOR PROBLEMS 2 machines were completely inoperative- had to be sent back to the manufacturer some minor things at the precincts that were curable Two machines "froze up" or would not allow data entry. Lots of malfunctions and very inconsistent. It wouldn't read ballots, it wouldn't mark ballots, couldn't calibrate, etc. We only ordered 21 AutoMarks to start with and we had to return 7 of them, before and after the September Primary. We experienced minor technical problems on Election Day. In most cases if the machine passed the election morning start up it would function through the day. Problems included failed touch screen, failure to start up on election morning, etc. An AutoMark would not recognize any ballot style. One was not printing on both sides of ballot When making a selection it would make a mark for another candidate We had two AutoMarks returned with problems and I currently have three that didn't weren't able to be used the entire day. Screen problems and reading the ballots are the problems experienced on the machines we have problems with. Not machine, but with a flashcard. During the initial testing for the primary election, the machine would not accept the ballot. Two machines wouldn't boot up on Election Day, even after testing okay the day before (after the machines were delivered to the proper precincts). They're currently in repair. here were problems at first but the machines were replaced One machine would not scan any ballots at all on Election Day. We switched it out with a sub. Multiple problems screeching noise crunching up ballots screen touch - not working Had one that didn't work. Didn't scan ballot. Vendor provided a replacement machine. It was discovered during testing that when listening to the Audio ballots, sometimes not all the information was given on the first run through. What you would have to do is to repeat that contest information then the information was spoken. One machine did not calibrate during testing and was replaced prior to Election Day. The machines malfunction when they stay idle for awhile. Also, ballots with a fold do not work. The ballot has to be flat while inserted.
No	4
Paper jam but fixed it	5	One machine jammed the ballots and was replaced prior to the election. Another would not boot up on election morning Ballot got stuck and holes were punctured into it. At the General Election the machine was used 5 times. Of those 5 times, it jammed twice. It's very embarrassing to have the equipment malfunction with a room full of voters. I am not sold on this machine.
Other
6. If yes to #5 did you have to replace the machine with a new one or were you able to fix it?
Replaced	20
Fixed	7
N/A	2
Other	1	We had one backup we could use - our other precinct had to share with another precinct located in the same building.
7. If the vendor was called to service a machine, did they respond in a timely manner?
Yes	13
No	3	They have not fixed the machine yet Still waiting I think
n/a	9
Other	4	The vendor has not been providing on site service at this point. All machines are returned to the vendor and replaced. This practice will end after the 1 year warrantee period expires. They weren't able to fix over the phone. ES&S customer service is a work in process. It is somewhat cumbersome and needs to be more streamlined. Most of us with more than 20 pieces of equipment do not have it stored conveniently close at hand to our offices. ES&S's practice of making us wait till a tech calls us and attempts to "work" out the issue on the phone was in my experience counter productive. Each time that a tech would call me, I would have to go to my election storage area and call them back, then go through the entire waiting game again and usually end up with a customer service representative who would want my name and number so a "tech" could call me back. Very frustrating. We were requested to bring AutoMark to the county and pick up when replaced.
8. What kind of feedback did you get from voters?
		Positive feedback on providing this enhanced opportunity for disabled voters to vote independently. No feedback as no one wanted to try the machine. In our absentee room (3875 AB issued) the voters who were able to use it were very happy. We did find that it was not the answer for everyone. It takes a certain about of physical dexterity and strength. Some of my older voters were intimidated by the touch screen, but with coaching were delighted to be able to read their own ballot. Disabled voters that used the machine really liked the opportunity to vote on their own. They were reassured to know that it was not an electronic voting machine - only a marking machine. Slow, and also we need to get Braille instructions on how to vote. If may be helpful if they were supplied. Also, we probably need posters for different languages on the AutoMark. One or two positive comments - one from a voter with a broken shoulder there were negative comments as to the cost of having this equipment in every precinct. Good Not much use of the machine, but the ones that did use it, liked it, however, it wasn't always used by disabled people, it was mostly used by election judges that worked and voted in that precinct. In general the response was positive although they weren't happy with the length of time it took. One woman - who needed to use the headphones and listened to complete instructions - took 45 minutes to vote. That was a little frustrating. We had 3 repeat voters in the General from the Primary who commented that they really found it easy to use. Comments generally were that the voting process was too slow. It was very evident that users would have really liked to see a "skip to end" function for the AutoMark, as many voters do not vote in the mass quantities of judges races on the back side of the ballot. One sight impaired individual who used the AutoMark did offer rave reviews to the election judge at the ballot counter. The machine made the voting process longer good comments easy to use Equipment was slow to use. Many felt it was useful however very slow. The feedback from Election Day users was positive. Many of the individuals using the device only used it out of curiosity and as a result felt the machine was slow. Others appreciated being able to complete a ballot with little or no assistance from others. If the poll workers actively promoted the use of the machines, then the voter feedback was very positive. not many used them- I guess they didn't want to learn something new- we really don't have any handicapped persons in Jackson County that would need to use them NOT A LOT, BUT MACHINES WERE EXTREMELY ACCURATE IN COUNTING AND VOTERS MARKED THE BALLOTS PROPERLY IN ALMOST ALL CASES 1. The AutoMark is slower to use! 2. User Friendly! 3. Not Hard! 4 No, I don't use computers! 5. Its fun to use! I do not have numbers or percentages, but, the machines were well received and the Election Judges told me that numerous people with minor to sever disabilities use the AutoMark successfully. Very few voters used equipment – maybe 1-5 voters/precinct – some said took too long while others like new technology. Only had one voter who voted unassisted 1st time (sight problems) who was thrilled – huge expense for one person. This equipment is too large and too heavy; needing a very large room for testing 26 machines between Accu-Vote and AutoMarks. Also, do not have storage available for the AutoMarks. I feel there is other equipment available that weighs less and is smaller that would be more compatible with the Diebold equipment. People are used to getting small receipts from ATM’s Diebold TSX has a paper trail and would have been easier to transport and store. But we all know our outgoing SOS vetoed that idea!
9. Any other comments you’d like to share?
		I was disappointed the media did not give more coverage to the AutoMark (unless I missed it). Only one person used the AutoMark to vote. That person was an election judge who was curious and voted using the AutoMark at the primary election. It seems like a LARGE expense to the taxpayers of the State/County/City to have 3 machines and all the supplies and programming involved. (Especially, when the cities/counties were not able to anticipate the expenses during a budgeting process). That goes for the recounts process also. Voters thought that the AutoMark was the tabulator during the Primary. So, we moved its location and added signage for the General. Moving the location will not be an option for the Primary, in the future, as we do not have as many Judges work the Primary and need to have someone keep an eye on the machine. So, if you want to provide professional signage that would be helpful. The precincts in our city did not have much activity regarding the AutoMark machines. In my small City with only one precinct, this equipment appears to be a waste of taxpayer’s dollars. The AutoMark was only used by a couple of voters who required this type of assistance. One voter with vision limitations still could not use it. The AutoMark has added many hours to election preparation, storage issues, ongoing costs and the AutoMark weren’t even used in most precincts. While most voters would prefer to absentee vote, having the AutoMark available 30 days before each election at City Hall seems to be adequate for our community. Even with that, no one absentee voted using the AutoMark. There was a lot of information given to the community and it still wasn't used. I think that each city should only have to have one machine that is kept at city hall for voters to use. They are costly and use up a lot of space. The use for them is extremely minimal and it does not validate the cost or the need for one at each ward/precinct. Too much time to devote to it with 0% people using it. :0) The majority of persons with obvious disabilities who voted in our polling place clearly preferred the assistance of a friend or family member to the AutoMark. Although our ballot counter judge did an excellent job of providing information about the AutoMark throughout the day, it was expressed to him on a few different occasions that people felt voting was quicker and more efficient with assistance. We thought this was pretty interesting feedback. Only one person with an impairment used the machine. The other 15 users on Election Day were just curious about the technology. I think one machine located at City Hall would be sufficient. For the use they received, I don't know that it's worth all the money to purchase so many. Also, it's a lot of work to test, store, and maintain them. We did not have any voters with a disability use the machine I think after people have tried it a couple times they will be more comfortable with the AutoMark. In the future the AutoMark could be best used for translating ballots for voters with limited English skills. The demand for these services would be very high. Multiple languages on the AutoMark would increase its demand greatly. I think most people who used the AutoMarks liked them. The machine is easy to use. No real impressed with the machine but the vendor service was good. It's sad because of all the money that was spent and the extremely minimal usage. I feel that for the smaller counties, one machine in the County Auditor's Office would work just fine instead of spending all that money THERE WAS A HUGE INCREASE IN THE AMOUNT OF PREPARATION TIME FOR THE ELECTION FOR THE COUNTY AUDITOR'S STAFF VERSUS NOT USING MACHINES Now that it is all said and done, the machines are great!! Thru lotza long hours of nites and weekends of testing equipment, it was just a great re-ward when all the machines worked so smoothly on Election Day & nite here in Rock County! It was all worth it!! Thank You!! It’s a shame that the use of this equipment was not simply an option in small counties and small precincts. One machine for Cook County would have been sufficient. Then, when the technology made them more accessible and affordable we could have invested at that time. I would like to see an internet system set up for military and over seas voters, where the registered voter would get a machine generated receipt when they cast their ballot that is numbered and recorders for them the votes they cast. The electronic file they access would be in my office and a ballot just like every other ballot would be printed here in my office. There would be no late applications, lost mail and no turn around time issues. They could vote the day before the election when all the issues are on the table and if a candidate dies, they would have access to the very latest ballot. For your information the AutoMark is an English only machine. I was a precinct judge at w5-P8 in St. Paul at the McDonough Community Center. There are lots of Hmong people in that location. That is why another election official decided to see if the AutoMark had the Hmong language. He found out is only English. This particular election official (Mr. Rienard) was pushing the AutoMark. He got a voter to use it. He tried to get me to use it, despite the fact I had voted by absentee ballot. When I had my election training a few minutes was used to talking about the AutoMark.

AutoMark Questionnaire

Responses from City and County Election Administrators