A Map Demonstrating the Accessibility Scores of Each State Voter Registration Website Tested Using VoiceOver on a Mac.
- Testing with a screen reader tool, VoiceOver on MacOS, revealed that 8 state voter registration websites were inaccessible to a visually impaired user: Alaska, Minnesota, Nebraska, Nevada, New Jersey, New Mexico, North Dakota, Oregon, Kansas, and Mississippi.
- In addition, 14 state voter registration look-up websites—sites that can be used to look up a voter registration and other election information—were inaccessible with a screen reader: Alaska, Connecticut, Georgia, Mississippi, New Hampshire, New Jersey, New Mexico, North Dakota, Oregon, South Dakota, South Carolina, Texas, Vermont, and Wisconsin.
- The 5 states that passed all our accessibility tests – California, Maryland, Oklahoma, Virginia and Washington – had strict web accessibility standards as requirements for official state websites.
- However, 13 out of the 18 states that had either an inaccessible voter registration or voter registration look-up website also had strict web accessibility standards as requirements for state websites.
- A few simple fixes, such as adding more labels to web forms, next page buttons, and submission buttons, would address many of the problems that made the websites we tested inaccessible when using a screen reader.
Abstract
In this study, we evaluated how many state voter registration and voter registration look-up websites are accessible to disabled Americans using screen readers. Government functions are increasingly migrating online, and today most states offer websites that help Americans register to vote or find their registration and other relevant election information. But what do the 8.1 million Americans who are visually impaired and may rely on screen readers experience when they use these websites? Currently, Section 508 of the Rehabilitation Act regulates website accessibility on federal agency websites. State websites are not required to follow this standard, but many states do so, or have their own strict accessibility standards. We tested the accessibility of each state’s voter registration websites first with WAVE, an automated program that checks the HTML of a webpage for compliance with W3C’s web accessibility guidelines, and then with VoiceOver, the default screen reader software on Mac computers, to see what problems a disabled user would encounter when trying to register to vote or look up their voter registration. Finally, we researched and ranked the web accessibility policy and guidelines of each state and the District of Columbia to see whether our test results aligned that state’s official web accessibility policy or guideline.
Results summary:
When testing with WAVE, we found that the majority of state voter registration websites (79%) and a majority of state voter registration look-up websites (72%) do not comply with W3C’s web accessibility guidelines, which are also part of the federal Section 508 standard. When testing with VoiceOver, we found that 8 state voter registration websites were completely inaccessible: Alaska, Kansas, Minnesota, Mississippi, Nebraska, Nevada, Oregon and New Jersey. Fourteen state voter registration look-up websites were also inaccessible with a screen reader: Alaska, Connecticut, Georgia, Mississippi, New Hampshire, New Jersey, New Mexico, North Dakota, Oregon, South Dakota, South Carolina, Texas, Vermont and Wisconsin. Thus, not only are most state websites not complying with accessibility guidelines, but frequently the lack of compliance makes it impossible for a visually impaired user to successfully use a state’s website in the ways available to a non-disabled user. The 5 states that led in our accessibility test results – California, Maryland, Oklahoma, Virginia and Washington – all had strict web accessibility standards as requirements for official state websites. However, so did 13 out of the 18 states that failed one of the VoiceOver tests at least once. A few simple fixes, such as adding more labels to web forms, next-page buttons, and submission buttons, would address many of the problems that made the websites we tested inaccessible to someone using a screen reader.
Introduction
Americans increasingly use online websites for critical government services, including voter registration [1]. As government functions move online, many Americans are left behind owing to their disability status. It is of vital importance that these websites be inclusive and accessible if they are to serve the 19.4% of Americans with disabilities, including the 8.1 million Americans who are visually impaired and may need to use screen readers [2, 26]. The Americans with Disabilities Act of 1990 was passed to eliminate discrimination against individuals with disabilities and ensure they have equal access to all walks of life [3]. In addition, Section 508 of the Rehabilitation Act ensures that federal agencies use information technologies that are accessible to those with disabilities [4]. The crucial issue of equal access to state voter registration and voter registration look-up websites is what we investigated in 2020. While Section 508 does not apply to state websites directly, it sets a standard in federal law that many states follow.
In 2014, the ACLU performed a similar in-depth study for 6 states and found that only one, California, was fully accessible [18]. In 2016, the ACLU and disabilities rights advocacy groups successfully sued the New York State Board of Elections and the Department of Motor Vehicles on behalf of two blind plaintiffs unable to access New York State’s online voter registration[16, 17]. Our study provides a comprehensive overview of the online accessibility of all state voter registration and voter registration look-up websites in 2020. Given the increasing reliance on digital tools, especially when in-person assistance may be severely strained by the COVID-19 pandemic, it is crucial to investigate whether the problems previously described by the ACLU study in 2014 still exist for state voter registration websites in 2020.
Background
In 1998, Congress amended the Rehabilitation Act of 1973, a predecessor to the ADA, to include Section 508 [5], which addressed web-related equal access issues. Section 508 requires federal agencies to ensure that their technology, including public websites, is accessible to people with disabilities. Inaccessible technology interferes with a disabled individual's ability to obtain and use information at the same level and with the same ease and speed as other non-disabled citizens. Section 508 seeks to eliminate these barriers for technology created by the federal government. This means that all technologies developed, procured and used by federal agencies are both: a) equally accessible to disabled employees; and b) equally accessible to disabled members of the public seeking to use online services or find information. Section 508 only applies to U.S. federal agency websites; Congress and the Judiciary are not included. The U.S. Department of Justice’s Civil Rights Division investigates complaints related to Section 508 and provides guidance to both state and local governments to help ensure their technology is accessible [7].
Legal requirements and accessibility standards for state websites vary by state. Some states have no specific laws pertaining to web accessibility or have only soft guidelines. On the other hand, nearly two dozen states incorporated Section 508 into their own laws [6]. Some states created their own accessibility standards based on Section 508 or other standards. These other standards are often those set by the World Wide Web Consortium (W3C), an international non-profit that develops standards to ensure the long-term growth of the web [21]. The W3C developed two sets of “Web Content Accessibility Guidelines”, first WCAG 1.0 and later WCAG 2.0 [21]. These guidelines go further than Section 508, which offers a broad, abstract standard, in specifying how to build accessible websites. Section 508 itself was updated in January 2018 to include WCAG 2.0; thus any states that set Section 508 as their standards now automatically include WCAG 2.0 as a requirement [22].
At present, the extent to which websites are covered by accessibility law is a contested topic. The successful 2016 ACLU lawsuit against New York state for having an inaccessible website demonstrated that courts might require state governments to follow their own laws [16, 17]. In 2019, the US Supreme Court let a lower federal court decision in Domino’s Pizza vs. Robles stand, handing a victory to a blind plaintiff suing Domino’s Pizza, a private company, over their website’s inaccessibility [18]. Up until 2019, the Supreme Court has not weighed in on whether private companies had to have accessible websites.
Currently, automated tools and services can test websites to see if they meet accessibility guidelines. In Phase 1 of this study, we used a popular automated testing program, the “Web Accessibility Evaluation Tool” (WAVE), on different state websites. WAVE tests the HTML code of websites for their compliance with W3C’s WCAG accessibility guidelines [9]. WAVE is created by WebAIM, a non-profit organization that has provided web accessibility solutions since 1999 [12]. The organization is based at the Center for Persons with Disabilities at Utah State University and aims to expand the potential of the web for those with disabilities [12]. WebAIM provides web accessibility training, evaluation, and consulting services to a wide variety of clients, including government agencies, businesses, educational institutions and Fortune 100 corporations. Its clients include PayPal, Sony, the IRS, and the CIA [12].
Assistive technologies such as screen readers exist to help those with disabilities such as poor vision navigate websites with hearing rather than sight. A popular screen reader is VoiceOver on MacOS. This is the native and default screen reader on all Macs and has significant market share; 13% of screen reader users say it is their primary screen reading software, and 47% say they commonly use it [20]. VoiceOver is an advanced screen reading technology that enables users with visual disabilities to control their computers using various keyboard commands and gestures and to access and interpret websites effectively [14]. The technology describes aloud what is presented on the browser screen. In order for websites to be effectively read aloud by VoiceOver, certain coding must be included during website development to describe non-text elements of the webpage. An example of this is an associated label to describe an input text box. While a user with good vision can read the label next to the text box, a VoiceOver user needs the text box itself to have an associated label in the HTML source file. An example of such a text box is shown in Figure 1 below.
Figure 1. A Screenshot of an Example of a Text Box Requiring an Associated Label. This screenshot shows an example of a text box (in this case ‘First name’). Such a text box requires an associated label in the HTML source file for the screen-reader technology to read. This label will ensure that the function of the text box is communicated accurately so that the user can use the site.
In Phase 2 of this study, we used VoiceOver to test the accessibility of websites from a user experience perspective. We chose VoiceOver because of its popularity and positive reviews from its users [15] and the relative ease of using VoiceOver on Macs as visually abled individuals to compare what we can see on the browser page versus what is read aloud by VoiceOver.
This study tested 43 state voter registration websites and 50 state voter registration look-up websites (including the District of Columbia, excluding Wyoming), which were all the state websites available online as of July 2020 [8]. For the 8 states without a voter registration website, voters must register in person or submit a paper form. Voter registration and voter registration look-up websites are extremely useful to voters, as they allow them to register to vote or check their registration information for errors without leaving the comfort and safety of their homes. These sites massively simplify the registration process for many Americans [11]. In addition, studies have found that voter registration websites can affect voter turnout. For example, a study of Georgia’s online voting registration system showed that 71% of those who registered online turned out to vote, while only 48% of those who registered by mail turned out to vote [10]. Thus, voter registration sites are extremely useful to voters, disabled and non-disabled alike.
Methods
Voter Registration Websites and Voter Registration Look-up Websites
We tested two types of websites: voter registration websites and voter registration look-up websites. Residents of many states use voter registration websites to register to vote. They use voter registration look-up websites to check their registration information and other election information such as sample ballots, election day polling places, their voting history, and absentee ballot request information. As of July 2020, we found voter registration websites in 43 states including the District of Columbia and voter registration look-up websites in 50 states including District of Columbia. Wyoming was the only state where we found neither. Figure 2 below shows examples of each type of website for Massachusetts.
Figure 2.1. Screenshots Demonstrating the Difference Between Voter Look-Up and Voter Registration Websites (using MA as an example). A Massachusetts cover page offers voter registration (“register or pre-register to vote”), voter registration lookup (“check registration information”), and other options.
Figure 2.2. This screenshot depicts the start of the online voter registration process for Massachusetts. This is the first page of the voter registration website.
.
Figure 2.3. This screenshot depicts the first page of the Massachusetts voter registration look-up website. Voters have to fill in their personal information to access their voter information (polling location, absentee ballot application, voter details, voting history etc.).
For Phases 1 and 2, we made a list of the 43 state voter registration websites and the 50 state voter registration look-up websites to test with WAVE and VoiceOver.
Phase 1: Testing for accessibility errors with WAVE
WAVE is an automated program that checks the HTML of a webpage for compliance with W3C’s WCAG web accessibility guidelines.
- We used WAVE to test each webpage of each state voter registration (Phase 1A) and voter registration look-up website (Phase 1B).
- We recorded the number and types of accessibility errors WAVE reported for each website. Figure 3 shows an example of a set of results from the WAVE test.
(a)
(b)
Figure 3. Screenshots Depicting an Example of the WAVE Accessibility Tool Results Layout. Both images A and B display the WAVE accessibility tool results for one example website (Florida’s voter registration website). Image A shows the first overview results page. Image B shows the ‘details’ tab, which displays the rundown of errors of different types. WAVE shows where exactly on the webpage each error occurs.
Phase 2: Testing for user experience problems with VoiceOver
We deepened our investigation of accessibility problems on each state voter registration and voter registration look-up websites by using VoiceOver, the default screen reader software on Macs, to compare the experience of using each website as a sighted vs. disabled user. This enabled us to examine whether the accessibility errors in the HTML of a website detected by WAVE translate into experience problems that prevent screen reader users from being able to successfully navigate the site to submit a voter registration or find their voter registration information online.
- We tested each state voter registration (Phase 2A) and state voter registration look-up (Phase 2B) website pages on a Safari browser with VoiceOver on a Mac computer to look for particular user experience problems that the screen reader user would encounter.
- We scored each website according to the scale below and recorded the specific experience problems observed, especially if they prevented a user from achieving the intended goal of submitting a voter registration or finding their voter registration online.
Accessibility User Experience Grading Scale
We created this grading scale by analyzing the impact of the problems a VoiceOver user would experience on each website. We determined the extent to which the problems hampered a user’s ability to proceed through the site to perform the site’s intended function. A high score indicates high accessibility, and a score of “inaccessible” means the website could not be functionally used with VoiceOver.
- High – No problems, or any problems that existed had no major impact. The site could be used successfully with VoiceOver.
- Medium – The problems slightly affect user experience (e.g., there is no description for images), but the site can still be used successfully and easily with VoiceOver. For example, if the site did not provide alternative text to describe an image of a state seal, VoiceOver users would not be aware of that image but could otherwise progress through the site and perform its intended function.
- Low - The problems make it fairly difficult to use the website with VoiceOver, but achieving the user’s goals is still feasible, assuming the user makes logical assumptions about what was not read out loud. For example, a county drop-down menu that lacks any labels would affect the user experience, but ultimately the user could likely proceed successfully if they deduced that all the options given were the names of counties in their state.
- Inaccessible - The problems render the site inaccessible, and it cannot be used with VoiceOver. For example, if none of the text boxes are labeled with associated text specifically to be read by screen readers, a disabled user would not know what to type in each box, whether their first name, last name, address, or other required information. Thus, they would be unable to proceed to use the website. Another common issue occurred when navigation was not possible because the “continue” or “next” button were images that weren’t readable by VoiceOver. In that case the website was categorized as “inaccessible”.
Phase 2 (VoiceOver) testing was done twice, first in May 2020 and then in July 2020. For the second round of testing, we used a second machine to confirm the results of the May tests using archived copies of the relevant state websites when possible. The results presented in the paper are from the second round of testing in July 2020.
We found that 8 states lacked voter registration websites, and 1 state lacked a voter registration look-up website as of July 2020. In addition, 4 states had voter registration websites and 7 states had voter registration look-up websites that WAVE’s automated program was not able to check for accessibility errors. This was usually due to the state websites treating WAVE as a bot and delivering an error page. We were able to use VoiceOver to test nearly all eligible state websites in Phase 2, including the ones that WAVE was not able to test in Phase 1. We encountered issues with using VoiceOver on Idaho and Michigan’s websites, so they weren’t tested in Phase 2. Thus, the following state websites were excluded from testing in Phase 1 or 2 in some manner:
- 8 states without a voter registration website (not tested in Phase 1 or 2):
- Arkansas, Maine, Montana, New Hampshire, North Carolina, North Dakota, South Dakota, and Wyoming
- 1 state without a voter registration look-up website (not tested in Phase 1 or 2):
- 4 states with voter registration websites that could not be tested by WAVE in Phase 1:
- Connecticut, Massachusetts, Minnesota, and Rhode Island
- 7 states with voter registration look-up websites that could not be tested by WAVE in Phase 1:
- California, Iowa, Massachusetts, Minnesota, New Mexico, North Dakota, and Utah
- 2 states with voter registration websites not testable with VoiceOver in Phase 2:
- 2 states with voter registration look-up websites not testable with VoiceOver in Phase 2:
Phase 3: Researching State Website Accessibility Policies and Guidelines
We researched state accessibility laws and policies to compare how these standards and guidelines aligned with our WAVE and VoiceOver accessibility test results in phases 1 and 2.
- We searched “[state] web accessibility policy” on Google for each state to find their policy/standards (if any). As a starting point, we used resources provided by 3Play Media, a company that focuses on video accessibility [23].
- We recorded what we found, if any, about accessibility standards for each state.
- We divided states into 5 categories based on their accessibility standards and then sorted into 2 tiers based on the strictness of their standards.
State Accessibility Standard Category
We created these categories based on shared characteristics of different states’ accessibility standards and laws.
- Strict Section 508 – A state falls into this category if Section 508 is stated as the required standard for accessibility compliance. In most cases, this is part of the state’s laws. Since Section 508 now includes WCAG 2.0 compliance, these states also automatically require WCAG 2.0, even if it is not specified in the state policy.
- Strict W3C Level Standards – A state falls into this category if the state does not require Section 508 compliance but does require compliance with W3C standards (WCAG 1.0 or WCAG 2.0).
- Strict Unique Regulations – States that have their own policies or laws that exceed Section 508 fall into this category.
- Soft Section 508 – A state falls into this category if Section 508 is described by the state as a guideline for state websites but not a legal requirement.
- Soft W3C Level Standards – A state falls into this category if it offers WC3’s WCAG as guidelines but not requirements.
Tiers Based on Strictness of State Accessibility Standard Category
We then created 3 tiers based on the strictness of each state’s accessibility standard category.
Tier 1 – These states have the strictest web accessibility policies. They adopt a high standard for web accessibility and require state websites to meet this standard. These are the states that fall into the three following accessibility standard categories: “Strict Section 508”, “Strict W3C Level Standards”, or “Strict Unique Regulations”.
Tier 2 – These states have accessibility standards, but they are only guidelines; there is no legal or compliance requirement involved. These are the states that were in the “Soft Section 508” or “Soft W3C Level Standards” categories.
Results
Phase 1A Results. Testing State Voter Registration Websites for Accessibility Errors with WAVE
We found that only 8 states with voter registration websites passed the WAVE test without any major accessibility errors: California, Illinois, Indiana, Maryland, New York, Oklahoma, Virginia, and Washington. Of the 39 testable state voter registration websites, 31, or 79%, failed the WAVE test and were not compliant with the W3C’s WCAG accessibility guidelines. Figure 4 shows each state’s performance in the WAVE test.
Figure 4. This map demonstrates which state voter registration websites met accessibility standards in the WAVE test. It shows that only 8 states had accessible voter registration websites compliant with W3C's WCAG guidelines.
In terms of types of errors found, 4 of the states that passed the WAVE test had no errors at all, while the other 4 had a few contrast errors. Contrast errors refer to a lack of contrast between background and foreground colors, which can make it hard for users with low vision to read and interpret the content. Since contrast errors can be overcome by screen readers, we did not count contrast errors as a major accessibility error in this study. Figure 6 shows the types of errors that WAVE found for voter registration websites. The most common was a “multiple form labels” error; 20 out of the 112 errors were of this type. A “multiple form label” is where a form control such as a text box has more than one label associated with it. This is problematic for those using screen readers because, if a form control has more than one label associated with it, the screen reader may not read aloud the correct label, and thus the user may be unable to proceed [9].
Phase 1B Results. Testing State Voter Registration Look-up Websites for Accessibility Errors with WAVE
We found that only 12 of 43 testable state voter registration look-up websites passed the WAVE test: Arizona, Arkansas, Illinois, Indiana, Maryland, Michigan, Montana, Oklahoma, South Carolina, Washington, District of Columbia, and West Virginia. Thus, 72% of the websites were not compliant with W3C’s WCAG accessibility guidelines. Figure 5 shows a color-coded map categorizing the states’ performance in the WAVE test.
Figure 5. A map demonstrating which state voter registration look-up websites meet the W3C accessibility guidelines. It shows that only 12 of 43 successfully tested sites had accessible, W3C WCAG–compliant voter registration look-up websites.
In terms of the accessibility errors found by WAVE, 8 of the compliant states had no errors at all, while 4 states had up to four contrast errors. For other errors found, the most common type of error on voter registration look-up websites is the “missing form labels” error. Of the total of 169 errors, 77 (46%) were of this type. This type of error would cause a screen reader to skip reading aloud the description of an input form such as a text box.
Figure 6. Most Common Accessibility Errors on WAVE Tests. The most common types of error are “multiple form labels” for voter registration websites and “missing form label” for voter registration look-up websites. The “other” category includes all the additional types of errors, including empty heading, empty button, broken skip link, broken ARIA menu, uninformative page title, linked image or spacer image missing alternative text, page refreshes/redirects, missing button, and missing or uninformative page.
Phase 2A Results. Testing State Voter Registration Websites for User Experience Problems with VoiceOver
After testing the user experience with VoiceOver, we categorized 8 state voter registration websites as completely inaccessible: Alaska, Kansas, Minnesota, Mississippi, Nebraska, Nevada, New Jersey, and Oregon (Figure 7). These websites failed the test because of missing form labels, which meant a user could not know what to enter into a text box, or missing labels for submit/continue buttons, which caused VoiceOver to skip over the buttons when reading out loud. A further 8 states had “low” accessibility scores, meaning that the websites could only be navigated with great difficulty by asking the disabled user to infer what’s missing based on context clues. These states were Colorado, Florida, Kentucky, Louisiana, Pennsylvania, Tennessee, Vermont, and Wisconsin (Figure 7). Fifteen states had high accessibility scores (Figure 7).
Figure 7. A map demonstrating the accessibility score of each state voter registration website tested using VoiceOver. Eight states’ sites were completely inaccessible, and a further 8 states had low accessibility. Only 15 states were scored as having high accessibility.
Figure 8 shows a screenshot for each of the 8 inaccessible state voter registration websites with a red box highlighting the area(s) of the webpage that made it completely inaccessible. These areas represent functions that a disabled user using VoiceOver could not perform.
Figure 8.1. A screenshot demonstrating the area of Alaska’s voter registration site that rendered it inaccessible.
Figure 8.2. A screenshot demonstrating the areas of Minnesota’s voter registration site that rendered it inaccessible.
Figure 8.3. A screenshot demonstrating the area of Nebraska’s voter registration site that rendered it inaccessible.
Figure 8.4. A screenshot demonstrating the area of New Jersey’s voter registration site that rendered it inaccessible.
Figure 8.5. A screenshot demonstrating the area of Oregon’s voter registration site that rendered it inaccessible.
Figure 8.6. A screenshot demonstrating the area of Kansas’ voter registration site that rendered it inaccessible.
Figure 8.7. A screenshot demonstrating the area of Mississippi’s voter registration site that rendered it inaccessible.
Figure 8.8. A screenshot demonstrating the areas of Nevada’s voter registration site that rendered it inaccessible.
Phase 2B Results. Testing State Voter Registration Look-Up Websites for User Experience Problems with VoiceOver
We found that 14 state voter registration look-up websites were completely inaccessible to a user using VoiceOver. These states were Alaska, Connecticut, Georgia, Mississippi, New Hampshire, New Jersey, New Mexico, North Dakota, Oregon, South Dakota, South Carolina, Texas, Vermont and Wisconsin (Figure 9). A further 4 states had low accessibility: Colorado, Florida, Hawaii, and North Carolina (Figure 9). The remaining 26 states had high accessibility (Figure 9). Figure 10 shows screenshots of the precise parts of the website for each of the 14 states that were inaccessible using VoiceOver.
Figure 9. A map demonstrating the accessibility scores of each state voter registration look-up website tested using VoiceOver. Fourteen states were completely inaccessible. A further 4 states had low accessibility. Twenty-six states had high accessibility.
Figure 10.1. A screenshot demonstrating the area of Alaska’s voter registration look-up site that rendered it inaccessible.
Figure 10.2. A screenshot demonstrating the area of Connecticut’s voter registration look-up site that rendered it inaccessible.
Figure 10.3. A screenshot demonstrating the areas of Georgia’s voter registration look-up site that rendered it inaccessible.
Figure 10.4a. A screenshot demonstrating the area of Mississippi’s voter registration look-up site that rendered it inaccessible.
Figure 10.4b. A screenshot demonstrating the area of Mississippi’s voter registration look-up site that rendered it inaccessible.
Figure 10.5. A screenshot demonstrating the area of New Hampshire’s voter registration look-up site that rendered it inaccessible.
Figure 10.6. A screenshot demonstrating the area of New Jersey’s voter registration look-up site that rendered it inaccessible.
Figure 10.7. A screenshot demonstrating the area of New Mexico’s voter registration look-up site that rendered it inaccessible.
Figure 10.8. A screenshot demonstrating the area of North Dakota’s voter registration look-up site that rendered it inaccessible.
Figure 10.9. A screenshot demonstrating the areas of Oregon’s voter registration look-up site that rendered it inaccessible.
Figure 10.10. Screenshot demonstrating the area of South Carolina’s voter registration look-up site that rendered it inaccessible.
Figure 10.11. A screenshot demonstrating the area of South Dakota’s voter registration look-up site that rendered it inaccessible.
Figure 10.12. A screenshot demonstrating the area of Texas’ voter registration look-up site that rendered it inaccessible.
Figure 10.13. A screenshot demonstrating the area of Vermont’s voter registration look-up site that rendered it inaccessible.
Figure 10.14. A screenshot demonstrating the area of Wisconsin’s voter registration look-up site that rendered it inaccessible.
Phase 3 Results. Researching State Website Accessibility Policies and Guidelines
We found that 23 states including DC had “Strict Section 508” policies, having adopted Section 508 as a required standard for accessibility (Figure 11). A further 6 states were in the “Strict W3C Level Standards” category, meaning that those states’ websites are required to meet WCAG 1.0 and WCAG 2.0 guidelines (Figure 11). Another 11 states created their own required “Strict Unique Regulations” that exceed Section 508 standards (Figure 11). A total of 40 states including DC had tier 1, the strictest accessibility policies, for their websites (Figure 12).
11 states had softer tier 2 recommendations or guidelines for web accessibility (Figure 12). 6 states were in the “Soft Section 508” category, meaning they recommended that all state websites comply with Section 508 standards (Figure 11). 5 of these states had ‘Soft W3C Level Standards”, meaning they recommended following WCAG 1.0 and WCAG 2.0 guidelines (Figure 11).
Figure 11. Table Grouping States By State Accessibility Standard Tier. This table shows the nature of the web accessibility policy of each state, demonstrating the level of enforcement (strict requirement vs. guidelines) and the level of standards (Section 508, WC3, or other).
Figure 12. A Map Categorizing States According to the Strictness of Their State Accessibility Standards. 40 states including DC are in tier 1, meaning they require the strictest accessibility standards. 11 states are in tier 2, meaning they recommend but do not require that websites follow accessibility guidelines.
Discussion
The Majority of State Voter Websites Are Not Easily Accessible
This study found that the majority of state voter registration and voter registration look-up websites displayed accessibility errors in the WAVE tests. Those often translated into usability problems that negatively affected the user experience during the VoiceOver tests. Seventy-nine percent of testable state voter registration websites (Figure 4) and 72% of testable state voter registration look-up websites (Figure 5) failed the WAVE test for compliance with W3C’s accessibility guidelines. Thirty-nine percent of the testable state voter registration websites (Figure 7) and 38% of the testable state voter registration look-up websites (Figure 9) were inaccessible or had low accessibility to a disabled individual using VoiceOver. These results demonstrate a clear accessibility problem in our voting registration and registration look-up websites that should be addressed to ensure all Americans have equal access to these tools.
Some states stood out as leaders in website accessibility. Five states consistently performed well in Phase 1 and 2 for each of their state websites: California, Maryland, Oklahoma, Virginia, and Washington. New York also passed each accessibility test, except for the WAVE test of the voter registration look-up website. That site was still highly usable with VoiceOver. Massachusetts also had highly accessible websites when testing with VoiceOver, although the Massachusetts sites had detected the WAVE program as a bot and blocked it from running in Phase 1.
Are States Compliant with Their Own Web Accessibility Policies and Guidelines?
We found that the 5 best performers (California, Maryland, Oklahoma, Virginia, and Washington) all had strict tier 1 web accessibility standards.
However, multiple states that adopted Strict Section 508 or W3C standards in their own laws did not have easily accessible voter registration or voter registration look-up websites. Out of the 18 states that had either an inaccessible voter registration or voter registration look-up website in Phase 2 testing with VoiceOver, 13 had strict tier 1 web accessibility requirements for state websites: Connecticut, Georgia, Kansas, Minnesota, Nebraska, Nevada, New Hampshire, New Jersey, New Mexico, North Dakota, Texas, Vermont and Wisconsin. Five of the states that failed Phase 2 testing had soft tier 2 accessibility recommendations or guidelines: Alaska, Mississippi, Oregon, South Carolina, and South Dakota.
Easy Ways to Make Voter Websites Accessible
It is important to note that most of the errors that render a site inaccessible to a disabled user using a screen reader like VoiceOver are fairly easy to fix. Seventeen percent of the accessibility errors at voter registration websites and 46% of the accessibility errors at voter registration look-up websites were “missing form label” errors, or places where text boxes on the webpage were not identified with labels that a screen reader could read. Without such labels, a disabled user has to guess at what the website is expecting them to type into the text box. Fixing this issue is fairly simple. Figure 13 shows how changing the “behind-the-scenes” HTML content of the webpage can help a disabled user using a screen reader understand what to enter in the text box [26].
Figure 13. An Image Demonstrating How to Code Forms So That They Are Accessible [26]. This image, created by the Center for Civic Design, shows how to combat one of the biggest issues with accessibility found in this study: coding forms so that they are accessible. Adding a label of “first” here will help a screen reader read out loud to a user that a first name is expected as input into the text box.
Other common accessibility problems arose when buttons to submit a form or continue to the next page were unreadable by VoiceOver, or important links on a webpage were unlabeled and skipped by the screen reader. These problems can similarly be fixed by adding more labels to the HTML of the website.
The CCD makes the following suggestion to help states make accessible voter registration websites [26]:
- Make the information easy to read
- Make headings meaningful
- Structure the site with proper HTML tags and appropriate metadata
- Code the form fields so they are accessible to screen readers
- Make sure everything works with a keyboard
References
- Digital.gov. Checklist of Requirements for Federal Websites and Digital Services. Accessed 17th March 2020. digital.gov/resources/checklist-of-requirements-for-federal-digital-services/
- Institute for Community Inclusion. Basic facts: People with disabilities. Accessed 14th February 2020. www.serviceandinclusion.org/index.php?page=basic
- ADA National Network. What is the ADA? Accessed 14th February 2020. adata.org/learn-about-ada
- United States Environmental Protection Agency. What is section 508? Accessed 17th March 2020. www.epa.gov/accessibility/what-section-508
- U.S. General Services Administration. IT Accessibility Laws and Policies. November 2018. www.section508.gov/manage/laws-and-policies
- U.S. General Services Administration. State Policy. Accessed February 2020. www.section508.gov/manage/laws-and-policies/state#W
- U.S. States Department of Justice, Civil Rights Division. Accessible Technology. Accessed February 2020. www.ada.gov/access-technology/index.html
- The PEW Charitable Trusts. Online Voter Registration: Trends in Development and Implementation. May 2015. www.pewtrusts.org/-/media/assets/2015/05/ovr_2015_brief.pdf?la=en&hash=E960B7E9E3945750B2B1F5617E3AC3EC6BB1F3C6
- Wave Documentation. WAVE website. Accessed March 2020. wave.webaim.org/api/docs?format=html
- Root, D et al. Increasing Voter Participation in America. July 2018. Center for American Progress website. www.americanprogress.org/issues/democracy/reports/2018/07/11/453319/increasing-voter-participation-america/
- Summers, M. Online Voting Isn’t As Flawed As You Think – Just Ask Estonia. October 2016. IEEE Spectrum website. spectrum.ieee.org/telecom/internet/online-voting-isnt-as-flawed-as-you-thinkjust-ask-estonia
- WebAIM. About WebAIM. Accessed March 2020. webaim.org/about/
- Enamorado, S. Do Your State’s Laws Require Section 508 Accessibility Compliance? Updated June 2019. 3playmedia website. www.3playmedia.com/2018/09/24/do-your-states-laws-require-section-508-compliance/
- Apple. Chapter 1: Introducing VoiceOver. Accessed March 2020. www.apple.com/voiceover/info/guide/_1121.html
- Lovejoy, B. Blind people say technology like Siri and VoiceOver is life-changing. May 2018. 9to5Mac website. 9to5mac.com/2018/05/29/iphone-blind-users/
- American Civil Liberties Union. Groups Sue New York Over Inaccessible Online Voter Registration For People With Disabilities. June 2016. www.aclu.org/press-releases/groups-sue-new-york-over-inaccessible-online-voter-registration-people-disabilities
- Queram, K. Websites for the board of elections and DMV must be accessible by the end of the year under the terms of a lawsuit settlement. February 2019. Nextgov website. www.nextgov.com/it-modernization/2019/02/new-yorks-online-voter-registration-will-become-accessible-blind-voters/155211/
- Mizner, S., Smith, E. Access Denied: Barriers to Online Voter Registration for Citizens with Disabilities. January 2015. ACLU website. www.aclu.org/report/access-denied-barriers-online-voter-registration-citizens-disabilities
- Higgins, T. Supreme Court Hands Victory To Blind Man Who Sued Domino’s Over Site Inaccessibility. October 2019. CNBC website. www.cnbc.com/2019/10/07/dominos-supreme-court.html
- WAVE. Screen Reader User Survey 8 Results. 2019. WAVE website. webaim.org/projects/screenreadersurvey8/
- W3C. About W3C. 2020. W3C website. www.w3.org
- Level Access. What’s New In The Section 508 Refresh? 2018. www.levelaccess.com/whats-new-section-508-refresh-2/
- 3PLay Media. Accessibility Laws. Accessed 2020. www.3playmedia.com/resources/accessibility-laws/#section-state
- New Jersey Transportation Trust Fund Authority. Web Accessibility Policy. 2005. www.nj.gov/ttfa/accessibility.shtml
- Center for Civic Design. Making Voter Registration Websites Accessible To People With Disabilities. Accessed 2020. civicdesign.org/making-voter-registration-accessible-to-people-with-disabilities/
- Center for Civic Design. Creating Accessible Online Information. Accessed 2020. civicdesign.org/fieldguides/creating-accessible-online-information/
- Interactive Accessibility. Accessibility Statistics. Accessed 2020. www.interactiveaccessibility.com/accessibility-statistics
Authors
Dr. Jinyan Zang is an experienced researcher on algorithmic bias, data privacy, election security, digital contact tracing, and more at Harvard University and the Federal Trade Commission. He is a Fellow at Harvard Kennedy School and a Scholar at the Public Interest Tech Lab at Harvard. He wrote one of the first Ph.D. dissertations on the new field of public interest tech at Harvard University. He was a 2017 recipient of the Paul and Daisy Soros Fellowships for New Americans for his work on public interest tech. He graduated with a B.A. in Economics from Harvard in 2013 and a Ph.D. in Political Science from Harvard in 2021.
Alyx van der Vorm, member of Harvard College Class of 2022, is a Neuroscience major with a minor in Government. She is a Double John Harvard Scholar and Detur prize winner with a particular interest in applying technology to improve social connectivity.
Juan Guzman, member of Harvard College Class of 2022, studies Technology Science and Government with a secondary concentration in Computer Science. Juan works as a Foundation Intern on campus, and has worked on multiple research papers regarding the accessibility of state websites.
Citation
Zang J., van der Vorm A., & Guzman J..
The Inaccessibility of Many State Voter Registration Websites.
Technology Science.
2021110801.
November 10, 2021.
https://techscience.org/a/2021110801/
Suggestions (0)
Enter your recommendation for follow-up or ongoing work
in the box at the end of the page. Feel free to provide ideas for next
steps, follow-on research, or other research inspired by this paper.
Perhaps someone will read your
comment, do the described work, and publish a paper about it. What do
you recommend as a next research step?
Back to Top