How the Prototype Was Evaluated with Blind Participants

According to casestudy_n_1, the prototype NavAccess was evaluated through user sessions with ten blind participants. The purpose of these sessions was to test the prototype’s navigation styles and learn how blind users normally navigate websites before and during prototype use.

Overall Study Setup

The evaluation was organized into multiple phases. casestudy_n_1 explains that each session included activities designed to gather both background information and direct evidence of use. The researchers combined interviews, observation, free exploration, task performance, and verbal reports.

• Semi-structured interview
• Observation of normal website use
• Free exploration of the Dan Brown website with NavAccess
• Familiar-task testing with NavAccess
• Think-aloud data collection

Phase 1: Semi-Structured Interviews

In the first phase, the researchers conducted a semi-structured interview with each participant. As described in casestudy_n_1, participants were asked about:

• How their impairment influenced daily life
• The role of the Internet in daily life
• The problems they experienced when accessing websites

This phase helped the researchers understand participants’ backgrounds and their existing challenges with web navigation.

Phase 2: Observation of Normal Website Use

The next phase involved an observation session. In casestudy_n_1, participants were asked to visit a website they frequently used and perform tasks they normally carried out there while the experimenter observed them.

This let the researchers study:

• What problems blind Internet users encountered in everyday browsing
• How they worked around those problems
• How they navigated before trying the prototype

Phase 3: Free Exploration with NavAccess

Before asking participants to complete a specific task with the prototype, the researchers first observed how they learned and used the controls. casestudy_n_1 notes that because users had to remember the controls, did not have constant visual feedback, and needed time to learn the system, the researchers included a free exploration phase.

During this phase, participants freely navigated the Dan Brown website using NavAccess. This was done to observe their experience with the main controls and functions of the prototype while they explored the site openly.

Phase 4: Familiar-Task Testing with NavAccess

After free exploration, participants were asked to carry out a task they were already familiar with on the Internet while using the NavAccess interface. According to casestudy_n_1, participants chose their own website and set their own task.

This phase was useful because it tested the prototype in situations that were meaningful to the participants rather than only in artificial tasks.

Think-Aloud Data Collection

While performing the familiar task, participants were asked to think out loud, as reported in casestudy_n_1. This gave the researchers access to participants’ ongoing reactions, decisions, and difficulties while using NavAccess.

The researchers also collected a range of supporting data, including:

• Participant age
• Visual capabilities
• Accessibility aids used
• Internet and computer experience
• How the participant had learned to use the Internet
• What the participant used the Internet for
• The website accessed during the session
• The nature of the task
• The duration of the task

Summary

In summary, casestudy_n_1 describes a user study with ten blind participants that combined background interviews, observation of participants’ usual web activity, free exploration of the Dan Brown website with NavAccess, familiar-task testing, and think-aloud reporting. This setup allowed the researchers to compare everyday browsing behavior with prototype-supported navigation and to collect both behavioral and verbal evidence about the experience.