A Pilot Study Comparing Performance of Blind Participants on 12 Tasks, With and Without the ARIA Device

A controlled, open label pilot study to assess the safety, efficacy, and usability of the ARIA Device with blind individuals who have no light perception or light perception only.

Intervention Name: The ARIA Device

Why: This study broadly asks: What is the ARIA difference, and how do we measure it? Aria Research is committed to codesign - developing assistive technology with and for people who are blind, so that the resulting device has genuine utility.

This pilot study explores the ARIA difference by comparing the performance of blind adults on 12 different research tasks that were codesigned with blind adults to represent their everyday tasks and environments. Each participant serves as their own control, undertaking each task with and without the Aria Device. This embedded mixed methods study has a qualitative priority. Checking the relevance of tasks and measures with every participant is part of warranting the validity of measurement data and the transferability/generalisability of study findings.

What: Materials for this study include the prototype ARIA Device being investigated, and the research resources that provide context for the investigation.

ARIA stands for Augmented Reality in Audio. The ARIA Device consists of Augmented Reality glasses connected by cord to a dedicated mobile phone that has the ARIA app installed. The glasses include cameras, speakers and an inertial measurement unit. The phone app uses artificial intelligence to convert camera vision from the glasses into a soundscape that includes words and unique sounds identifying specific objects nearby, and an audio rendering of depth that estimates the user's distance from solid matter. This soundscape is delivered to the user via an amplifier that enables volume control and switch-off. The soundscape is designed to augment rather than replace natural hearing, increasing the user's perceptual access to details in the nearby environment.

The ARIA Device is a secondary aid, designed to complement rather than replace a primary mobility aid (long cane, guide dog or human guide). The glasses are secured to the wearer's head with a lanyard and the other components are mounted onto a lightweight backpack, leaving the user's hands free to manage a long cane, guide dog harness, bus pass or shopping bag.

The research protocol uses multiple private and public indoor settings in and around Aria HQ: a deskspace and boardroom for talking and training; a contrived office, motel room and waiting room simulate real world scenarios; a large multi-purpose room and research laboratory house several clinical search tasks; an office corridor and public foyer are lived environments that offer room to move fluently. Then the living lab beyond the front door, includes busy footpaths, streets, and businesses in the Sydney CBD. Research resources in these settings include objects the ARIA Device can recognise in the context of the varied tasks undertaken therein.

Procedures: People who express interest in the study are booked for a 60-90 min intake interview by phone to confirm their eligibility to participate in the study. This interview includes co-rated assessments of functional vision and mobility using established measures (VROOM: Vision-related Outcomes in Orientation and Mobility and OMO: Orientation and Mobility Outcomes).

Each eligible, available participant undertakes four research sessions on separate days within a month, at ARIA HQ (Haymarket NSW, 2000). Participation in all four sessions is needed to complete the dataset, and includes:

• An introduction to Aria Research and the ARIA Device.
• A selection of questionnaires / baseline assessments to profile participants and provide a clinical point of comparison with performance in functional tasks. These include an audiogram (confirming normal hearing or no worse than mild to moderate loss with no hearing aids), the Stuart Tactile Maps test (measuring spatial cognition), Dynamic Sound Field Audiometry assessment (measuring spatial hearing) and the WHOQoL-26A (measuring quality of life).
• Training in use of the ARIA Device: fitting the device, scanning, identifying objects, interpreting distance cues, spearcons (speech sounds) and earcons (iconic object sounds); and social navigation using ARIA.
• 12 research tasks that have real-world equivalence for blind people, codesigned with blind adults, varying in purpose, and sequenced in increasing complexity across the four sessions. Each task is undertaken with and without the ARIA Device. Participants are free to use their long cane as they choose while they explore what the ARIA device can offer them in each task and complete the non-ARIA trials in a way that feels ordinary or authentic to them.
• Evaluation of the ARIA Device, tasks and measures, the overall protocol and the participant's experience of ARIA in each task.

The 12 research tasks:

Task 1: Travel Baselines involves multiple timed walks along an office corridor: two with reverse sighted guide to establish preferred walking speed, then one each using a long cane, the ARIA device, no aid, and any other preferred aids.

Task 2: Open Doors involves walking down the same corridor looking for an open office door, checking whether there is a person within, and locating door signage that identifies the occupant, first with then without the ARIA device.

Task 3: Timed Up and Go begins with you seated in a chair. You stand and walk across an open space to touch a potted plant 6 metres in front of you, then turn around and return to your seat. The trial order is ARIA, no-ARIA, and ARIA.

Task 4: Circle Search involves looking for five free-standing objects placed in a large circle, then walking to three of them in a specified order, before returning to home base. The objects are rearranged in between ARIA, no-ARIA, and ARIA trials.

Task 5: Office Search involves exploring an empty office, and then finding ten office objects (only earcons) that are placed on surfaces, some distance apart. The task is conducted 6 times; with and without the ARIA device, and with and without background noise.

Task 6: Un/Pack @ Ariabnb is like going on holiday or traveling for work. You explore the bedroom and unpack your bag, putting items in places that make sense to you. When repacking, you need to search because some items have been moved. The furniture is rearranged between the ARIA and no-ARIA trials.

Task 7: Court or Courting involves walking around Priscilla (a mannequin) at cane's length to identify 10 objects or accessories she is wearing and work out what she might plan to do today.

Task 8: Waiting Room is like attending a medical appointment where you take your referral to reception, find the toilets, then locate a seat near another person and settle in for a chat. Furniture is rearranged between ARIA, no-ARIA, and ARIA trials.

Task 9: Slalom Wayfinding takes place in the ARIA public foyer and involves finding a clear path between freestanding obstacles and people to reach the clock on the other side of the foyer, then return. The task is conducted with then without ARIA.

Task 10: Two Minute Walk happens at The Goods Line, a pedestrian walkway near Aria HQ. We measure how far you walk in two minutes and find out what you notice along the way, first with long cane only (no-ARIA) and then with ARIA.

Task 11: Finding Laura also takes place at The Goods Line, where you search for your friend Laura, who you're meeting for lunch. Laura is on her phone, not looking out for you, so you need to find her first with ARIA, then without ARIA.

Task 12: Traffic Spotting involves walking along the footpaths near ARIA HQ and reporting what you notice on the path, and on the road, first with your natural hearing, then with ARIA. You can walk alongside the guide, or hold onto an arm.

The Research Tasks and Measures document is a supplement to the Clinical Investigation Plan, available upon request from the Sponsor/Principal Investigator. It details the baseline assessments, ARIA training activities, the 12 novel research tasks and suite of new measures used to evaluate participants' performance in this study.

Intervention Provider: The core investigation team includes one Certified Orientation and Mobility Specialist (COMS) conducting the Intake Interviews off-site via phone, and four onsite members generating data with participants during the four research sessions:

The Principal Investigator (PI) directing tasks and recording qualitative data is a COMS/teacher/functional researcher/mixed methodologist.

The research assistant (RA) responsible for videoing every task and ensuring the ARIA Device and other recording devices are maintained in good working order, is a COMS/Guide Dog Mobility Instructor.

The RA generating quantitative data through co-rating performance scales with participants and the team, is a qualified occupational therapist.

The RA generating quantitative data through biosensors and a patient-reported outcome measure is a PhD student investigating task-related effort in the context of human-computer interaction.

Two other RAs from another university partnership are generating data in the spatial hearing assessment.

Certified Orientation and Mobility (O\&M) Specialists have the tertiary qualifications and experience to assess the behaviour of blind travellers, teach the blind mobility skillset, and identify and manage co-morbidities that can affect pedestrian travel in lived environments. The blind mobility skillset includes guiding skills, independent travel skills, long cane training, road crossing safety, orientation to new places, accessing public transport, and strategies to optimise social engagement in public, such as self-advocacy, help-seeking and refusing assistance.

Investigation team members who are not O\&M-qualified undertake immersive blindfold training in O\&M and activities of daily living to understand how to guide and work effectively with blind participants, and how to manage power differentials in person-centred practice, co-design and co-rating conversations. All members of the investigation team have completed Good Clinical Practice (GCP) training and most hold a current first aid certificate. All have received training on the study, including familiarisation with essential documents, how to set-up and manage the research tasks, and how to record and secure data.