Skip to main page content

Mixed Reality Glasses as a Navigation Aid for Patients with Homonymous Hemianopsia - 5199

My Session Status

When:
11:56 AM, Friday 20 Jun 2025 (5 minutes)
Author’s Name(s): Edsel Ing, Ishaan Roy, Mahdi Tavakoli, Imran Jivraj, Alberto Galvez Ruiz

Author’s Disclosure Block: Edsel Ing, none; Ishaan Roy, none; Mahdi Tavakoli, none; Imran Jivraj, none; Alberto Galvez Ruiz, none

Abstract Body
Purpose: To develop mixed reality glasses (MRG) software to help patients with hemianopsia better navigate their visual environment. Study Design: Evolutionary (Prototype) Methods: Unlike virtual reality, mixed reality allows users to see the actual environment plus superimposed holograms. We employed the commercially available Microsoft HoloLens 2 MRG ($5000 US) in research mode, and the Unity software platform to develop real-time picture-in-picture navigation (PIPN). With PIPNa miniaturized view of the visual environment is transposed to the edge of theintact visual field inpatients with hemianopsia. External remote control was developed with the Streamlit and WebSockets applications as the MRG may be difficult for patients to initialize. Results: We were able to transpose a real-time miniaturized full-field picture-in-picture (PIP) hologram to the right or left and top or bottom of the MRG. The PIP could be adjusted to either black and white or color. Sighted observers using hemianopic simulator goggles found that PIPN did not impair navigation ability and was easy to adapt to once initialized. MRG could be worn over spectacles, but pantoscopic tilt required adjustment of the viewing window. Fully charged, the run times were at least one hour. REB approval for testing on patients was obtained. Conclusion: PIPN is a viable rehabilitation option to improve navigation for patients with hemianopsia and may be combined with other technologies such as obstacle detection. Other potential applications for MRG vision rehabilitation include patients with torsional diplopia, and oscillopsia. (CC-BY-NC-ND)

My Session Status

Send Feedback

Session detail
Allows attendees to send short textual feedback to the organizer for a session. This is only sent to the organizer and not the speakers.
To respect data privacy rules, this option only displays profiles of attendees who have chosen to share their profile information publicly.

Changes here will affect all session detail pages