Sensory augmentation to aid training with retinal prostheses

Simple item page
dc.contributor.authorKvansakul, Jessica
dc.contributor.authorHamilton, Lachlan
dc.contributor.authorAyton, Lauren
dc.contributor.authorMcCarthy, Chris
dc.contributor.authorPetoe, Matthew
dc.date.accessioned2020-08-05T07:16:17Z
dc.date.available2020-08-05T07:16:17Z
dc.date.issued2020-07
dc.description.abstractOBJECTIVE: Retinal prosthesis recipients require rehabilitative training to learn the non-intuitive nature of prosthetic 'phosphene vision'. This study investigated whether the addition of auditory cues, using The vOICe sensory substitution device (SSD), could improve functional performance with simulated phosphene vision. APPROACH: Forty normally sighted subjects completed two visual tasks under three conditions. The phosphene condition converted the image to simulated phosphenes displayed on a virtual reality headset. The SSD condition provided auditory information via stereo headphones, translating the image into sound. Horizontal information was encoded as stereo timing differences between ears, vertical information as pitch, and pixel intensity as audio intensity. The third condition combined phosphenes and SSD. Tasks comprised light localisation from the Basic Assessment of Light and Motion (BaLM) and the Tumbling-E from the Freiburg Acuity and Contrast Test (FrACT). To examine learning effects, twenty of the forty subjects received SSD training prior to assessment. MAIN RESULTS: Combining phosphenes with auditory SSD provided better light localisation accuracy than either phosphenes or SSD alone, suggesting a compound benefit of integrating modalities. Although response times for SSD-only were significantly longer than all other conditions, combined condition response times were as fast as phosphene-only, highlighting that audio-visual integration provided both response time and accuracy benefits. Prior SSD training provided a benefit to localisation accuracy and speed in SSD-only (as expected) and Combined conditions compared to untrained SSD-only. Integration of the two modalities did not improve spatial resolution task performance, with resolution limited to that of the higher resolution modality (SSD). SIGNIFICANCE: Combining phosphene (visual) and SSD (auditory) modalities was effective even without SSD training and led to an improvement in light localisation accuracy and response times. Spatial resolution performance was dominated by auditory SSD. The results suggest there may be a benefit to including auditory cues when training vision prosthesis recipients.en_US
dc.description.sponsorshipThis work was partially funded by NHMRC project grant 1082358 (L.N.A, M.A.P), industry support from Bionic Vision Technologies Pty Ltd (J.K, M.A.P, L.N.A), patents (M.A.P), Health Investment Grant (Clive and Vera Ramaciotti Foundation) and Operational Infrastructure Support from the Victorian Government of Australia.en_US
dc.identifier.citationKvansakul, J., L. Hamilton, L. N. Ayton, C. McCarthy, and M. A. Petoe. 2020. Sensory augmentation to aid training with retinal prostheses. Journal of Neural Engineering. 17(4): 045001.en_US
dc.identifier.issn1741-2552
dc.identifier.urihttp://repository.bionicsinstitute.org:8080/handle/123456789/402
dc.language.isoenen_US
dc.publisherIOP Publishingen_US
dc.subjectSensory substitution devicesen_US
dc.subjectSSDen_US
dc.subjectRetinal prosthesesen_US
dc.subjectBlindnessen_US
dc.subjectRehabilitationen_US
dc.subjectTrainingen_US
dc.titleSensory augmentation to aid training with retinal prosthesesen_US
dc.typeArticleen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
2020_Kvansakul_Sensoryaugmentation.pdf
Size:
56.59 KB
Format:
Adobe Portable Document Format
Description:
Download
License bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description:
Download
Collections
BI publications