Project: Visual Impaired Digital Platform

At present, the existing viewing aids and accessibility tools are rarely mobile and are usually heavy and expensive. They consist of electronics, mechanics, optics and a minimum of software. Their images cannot be adjusted according to individual eye diseases or individual patient parameters. _x000D_Digital devices with micro displays, micro cameras and software (to manipulate the image in real time) are not existing. Combining off-the-shelf components such as micro displays and micro cameras with embedded electronics and the latest processor techniques will create an universal, flexible digital viewing aid similar to goggles or HMD. See figure 1 (annex). Together with eye tracking, the user can control all functions of his device, and the image enhancements can be presented individually into the correct viewing position. The planned digital platform will be mobile, small and easily programmable to accommodate the patient's particular degree of disablement. It will be flexible for later adaptation, in the case of changed patient's parameters. The platform can be upgraded by additional features such as with plug-in modules. The result is one device for (at least) these following diseases: Macular Degeneration - Morbus Stargardt – Morbus Best – Retinitus Pigmentosa Diabetic Retinopatie – Usher Syndrome – Diabetes – Cataract – Glaucoma – N. Optic neuropathy – Retinal Vascular accident – Abinism – Cornea Dystrophy – Hemianopia. See figure 2 (annex). The same device can also be used for therapies and rehabilitation of Cortical Blindness patients as well as help in certain cases of Parkinson's disease. Several additional features are possible. For example, the device can be used as a reading magnifier for aging people either stationary or mobile. Combined with OCR techniques and simple audio output, the device could read short texts, even when travelling or in poor light conditions. The integration of navigation techniques (GPS, maps) is very useful and gives additional benefit to the device since this information can be presented according to individual needs - what is impossible for current market products. The combination of the NTE (near the eye) see-through optic, highly integrated electronics and the flexibility of software will reduce volume and price. The same device will be able to project text or images (i. e. maps) magnified on walls or on flat surfaces. See figure 6 (annex). Distance sensors can alert the person whose head is approaching an object. The integrated audio can update various and multiple situations or the features' status. For aging people, it will enable them to keep their independency and mobility. The device can be used hands free as HMD, as goggles or as handheld binoculars, hanging around the neck if not used. The NTE optics offers the advantage to display good image quality even in bright ambient light conditions, compared to direct view LCD screens. One of the key elements of the digital viewing aid is a transparent Head-Mounted-Display (see figure 4+5 annex) which does not block the user's sight. This is combined with video-see-through and the ability to enhance images compensating for the patient's viewing disabilities by using a camera. For example, such a camera can aid one to see better at night, auto focus for sharper images, give brilliant colours and, most importantly, magnify the scene by optical/digital zoom. The algorithms can adjust and enhance the image, depending on the individual user's needs. Diopter adjustments and parallax corrections are implemented into the near-the-eye (NTE) optics. Additionally, an optician can add correction lenses and adapt the parameters of the software algorithm with any computer._x000D__x000D_The consortium contains two groups of Ps: On the one side the development Ps Shepens, Trivisio, EOS and DFKI for hardware and software development._x000D_On the other hand a group of low vision distributors for the user tests in various European countries, OLVS (UK), Lysoglup (Denmark), ProVista (Norway), Reco (Spain), LVT (Netherl.)._x000D__x000D_All Ps have the corresponding expertise to ensure a solid development which will be validated with the help of real pilot applications._x000D__x000D_Schepens has profound expertise in all ophthalmologic fields concerning eye diseases, visual impairments and low vision tools._x000D_Trivisio is an SME with strong expertise in micro optoelectronic systems and NTE displays._x000D_DFKI focuses on the development of software solutions and algorithms for the fields of virtual and augmented reality and real time image manipulation._x000D_EOS is an SME with detailed knowledge about many kinds of optics particularly in NTE and eye tracking optics._x000D__x000D_OLVS, ProVista, RECO, Lysoglup and LVT, all SME, are specialists for rehabilitation, low vision and opthalmology along with distribution in their respective countries. They will ensure professional field tests and application scenarios along with acting as future reseller in their region for the planned sales phase.

Acronym VIDP (Reference Number: 5558)
Duration 01/12/2010 - 31/05/2014
Project Topic The planned system is a universal, flexible digital viewing device for the visually impaired, including an information and navigation tool, thus providing better and safer mobility and resulting in quality of life improvement.
Project Results
(after finalisation)
Protype mark III was delivered, but the project did not progress further than this. A full scale production was not achived within the granted period of 42 months. A new and most advanced prototype is expected to be ready for field test during summer of 2015.
Network Eurostars
Call Eurostars Cut-Off 4

Project partner

Number Name Role Country
9 German Research Center for Artificial Intelligence (DFKI) - Research Group Augmented Vision Partner Germany
9 Low Vision Totaal BV Partner Netherlands
9 Lysoglup v/Steen Scheffler ApS Partner Denmark
9 OOO ?lectro-Opticheskiye sistemi Partner Russia
9 Optima Low Vision Services Ltd Partner United Kingdom
9 ProVista Partner Norway
9 Recoletos Baja Vision Partner Spain
9 Schepens Eye Research Institute an affiliate of Harvard Medical School Partner United States
9 Trivisio Prototyping Gmbh Coordinator Germany