Evolution of User Interfaces for the Visually Impaired- Part- 1

Transcription

1 From the SelectedWorks of Umakant Mishra May, 2006 Evolution of User Interfaces for the Visually Impaired- Part- 1 Umakant Mishra Available at:

2 Evolution of User Interfaces For the Visually Impaired (Part-1) * By- Umakant Mishra, Bangalore, India [This article is divided into two parts. This is the first part of the article.] Abstract Physically or mentally challenged people cannot use a computer in the same way a normal people can. For example, a person with disability in hands cannot use a standard keyboard or mouse efficiently. People having hearing problem, visual challenge etc. cannot interact with a computer like a normal person. So it is necessary to specially design the computers, interfacing devices and software interfaces, which can be used by the physically challenged people. There are many special devices like mouse, keyboard, pointers, and touch screens etc. to assist the visually challenged users. It is a challenge for the inventors and manufacturers to build such devices. It is difficult for the inventors to visualize the difficulties of a visually impaired person and invent special devices to assist them. Similarly it is challenging for the manufacturers to build these special equipments, as they may not find enough customers for a commercial viability. This article analyses the types of visual disabilities, different assistive technologies for different visual disabilities, guidelines for developing user interfaces for the visually impaired, software products available for assisting the visually impaired, and Inventions made on such adaptive technologies. The objective is to analyze and explore various assistive technology for the visually impaired users, and throw some light on the scope for future improvements on such interfaces. * This article was first published in May 2006 issue of TRIZsite Journal

3 Contents: 1 Introduction: What sense organs are used for computer interaction Who is a visually impaired user Type of Visual Disabilities and Assistive Technologies Assistive or Adaptive techniques for the visually impaired Common assisting Options useful for the visually impaired Tips for the developers to build adaptive interfaces Some software products for assisting the visually impaired Inventions on Adaptive Technologies (Part-II) 10 Scope for future inventions on Adaptive Technologies. (Part-II) 1 Introduction: The development in Information Technology gives increasing importance on building high performance user interfaces. Not only hardware interfaces but software interfaces are becoming more and more convenient and user friendly with the object oriented approach. The objects like files, folders, cabinets, printers etc. are all displayed in graphical icons. The objects are handled in a similar way like dragging and dropping as they are handled in the real life. The technology even leads to 3d display, virtual workspaces and simulations. Although all these improvements have benefited the common users, they have very negligible impact on the blind and visually impaired users. The visually impaired users cannot use the standard user interfaces made for a common user. There are certain assistive technologies used for improving the user interfaces for the visually disabled users. Normally human beings interact with computers by using the organ of vision, hearing and touching. When the visual interface is weak or invalid, naturally the importance goes to the other two organs. However, partially blind users still can use the visual interface although to a very limited extent. The assistive technologies built around the three major human interfacing organs are: vision - screen zooming technologies hearing- reading and speech recognition technologies, and touching- tactile display technologies Evolution of User Interfaces for the Visually Impaired, by Umakant Mishra 2

4 2 What sense organs are used for computer interaction If we look at the use of sense organs for interacting with the computer we find that vision, touch and hearing are mostly used for computer operation. Taste and smell are hardly used. In case of a normal user the vision plays a dominant role, whereas a blind user has to rely mostly on the hearing of sounds and voice. Organs used by Normal Users Organs used by Visually impaired Users vision Tactile audio others Human Output (input to computer) Human Input (output from computer) Audio Tactile Vision Others As we see in the above illustration, there is a need to improve the audio and tactile interacting techniques to help the visually impaired. There is also a scope to alter the visual interfacing techniques to suite the partially blind or low vision users. 3 Who is a visually impaired user If we look at the community of visually impaired computer users there are basically two categories. The first category- people who had visual disability and they later became computer users. The second category- the computer users who developed visual disability. Evolution of User Interfaces for the Visually Impaired, by Umakant Mishra 3

5 Interestingly the size of both the groups are increasing. While more and more disabled users start using computers, the existing computer user community also growing old to develop visual disability. Both the categories of visually impaired users are equally important although their expectations may slightly differ because of the difference in their previous experience with the computer. The older users who developed low vision may still like to depend more on the visual interface which they were familiar in the past. The new users may depend more on the audio interface which they use more in interacting with the rest of the world. 4 Type of Visual Disabilities and Assistive Technologies There are different types of visual disabilities, such as low vision, color blindness and lost vision etc. Users having partial blindness get some benefit from improved visual interfaces. Users with complete blindness get no benefit from visual interface. Thus they are broadly classified into partial blindness and complete blindness. Type of visual disability Partial blindness or low vision Complete blindness Blindness with hearing Disability Technology involved The visual interfaces need to be adaptive. Supplementary audio interfaces. Supplementary touch sensitive interfaces Substitution of visual interface by audio interfaces. Substitution of visual interface by tactile interfaces. Use of only tactile interfaces. 5 Assistive or Adaptive techniques for the visually impaired As we discussed, there are various techniques to improve the adaptiveness of the user interface for the visually impaired computer users. Broadly, all these techniques can be grouped under audio, visual or tactile domains. However, it is important to find the efficient techniques under each domain and explore the possibility of combining the techniques to produce the best effect. Evolution of User Interfaces for the Visually Impaired, by Umakant Mishra 4

6 Visual Techniques Useful for partial blindness Use of deep color and high contrast color schemes for text, graphics and GUI Using large fonts, large icons, large cursors, No large mouse pointers etc. for better visibility. Using screen magnifiers- the external No software tool that is used to magnify the screen contents. Illuminated keyboards. No Using special display devices like large size No monitors, CCTV (Closed Circuit Televisions), projectors etc. Audio Techniques Voice recognition and Text to Speech Technologies for voice interaction with the computer. listens to the voice commands. Narrators or audio descriptors which audibly describes different parts of the display or program. Screen readers that use TTS to audibly read the text displayed on the screen. Audible feedback on different mouse events. For example different sounds on onmouseover, onclick, ondrag, ondrop and similar events. Useful for complete blindness No Key tones or audio feedback on pressing keys on keyboard. Special sounds for special keys. Sound notifications when features are turned on or off Tactile Techniques Braille Keyboards - Special keyboards, large special keys, other special hardware interfaces. Braille monitors or Braille embossers, that - provide dot matrix dynamic display of contents Combined Techniques Karaoke type highlighting the text word by word while reading out the text. (Audio + Visual) Speech synthesizers that gives audio feedback on what the user has typed. For example, the user types a and computer speaks a. (Audio + Tactile) Braille display with sound and music (Audio + Tactile) Evolution of User Interfaces for the Visually Impaired, by Umakant Mishra 5

7 6 Common assisting Options useful for the visually impaired There are some assistive techniques, which are normally available in many applications and operating systems. This is because these features are not only helpful to the impaired user but also helpful to the normal user. It is important for the visually impaired user to know and make use of these features whereas a normal user can well manage without turning on any of them. Selecting a lower screen resolution for larger display of items. Turning display to high contrast for better visibility. Choose suitable color options. Select large icons and bigger font size in display settings. Change mouse pointer to bigger size and prominent color. Use pointer trails. Toggle on key tones, which beeps a tone when a key is pressed. Toggle on sound notifications when some feature is turned on or off. Assign sounds to different system events. Using short cut keys or function keys for frequently used (or difficultly accessible) operations. Configure browser to supersede the original font size and display in larger fonts. 7 Tips for the developers to build adaptive interfaces The look and feel of the GUI is very important to make it adaptive to the visually (and even otherwise) impaired users. Some people wrongly believe that the GUI is only meant for aesthetics, but it has so many impacts on different aspects like speeding up the operation, hygiene to the eye and brain, assisting to the impaired users and so on. While developing applications for a target group that might include visually impaired users, the developers should take care of the following aspects in their graphic user interfaces. Using larger fonts for better visibility. Use larger and with color contrast. The 16x16 small icons to be replaced with 32x32 or even larger icons. The icon size should be matching with font size. Include plenty of warnings and alert messages to ensure that the user is doing what he wants to do. This can be enabled in a special checkbox in the options menu. Include beeps, tones and audio messages as much as possible. Small tones after completion of any operation makes sure that the operation is done. Evolution of User Interfaces for the Visually Impaired, by Umakant Mishra 6

8 Informative voice messages can be managed by using wav files even without installing TTS engine. Quite a few wav messages can be included in the application to be enabled optionally. Voice interacting features with TTS and Speech Recognition engines will be quite good for visually impaired users. 8 Some software products for assisting the visually impaired Microsoft Narrator- is specially made for the blind and visually impaired users. It reads the contents of the start menu, program menu and web links. When the narrator is turned on it reads aloud every keystroke made by the user. ( Home Page Reader is a talking web browser from IBM. It supports several languages. This is intended for blind and visually impaired internet users. The JavaScript support allows to speak aloud all the contents on the web page. This enables blind and visually impaired users to complete on-line forms for doing transactions over the web. ( BrailleMaster from TVI (Technologies for the Visually Impaired) provides simple way to translate text to Braille, Braille editing and printing. ( Supernova - is a product from Dolphin specially made for the visually impaired. It has features like screen magnification to increase visibility and speech features to read text, s, web pages and windows menu items. It also supports refreshable Braille display to help the blind and deaf-blind. ( Magic from Freedom Scientific Group. Magic combines magnification features for the low vision users. Magic comes in professional and standard editions packaged with or without speech. It has features like mouse speech (reading the word under mouse pointer), keyboard echo (reading characters while typing) and other features. ( JAWS from Henter-Joyce is smooth in screen reading and providing output in refreshable Braille. ( outspoken, inlarge from Alva Access Group. outspoken has different versions for Windows and Macintosh. ( ZoomText the screen magnification software from Ai Squared. It enlarges, enhances and reads aloud everything on the screen, documents, s etc. It has two components, viz, magnifier and screen reader. ( [To be continued in the next part ] Evolution of User Interfaces for the Visually Impaired, by Umakant Mishra 7

9 About the author After working for more than 18 years in various fields of Information Technology Umakant is currently doing independent research on TRIZ and IT since He last worked as Director and Chief Technology Officer ( ) in CREAX Information Technologies (Bangalore). Before that he worked as IS/IT manager ( ) for ActionAid India (Bangalore). Umakant is a Master in Philosophy (MA), Master in Business Administration (MBA), Bachelor in Law and Logic (LLB), Microsoft Certified Systems Engineer (MCSE+I), Certified Novel Engineer (CNE), Master Certified Novell Engineer (MCNE), Certified Intranet Manager (CIM), Certified Internet Professional (CIP), Certified Software Test Manager (CSTM) and holds many other global IT certifications. Umakant has authored the books "TRIZ Principles for Information Technology", Improving Graphical User Interface using TRIZ, Using TRIZ for Anti-Virus Development etc. and working on a book on Management Information Systems. Many of his articles are available in SSRN elibrary ( bepress ( Arxiv ( etc. More about Umakant is available at Evolution of User Interfaces for the Visually Impaired, by Umakant Mishra 8