Giter Club home page Giter Club logo

haptic-ios's Introduction

"Augmenting Reality" for the Visually Impaired

Problem Statement

How do we use artificial intelligence to make our digital tools more accessible to everyone?

Visually impaired internet users like their sighted counterparts, benefit tremendously from the information and services the web has to offer. However, as web pages have become more complex the "screen readers" that visually impared users

Context

High level research into the potential market of visually impaired users revealed a global market reach of 285 million visually impaired individidals worldwide. Of that population:

  • 39 million are fully blind
  • 246 million have low vision
  • About 90% of the world's visually impaired live in developing countries.

Demographic Considerations

Given that 90% of the world's visually impaired population live in developing countries, we felt it was important to incorporate addtional design considerations so that our prototype is:

  1. Financially accessible to a wide range of demographics
  2. Serves the needs of users in markets where internet access may not be consistent

Design Considerations

Only 13% of the visually impared market is fully blind, which means that we have to design an experience that uses AI that augments physical and digital experiences for broad spectrum of users, some who are fully visually impaired and others who are less. As such, it will be important to design an experience that uses a wide range of sensory experiences including:

  1. Auditory: Includes image and text to speech as well as other auditory based cues
  2. Tactile: Touch-based cues to
  3. Visual: Basic and/or varying level of visual object cues

Technology Considerations

Further refining the "How can we..."

How can we leverage advances in artificial intelligence and image/text-based recognition tools to improve digital and physical accessibility for the visually impaired in emerging markets?

The Protype:

Overview

Our prototype repurposes old or recycled touchscreen phones in developed markets where and uses image and text based recognition to provide auditory and tactile queues using haptic feedback:

Haptic feedback

Haptic feedback is the use of the sense of touch in a user interface design to provide information to an end user. When referring to mobile phones this generally means the use of vibrations from the device's vibration alarm to denote that a touchscreen button has been pressed. In this particular example, the phone would vibrate slightly in response to the user's activation of an on-screen control, making up for the lack of a normal tactile response that the user would experience when pressing a physical button.

Artificial intelligence:

Our Haptic feedback for visually impaired users

Future Iterations:

A future iteration of this model

haptic-ios's People

Contributors

cabmorris avatar smithclay avatar willpapper avatar

Watchers

 avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.