iSight

Key Challenges

•Access to Information
Reducing Autonomy

•Time Tables for trains
•Billboards
•Restaurant Menu’s
•Shopping
•Access to Education
•Books
•Printed Material
•Internet
•General Information

•Job Retention decreases self reliance
•Less jobs for Visually Impaired

•Compromise in speed, accuracy impacts
retention
•Dependence - Relatives and Friends
•Life in Isolation
•Community connect
•Work on tasks independently

iSight – Sample Testing Results

Amazon Alexa Link to View

iSight – Testing Results Summary

1. Describe Scene – Single Snap

Good Lighting Conditions Accuracy (not extremely dark) - 85%

2. Multiple Snaps

3. Custom Trained Model

Ability to take continuous snaps,
controlled by voice to start and stop.
It works 100% of the time.

90% of objects/places correctly identified
more than 70% of the time. The offline
capability means that results are
immediate

4. Read and Translate

Read – 80% success Translate - 7 out of 9 languages correct.
Arabic and Japanese are semi accurate.

5. Facial and Emotion Recognition

Face + Emotion Accuracy – 90%

6. Read and Translate

Barcode Accuracy - 75% accurate

7. Color Analysis

Color Accuracy - About 75% accurate

8. Custom Voice Control

Up to 90% accurate.

9. Flash Control, Time

Voice control of flash, tells time

Driving the Change– What Can iSight Do Now

#1 – Enable an Effective Conversation #2 – Access to Printed Information

view site link

#3 – Enable Shopping #4 – Identify Objects, Scenes, Obstructions

view site link

#5 – Identifying Objects, Getting Context

Identify Objects, Get Spatial Context - Identify
Objects, understand where exactly you are
based on what the device is pointing to at that
point of time (for example Dining Table, or Sofa,
or Main Entry)

#6 – Leverage Alexa

Connection to Alexa enables a host of information gathering possibilities from weather, to news, home automation to getting answers about almost anything.