Kestrell

VisWiz app allows blind users to crowdsource visual descriptions in real time
Originally posted to the MacVisionaries mailing list; more links after the article extract.

New Scientist article
http://www.newscientist.com/blogs/onepercent/2011/05/smartphone-app-lets-the-blind.html

block quote start
Designing a computer program that can reliably recognize text and distinguish objects in the real world has proven to be a massive challenge for artificial
intelligence researchers. To get around this, the researchers behind VizWiz - a team consisting of computer scientists from several universities, including
the University of Rochester - decided to outsource the task of problem-solving to people: specifically, to Amazon Mechanical Turk's masses of online workers.

To make sure users get answers as quickly as possible, the researchers programmed an intelligent queuing system they call Quik Turkit to speed things up.
Quik Turkit recruits Mechanical Turk workers even as a VizWiz user is taking a picture, so someone is always ready to answer an incoming query.

Eleven blind iPhone users tested out VizWiz, asking questions like: "What denomination is this bill?", "Do you see picnic tables across the parking lot?",
and "What temperature is my oven set to?"

They received an average of three responses per query and waited an average of 133.3 seconds for the first answer. The first answer received was accurate
or helpful in 71 of 82 cases. By the third answer, all questions were correctly answered.

In a second test, the volunteers got to use VizWiz 2.0, which includes improved image processing techniques. Their response time was cut to an average
of 27 seconds.
block quote end

WisWiz app at Apple store (available in U.S. and UK)
http://itunes.apple.com/us/app/vizwiz/id439686043?mt=8

VisWizweb site
http://vizwiz.org/

Vizwiz tutorial (helpful to read through first, since the app just opens with the camera)
http://vizwiz.org/tutorial.html

Research project at the University of Rochester
http://hci.cs.rochester.edu/currentprojects.php?proj=vw