EyeMusic: Hearing colored shapes
By Amir Amedi
This app is only available on the App Store for iOS devices.
Have you ever heard colors? Heard shapes? Using the EyeMusic you can experience the visual world without even opening your eyes. With your ears open and your eyes closed join us for a trip around the brain and let us teach you how the world can be experienced with your mind's eye.
While blind people cannot use their eyes to see, they can experience the world using their intact senses. Even though hands can experience textures and shapes, and the ears can listen to and enjoy music, other aspects of the visual world such as the colors and the concept of horizon are less accessible to blind people.
The EyeMusic captures shapes and translates them into Soundscapes - auditory representations of pictures. Colors are represented using different musical instruments, higher pixels of the image are translated into higher notes on a given musical instrument (i.e. higher pitches on the piano, trumpet or the violin) while lower pixels of the image are translated into lower notes on the same musical instruments & pixels closer to the left side of the image are heard before pixels closer to the right side of the picture - thus enabling everyone to hear shapes and colors!
Using the EyeMusic you can:
pick the red apple from a bowl of green apples without opening your eyes, differentiate orange juice from lemonade, or experience the rainbow. Let us show you how the visual world can be experienced with only the ears!
Cool features include:
* 14 lesson for self-teaching
* 5 musical instruments = 5 colors. Can YOU pick out the red apple?
* sonification of your iphone's camera
* Auditory games using the EyeMusic
"The general concept is that you don't need to teach each object individually, you teach the principles—just like the brain understands the principles of dots and lines and how to combine them," Amir Amedi, principal investigator and developer of the EyeMusic
"A woman who has been blind since birth sits at a table with a bowl of mostly green apples in front of her. When asked to find the single red one, she plucks it from the bowl without hesitation and holds it up to applause from the audience. It's not a magic act but a demonstration of a new app that enables the visually impaired to hear information usually perceived through sight." Roni Jacobson, National Geographic http://news.nationalgeographic.com/news/2014/04/140403-eyemusic-ssd-visual-impairment-software-science/?rptregcta=reg_free_np&rptregcampaign=20131016_rw_membership_r1p_intl_dr_w#close-modal
What's New in Version 4.2
* New training gallery which includes some new images and previous white images in all colors.
* Bug fixes
To me this application does not appear to be at all finished. There are bugs, and pages that aren't complete. It doesn't seem to work correctly, but maybe that's on me. However, it is a little sloppy in the programming and the interface is poor.