Digital World & Image Group

Richard Cytowic

Oliver Sacks

Vilayanur Ramachandran

Existing Material

There are Artificial Synaesthesia devices that perform certain kinds of information mapping depending on their intended function. This is true for Synaesthesia artists that specifically cater to an audience that can relate to the artistic expression as well as to neuro-typical people that would perceive the art as a form of surrealist work.


A project more closely related to the one I propose to create (although involving different sensory mappings) is the feelSpace device.

It tries to create a mapping between our spatial and directional systems to our touch senses, so the person can improve their navigational skills. The researchers believe that by using sensory substitution devices, “a strong integration of new information in perception is possible, presuming fair training. “



Bloom (a precursor to Trope but with the same idea in mind) is, “Part instrument, part composition and part artwork, Bloom’s innovative controls allow anyone to create elaborate patterns and unique melodies by simply tapping the screen.” It most resembles my application in terms of a computational approach to generative music playing. My application is conceptually different in that it will have a procedurally generated visualization that the viewer’s interaction will accompany. It is also not clear on what basis the visual elements where chosen to represent the sound pieces.