Synesthesia

Synesthesia is a processing application. It merges the senses and confuses them, prompting the user to see with their ears. Synesthesia parses through a Flickr feed and calculates the brightness, red channel, green channel, blue channel and color frequency histograms of each picture passing through it. It then maps out a library of sounds to the values of the histograms, letting the color properties control the sound (grain, pitch, playback rate, etc.) in real time. Each time the image is displayed, it generates a track that gets concatenated with the melody of the following one, in order to produce a never-ending generative piece.