Synesthetic Music Visualizer

Fall 2018 - Spring 2019 Group 02

A raspberry pi with a microphone attached to it listens for frequencies and maps the frequencies heard to a color. There will also be LEDs connected to the GPIO pins on the pi that will display the colors. There are two modes to this project, the first mode being a simple mapping mode which correlates a specific range of frequencies to a color. The second mode is melody mapping mode that goes a little farther and determines key signature as well as a color configuration for a melody.

Simple Mapping Mode

Alt Text

Frequencies being fed in through microphone connected to raspberry pi are displayed on the GUI as well as the note that corresponds that frequency. Each note has a certain color that displays with it.

Melody Mapping Mode

Alt Text

This is the same as simple mapping mode but adds some more functionality. The key signature is determined from the melody, intervals between frequencies is shown, and an overall mood is assigned to the melody.

Settings

Alt Text

The settings menu allows users to change the color-note bindings of different notes.

PortAudio

Library used to listen to sounds and take in input from microphone.

sudo apt-get install libasound-dev

GTK3

C library used to develop the GUI

sudo apt-get install libgtk-3-dev

To compile and run the program use the following command:
#### gcc GUI.c FFT2.c KeyFind.c paex_record.c naivebayes.c intervalfinder.c rgb.c libportaudio.a -Wall -lwiringPi -lrt -lm -lasound -pthread `pkg-config –cflags gtk+-3.0` `pkg-config –libs gtk+-3.0` && ./a.out</br> **Note: don’t forget the backticks when running the code: `