Open-source synesthesia for anyone
While it may not be immediately obvious, the way we experience the world around us involves every one of our senses working in unison, rather than separately. Anyone who has seen a silent movie can describe the discomfort caused by completely separating visuals and sound.
Audiovision brings synesthesia to everyone. While most media players have some sort of audio visualizer built in, and there are complex projector systems and light shows that can synced up with live music, the ability for a local musician to take advantage is hindered by complex code or proprietary systems that would decimate a budget. Audiovision changes that by being developed with entirely open source technologies and easily modded software. Put together, the whole system costs about 150, putting it in the price range of any hobbyist.
Every aspect is open source. The software is written using Processing 3 and its accompanying sound library, while the hardware is made up of a raspberry pi 3+ outputting a graphic through HDMI. The software is based on modified code from tutorials and is broken down step by step in the comments as to how it works, with different modes commented out and ready to run.
- Apr 5, 2018 Plan of Research Apr 5, 2018
- Apr 10, 2018 Object Based Programming in Processing Apr 10, 2018
- May 1, 2018 Processing 3 Sound Library AudioIn Class May 1, 2018
- May 1, 2018 Processing 3 Sound Library FFT May 1, 2018
- May 1, 2018 Rendering a Sine Wave May 1, 2018
- May 1, 2018 Hardware May 1, 2018