Project 2 Experiment 8 – Processing P3D and FFT

I will start the last experiment description with a burst of honesty: by the time I did the seventh experiment, the second project for the Creation and Computation class was finished. So any¬†experiment done after that point wouldn’t affect the outcome of the main project in any way. Because of that, the eighth experiment was something I did just to explore some of my personal creative interests. At first I wanted to try fluid dynamics in Processing. The¬†diewald_fluid library for Processing gives interesting results but I was having too much trouble trying to create my own code using it, and given how complicated the mathematics behind fluid dynamics are, I decided it would be better to try something else.
After spending some time on the Processing website, I found a short example code showing how to create a sphere, a camera and a light in Processing. In other words, a very simple 3d scene. So I decided to revisit the fourth experiment and use FFT to animate the parameters of the 3d scene. In the example video, the object size and camera position are animated based on audio analysis. Lights were not used because I thought removing the objects shading and only having the wireframes looked interesting. This short experiment opened up new possibilities for exploring audio and video interaction. I’d like to try animating things such as a displacement map in a more complex 3d object and see the results. This could also be done in a 3d package such as Cinema 4D which offers options to use audio tracks to animate parameters, but it won’t offer real-time results. Another plan I have for further exploring 3d and audio interaction is the softare Touch Designer. I have seen a few projects around the web that showed the capabilities of that software of handling 3d object manipulation in real-time and that is something I will spend time attenpting to achieve in the near future.