Here's a little something I've been working on using PD for sound and VVVV for animation. Almost everything is generated in PD and sent over to VVVV for mapping and object manipulation. Everything is real-time, and not a lot of human intervention is needed to make things happen in the piece. I used Fraps to capture the output of both audio and video (which is dead simple and awesome).

Enjoy!