Brandi Rourk
Brandi Rourk
Collaboration
Collaboration is my first experiment with the concept of human interaction with AI.Â
​
I wanted to bring the conversation of AI into a space that can be physically explored.
​
By using Comfy UI, Touchdesigner, and Medipipe, I created a motion-driven experience that combines performance with randomness.
​
As the viewer moves their arm, they create an abstract, fluid drawing. I then have Comfy run its own interpretation of that drawing and lay it in the background. The resulting image is a relatively cohesive visual.
Project
Gallery
This was my first experience working in Touchdesigner, so my first step was to look at what other people were doing with live visuals and AI.Â
​
I found a few creators and used their graphs as a stepping stone to build off of.
​
I heavily relied on the Medipipe Tox by Torin Blankensmith and a Comfy UI-Touchdesigner tutorial by Yehua Ou
Phase 02: Design
I knew I wanted to have bright abstract visuals incorporating particles. But it was too much for my computer to run a real particle simulation and the Comfy UI generation. So instead, I chose to displace the color pixels in 3D space to give the illusion of particles. With some added color enhancement, I was able to get the drawn visuals and the generative ones to overlay and interact in a cohesive way.
Phase 01: Concept
Phase 03: Performance
This project was made for my first Grad Review. It served as a good base to show my interest in immersive visuals, real time motion capture, and human performance.Â
​
It was run on the LED wall in the XR Studio
TouchDesigner
Primary node-based visual programming environment for real-time interactive playback.
Orbbec Femto
Femto Mega is a programmable multi-mode Depth and RGB camera with real-time streaming of processed images over Ethernet or USB connections.