Built a local pipeline for beat-synced generative music videos using Stable Diffusion
I combined Stable Diffusion with audio analysis to trigger frame interpolation on kick drums. The result is a trippy visualizer that reacts dynamically to the stem separation of any uploaded track. You can grab the Colab notebook in the comments if you want to tweak the sensitivity thresholds.
0 comments
0