The initial idea stemmed from thinking about possible ways to implement music with body movements. After research on the ml5 website and finding good examples online, the idea formed. The concept became a handPose controlled music editor and controller. While many examples utilized mediaPipe, i chose ml5 and tonejs. The song would be split intro different tracks that could be turned on and off, with a separate hand infusing effects into the sound. While no clear idea was present for the visuals from the start, due to time constraints and technical issues I relented to keep them rather simple.
Project made with musical help from @Safarri on SoundCloud.