​​​​​​​GitHub | YouTube
This experiment is aimed to control song visualizations we usually find media players like VLC and Windows Media Player. The mechanics are based on sin wave structures and are inspired by a “Colorful Coding” video on YouTube I watched a while ago.
In this setup, the visualization reacts to the user’s wrists. Using ml5.js(poseNet), a scroll is detected when the user quickly moves their arms together to left/right. The rotation speed of the visualization depends on the speed of the hand movement. Users can also move their hands up and down; during which the illustration loops through the sin wave propagation providing spring feedback.
Back to Top