DEEP KARAOKE
Exploring Machine Learning with Song
What: Experience Prototyping Machine Learning Course
Duration: 3 days, winter 2019
With: Ivan Kunjavic, Toby Whelan, Yijiia Tao, Lea Bachmann
Skills: Teachable Machine, P5.js, Runway GPT-2
OVERVIEW
During our experience prototyping course, we worked on creating a karaoke machine which utilises machine learning to generate new lyrics and music videos for a new twist on the karaoke experience. Using Teachable Machine and the GPT2 pre trained model through Runway, we create an interaction with a cube with album covers on it with which the user can select a song. Using GPT2 the karaoke machine then generates alternative lyrics to karaoke classics!
SONG SELECTION
Select the song using the album cover cube
BECOME THE POPSTAR
Deep Karaoke, generates new lyrics to your favourite songs and immerses you inside the video so you can really be the the popstar!