An experiment from our Creative Lab Fivers - primarily Rupert Manfredi
Semi-Conductor puts you in front of your very own AI orchestra. It uses Tensorflow & PoseNet to allow you to conduct music by moving your arms, using only your browser and a webcam.
For us, it was a fun experiment in AI and interfaces – how can AI help us interact with computers more naturally? Can we control music the way a real conductor would, instead of with buttons and a screen?
You can find it on the Experiments page here, and YouTube here, and here's the direct link.