Finalyy came up with a game idea, here's a sketch:

Going to try and make it into a game now, streaming at https://twitch.tv/kuviman