I guess I won’t use what I was planning (SDL, c++, yada yada)
Instead, I’ll use pygame + python and use some bits and pieces from my last entry in the pyweek compo. Here’s the link, and feel free to use anything that you might find useful:

https://github.com/Gato-X/NotYourData