People in the comments of our game brought up that it was possible to place elements past the top of the screen. Turns out I had forgotten a check, and the program was writing to unrelated memory, causing weird things to happen. Ah, the joys of low-level programming!

Thankfully running the game in debug mode and with instrumentation helps to find this kind of bugs!