I decided I would take the path of simply using SDL.  This was a bad choice, I miss hardware acceleration