Just tried physically turning it off and on again and it sat dead.
So I disconnected everything, blew on the SD card pins, tried again. As if by magic everything is working perfectly.
I hate it when it just restarts and you can't find out why it stopped.