Off With Their Heads - In Desolation. Minneapolis punk band Off With Their Heads are well on their way to carving out their own punk rock story with their modern take on anthemic four-to-the-floor rock and roll. In the gritty tradition of bands like the Bronx and Against Me, Off With Their Heads write songs that invite fist-pumping singalongs.