Here's what Superchunk's Mac McCaughan remembers about the album:

"We recorded Here’s to Shutting Up in the Cabbagetown neighborhood of Atlanta at Zero Return, the studio built by Brian and Rob (aka Birdstuff and Coco the Electronic Monkey Wizard) of Man or Astro-man? Brian Paulson came with us to produce it. The studio itself was amazing. We also slept there in a dorm-like setting and stayed up too late. We had some great guest players on the record including the first appearance of a pedal steel on a Superchunk album, played by John Neff of Athens band Japancakes. Local Chris Lopez ( The Rock*A*Teens ) came over to sing backup vocals on “Art Class (Song for Yayoi Kusama).” I asked him to sing harmonies on the chorus and he was like, “Harmonies? Oh, I can’t sing harmonies.” I still don’t believe him, but what he did sing is awesome."