Thursday night on the Late Show, Regina Spektor performed "All the Rowboats"--the lead single from her upcoming LP, What We Saw From the Cheap Seats. Conan O'Brien and John Mayer also stopped by to see David Letterman, the latter of whom releases his album Born and Raised on Tuesday.

What We Saw From the Cheap Seats hits stores on May 29 via Sire/Warner Bros. Records.

Watch the video below.