Actually Chris it's the Old Exchange and Provost Dungeon. At the time it was built it served as an Exchange/Customs House as well as the Provost Dungeon.
Here's a link.
http://www.oldexchange.com/
Been spending a lot of summers in that neck of the woods since '81. Charleston, IMHO, is one of the most coolest towns I have ever been to.