"The waterfront is still littered with the warehouses and other buildings that were essential for exchange and trade with the slave holding states." . . . .