An elderly man died after he was pulled out of Baltimore's Inner Harbor on Wednesday, according to fire officials.