Taylor Swift cut New York taxpayers a fat check for her Madison Square Garden nuptials ... forking over $60,000 for a city permit on her wedding day, TMZ has learned.