He worries about the future of the condo market and whether his dreams of retiring early are still possible