The homes will be built on the former site of a centuries-old family business which is now the only one of its kind