The finance minister will not say why his department is refusing to release the total amount the federal government plans to spend on defence annually.