A family-run garden centre is closing down with its owners blaming the "stress and pressure" of running a small business.