Retirement experts are warning against bringing the age increase forward as it could impact vulnerable Brits.