Many UK drivers rule themselves out of car finance based on assumptions about their credit score, according to a broker.