A shadow minister has said he “desperately hopes” the Conservative Party can avoid another leadership contest in a few years time.