Senior Conservative Sir James Cleverly has said he is quitting the shadow cabinet to stand for London mayor..