A BBC Gardeners' World star has said he is unsure whether he would want to take over from Monty Don when he steps down as the main face of the show.