The Herefordshire fruit grower being told to scale back facilities at one of its farms has said the decision means “putting views ahead of food”.