Plans to create four gypsy caravan pitches near a Herefordshire village have been refused permission, after more than a year of deliberation.