Herefordshire residents are “polarised” on the issue of whether to boost cycling and walking in the county, bosses have been told.