The owner of a rural Herefordshire bungalow is trying to have a condition removed that requires its occupants to work in farming.