A Herefordshire man has been told facilities for his equestrian business in a scenic rural spot are not allowed – and he may have to remove them.