Gold medal winner Piers Gilliver says it is "not acceptable" he and his partner were turned away.