Currently in Relationship search configuration you are able to add additional fields to search by, but you are not able to remove the default fields.
Customer use case for this is that they are only initially configuring the relationships, they are not being used yet and would like to hide the relationships until end users are using this feature.