If you want to remove reference view for a specific content type, you can do so:
Navigate to the Content model tab.
Select the content type you want to remove the reference view from.
Click the Entry editors tab. You can then remove your desired content type from the list of entry editors.