https://www.drupal.org/project/verf/issues/2998697 The first load of the filter, loads all entities. If you put a field that is referenced from a node, you will have a extreme performance problems with a large number of nodes. Issue module Views Entity Reference Filter