I just notice there is no query settings under advance in view interface if the display type "Entity Reference", is this bug? it supposed to be like this?
I Drupal 7 we used to have that option.
This is a bug, it turns out that the 'cache' setting should have been hidden and not the 'query' setting.