If you have a file field that's set to private and a non administrator creates a file and saves the node as a draft the next time an administrator tries to change the workflow from draft to publish or just updates the node, the administrator gets the validation error:
'You do not have access to the referenced entity'
Within ReferenceAccessConstraintValidator.php it doesn't seem to take into account the 'bypass node access' permission or simply the administrator should have access to everything so this validation error should never occur.
This only happens when the content moderation module is installed, and a private file field is added.