If when editing a view, you rearrange a list of fields and then apply the changes, all the items in the list will be removed. This happens to both the list of fields and the items in the sort criteria.
Just to add some extra data for troubleshooting:
You do not have to actually rearrange any of the items. Just clicking the Apply button will remove the items.
Canceling the dialog will not remove the items.