Steps to reproduce:
1. Navigate to Site Administration > Documents and Media
2. Click Add > Multiple Documents
3. Select any number of documents to upload
Once the files are uploaded (before clicking save), click the x icon on any of the files. Once you refresh the page the deleted documents will still be listed.