Bug: Files don't remove highlight when unselected after drag and drop

### Description

When i select a file or a group of files, and unselect a file by ctrl clicking it, it acts as if it is unselected (when dragging the group of files, the file does not come with) , however, it remains highlighted as if it was selected so it is very hard to tell which files are selected

### Steps To Reproduce

1. Select a group of files
2. Ctrl-click a file to un-select
3. File remains highlighted but is no longer selected

### Steps to fix

- Remove highlight on file when Ctrl-clicking individual file to unselect it

### Files Version

Version: 2.4.25.0 OS Version: 10.0.19045.2486

### Windows Version

Edition Windows 10 Home Version 22H2 Installed on ‎11/‎28/‎2020 OS build 19045.2486 Experience Windows Feature Experience Pack 120.2212.4190.0

### Log file

[debug.log](https://github.com/files-community/Files/files/10582255/debug.log)