Only tab complete after no match?

Would it be possible to have the fzf tab completion only kick in after a tab fails to do any completion? Often I want to tab complete something I know is a partial match that I am going to add a * to so I can do something on a (sub)set of files.

e.g.

```
> ls
test_1.txt
test_2.txt
results_1.txt
results_2.txt

> rm res
rm results_
rm results_*
```
At the moment, that first tab immediately goes into fzf mode, making it difficult to partially complete a file name. It also feels that more naturally matches existing tab completion modes which tend to only offer you a list when you hit tab and there's no common partial solution.