Vim keybindings broken after fzf_cd

- [X] I have read through the manual page (`man fzf`)
- [X] I have the latest version of fzf
- [X] I have searched through the existing issues

## Info

- OS
- [X] Linux
- [ ] Mac OS X
- [ ] Windows
- [ ] Etc.
- Shell
- [X] bash
- [ ] zsh
- [ ] fish

## Problem / Steps to reproduce
I cannot figure out the exact steps reliably, but I use tmux + vscode + vim keybindings. Through some sequence, I trigger the `__fzf_cd__` mechanism, but after I cancel out of it, it breaks my vim keybindings: specifically, various vim navigations require pressing the same keys twice (e.g. CTRL + {, then K to go to previous command). I confirmed that `set -o vi` was being called in my `bashrc` before initializing fzf.