Changing `ivy-initial-inputs-alist` has no effect on startup

### What did you expect to happen?

Changing `ivy-initial-inputs-alist` should change the initial character on the input.

### What actually happened?

Changing works when evaluating manually, but not on startup.

### Describe your attempts to resolve the issue

Try setting the variable in many ways, in and outside of `use-package!`, also tried using `after!` and `setq-default`.

Here's one of the attempts:

``` emacs-lisp
(after! (ivy counsel)
(setq ivy-initial-inputs-alist
'((org-refile . "^")
(org-agenda-refile . "^")
(org-capture-refile . "^")
(Man-completion-table . "^")
(counsel-M-x . "^")
(woman . "^"))))
```

### Steps to reproduce

Change `ivy-initial-inputs-alist` and see if the change is loaded on startup.

### System Information

https://pastebin.com/NjFtxjwm