[BUG] autochdir setting does not work when changing git-worktrees.

### Is there an existing issue for this?

- [x] I have searched the existing issues

### Current Behavior

Hello I found an issue when I change a git worktree the vim cwd is changed to a different directory.
But when I re-open the terminal directory is not changed to reflect the current worktree.
I checked that the vim cwd is changing and I was able to locally fix it with this change

Because of this fix https://github.com/akinsho/toggleterm.nvim/commit/dca1c80fb8ec41c97e7c3ef308719d8143fbbb05 I am not sure this will be the correct resolution.

### Expected Behavior

The cwd of vim and terminal to be synced up when it is reopened.

### Steps To Reproduce

Using configuration {
size = function(term)
if term.direction == "horizontal" then
return 20
elseif term.direction == "vertical" then
return vim.o.columns * 0.4
end
end,
open_mapping = [[t]],
autochdir = true,
start_in_insert = false,
insert_mappings = true,
erminal_mappings = true,
persist_size = true,
persist_mode = true,
direction = 'vertical',
close_on_exit = false,
clear_env = false,
auto_scroll = true,
}
1. Open vim in a directory open the terminal.
2. close the terminal
3. Change the vim directory with cd in vim
4. open terminal
5. check the path of the terminal cwd and of vim they should be the same.

### Environment

```Markdown
- OS: Arch linux
- neovim version:0.11.6
- Shell: zsh
```

### Anything else?

_No response_