Have to approve access to the same directory multiple times, no clear indication why

### Describe the bug

When working through a session and it needs access to a directory it will prompt multiple times in a row for the same directory but it is unclear why, is it for a different agent, different permissions?

Please add some text explaining what the additional approvals are for and why they are required. If they are not required then remove them.

### Affected version

_No response_

### Steps to reproduce the behavior

1. Instruct LLM to get details for something in another directory that it does have access to

### Expected behavior

One prompt is raised for directory access.

If an additional prompt is raised, it is clear to the user how it is different from the previous approval

### Additional context

_No response_