datasource listing performs full listing despite user pruning partitions

### Describe the bug

Current implementation of caching will result in performing full listing of the table despite user explicit request for pruning partitions
This means that user MUST disable cache if he wants to perform efficient data lookup with partition pruning

This should be documented if it is not intended to be fixed

https://github.com/apache/datafusion/blob/54b7dd99bcda9a3015485388713f632cc089a637/datafusion/datasource/src/url.rs#L418

### To Reproduce

_No response_

### Expected behavior

Only cache paths by prefix, not full table

### Additional context

_No response_