Allow user to provide custom filter in ListingTableUrl

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
Many object_stores are not as clean as expected. Eg: many have "hidden" files such as _SUCCESS or _temp/blahblah.
When using ListingTableUrl these files are not filtered and cause issues when inferring schema/options.

**Describe the solution you'd like**
ListingTableUrl has an optional glob but it would be more helpful if this was somewhat more generic, eg an optional Fn(&ObjectMeta) -> bool

**Describe alternatives you've considered**
We could implement the filtering at other layers in the application but they all seem to come with drawbacks/feeling awkward (eg: such filtering does not really belong in a wrapper around an object_store).

Comienza localizando ListingTableUrl y su filtrado glob opcional existente; después, inspecciona cómo se utilizan los metadatos de los objetos durante la inferencia del esquema y de las opciones. Se considera terminado cuando un predicado de metadatos opcional puede excluir entradas como archivos ocultos antes de la inferencia, con pruebas que cubran el comportamiento del filtrado.

Escrito por el modelo de indexación a partir del texto del issue.