Building time for `cargo bench` takes quite a long time

### Is your feature request related to a problem or challenge?

Running `cargo bench --bench math_query_sql` takes almost 4min for building, @goldmedal reported that it takes about 10min for him

Most of the time stuck at `datafusion/core` crate.

### Describe the solution you'd like

Find the root cause and reduce the building time if possible

### Describe alternatives you've considered

_No response_

### Additional context

_No response_

Start by reproducing the reported `cargo bench --bench math_query_sql` build and investigate why compilation spends most of its time in the `datafusion/core` crate. Compare build timings before and after the investigation; done means the benchmark builds measurably faster without losing its existing behavior.

Written by the indexing model from the issue text.