Python: Expand test suite for minimal dependency test

We run some tests without `pylance` or `pandas`, but it's pretty limited in scope. We should run most of the tests with this.

One thing we should make sure is that we only use pandas in tests that actually need pandas. For example, right now we skip `python/tests/test_table.py::test_add_pydantic_model` due to not having pandas, but that test is about pydantic, not pandas.

We should have been able to catch #3053 with this.

Start with the minimal-dependency test configuration and python/tests/test_table.py::test_add_pydantic_model. Audit which tests are skipped because pandas is unavailable, run them without pandas where appropriate, and broaden the suite so it can catch the regression described in #3053.

Written by the indexing model from the issue text.