We limit the learn about your data to 1000 objects in the Native Query Editor
- Dominant language
- Clojure
- Stars
- 49.3k
- Forks
- 6.8k
- Avg merge
- 1d 13h
- Merged PRs (30d)
- 653
Description
### Describe the bug
We limit the learn about your data to 1000 objects
You cannot decide what shows up and what doesn't, the weird thing is that if you have 1000 tables, and you create a model form this Database the model will be counted as an object and the table count lower to 999
### To Reproduce
Connect to any Database, created over 1K tables and then go to Native -> Learn about your Data -> It limits to 1K. tables
In practice it's 1K objects so creating Models will also be part of these 1K and remove tables randonly
### Expected behavior
All tables and columns are listed there
### Logs
None that are relevant
### Information about your Metabase installation
```JSON
Happens on v59 On v58 this issue wasn't present and everything loaded in that section
```
### Severity
Some people have been using this feature to check what tables they should use. It's more problematic with DBs that supports Schemas cause you might have different set of schemas and different set of tables but it would still aggregate the total to 1K entities
### Additional context
_No response_
Contributor guide
Research direction
Start in the Native Query Editor at Native → Learn about your Data and reproduce the issue against a database with more than 1,000 tables. Compare the behavior described for v58 and v59, including databases with schemas and models. Done means all tables and columns are listed and creating a model does not displace a table from the 1,000-object result.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- clojure
- Domain
- databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100