AltimateAI / AltimateAI/altimate-code

schema_index times out on large Snowflake databases

Offen
#58 1 Kommentar 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
Vorherrschende Sprache
TypeScript
Sterne
811
Forks
134
Ø Merge
3 T. 2 Std.
Gemergte PRs (30 T.)
50

Beschreibung

## Bug

`schema_index` times out when indexing a Snowflake database with a large number of schemas/tables, with no progress feedback or ability to scope the operation.

## Steps to Reproduce

1. Connect to a Snowflake warehouse with many schemas/tables
2. Run `schema_index [warehouse=jaffle_shop]`
3. Indexer times out with no useful output

## Expected Behavior

- **Progress feedback**: Show incremental progress (e.g., "Indexed 5/42 schemas...")
- **Timeout configuration**: Allow users to increase the timeout for large databases
- **Partial results**: Return whatever was indexed before the timeout rather than failing entirely
- **Scoping**: Allow indexing a specific schema rather than the entire database (e.g., `schema_index [warehouse=jaffle_shop, schema=public]`)

## Context

Large production Snowflake databases can have hundreds of schemas and thousands of tables. The current indexer appears to attempt a full catalog scan with a fixed timeout, making it unusable for these environments.

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.