AltimateAI / AltimateAI/altimate-code

schema_index times out on large Snowflake databases

Aperta
#58 1 commento 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
TypeScript
Stelle
811
Fork
134
Merge medio
3g 2h
PR unite (30g)
50

Descrizione

## Bug

`schema_index` times out when indexing a Snowflake database with a large number of schemas/tables, with no progress feedback or ability to scope the operation.

## Steps to Reproduce

1. Connect to a Snowflake warehouse with many schemas/tables
2. Run `schema_index [warehouse=jaffle_shop]`
3. Indexer times out with no useful output

## Expected Behavior

- **Progress feedback**: Show incremental progress (e.g., "Indexed 5/42 schemas...")
- **Timeout configuration**: Allow users to increase the timeout for large databases
- **Partial results**: Return whatever was indexed before the timeout rather than failing entirely
- **Scoping**: Allow indexing a specific schema rather than the entire database (e.g., `schema_index [warehouse=jaffle_shop, schema=public]`)

## Context

Large production Snowflake databases can have hundreds of schemas and thousands of tables. The current indexer appears to attempt a full catalog scan with a fixed timeout, making it unusable for these environments.

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.