AltimateAI / AltimateAI/altimate-code

schema_index times out on large Snowflake databases

Abierto
#58 1 comentario 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
TypeScript
Estrellas
811
Forks
134
Merge medio
3 d 2 h
PR fusionados (30 d)
50

Descripción

## Bug

`schema_index` times out when indexing a Snowflake database with a large number of schemas/tables, with no progress feedback or ability to scope the operation.

## Steps to Reproduce

1. Connect to a Snowflake warehouse with many schemas/tables
2. Run `schema_index [warehouse=jaffle_shop]`
3. Indexer times out with no useful output

## Expected Behavior

- **Progress feedback**: Show incremental progress (e.g., "Indexed 5/42 schemas...")
- **Timeout configuration**: Allow users to increase the timeout for large databases
- **Partial results**: Return whatever was indexed before the timeout rather than failing entirely
- **Scoping**: Allow indexing a specific schema rather than the entire database (e.g., `schema_index [warehouse=jaffle_shop, schema=public]`)

## Context

Large production Snowflake databases can have hundreds of schemas and thousands of tables. The current indexer appears to attempt a full catalog scan with a fixed timeout, making it unusable for these environments.

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.