apache / apache/polaris-tools

feat(console): add concurrency cap or pagination for cross-catalog search data fetching

Open
#191 1 comment 1 reaction 0 assignees View on GitHub
console
Dominant language
TypeScript
Stars
33
Forks
46
Avg merge
1d 4m
Merged PRs (30d)
2

Description

##Context

The search feature https://github.com/apache/polaris-tools/pull/187 fetches all catalogs, namespaces, tables, and views client-side when the search dialog opens. The fetch strategy fans out to one request per namespace for tables and views:

1 request per catalog → namespaces
1 request per namespace → tables ← fan-out
1 request per namespace → views ← fan-out

In a deployment with many catalogs this results in several parallel HTTP requests on first open.

## Problem

- First open can be noticeably slow in large deployments
- Causes a request spike on the Polaris server

## Proposed solution

- Implement a concurrency cap or pagination

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the console search dialog and the client-side fetch path described in PR #187, tracing catalog, namespace, table, and view requests. Decide whether the issue's concurrency-cap or pagination approach fits the existing search flow, then verify that opening search avoids the current request spike while still loading the required results.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
frontend, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.