stackql / stackql/stackql-devel
[FEATURE] Big Data support
Nobody has claimed this yet.
- Dominant language
- Go
- Stars
- 0
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Description
Feature Description
stackql should service queries against large or unbounded datasets, with configurable, opt-in restrictions on SQL support (eg: no aggregation).
Where the stackql deployment cannot service an big data query, there should be a decent error message to that effect.
It might be that some things onyl work on horizontally scaled stackql or some best effort algorithm with serious bottlenecks; this needs to be architected and failure / QOS degradation cases catalogued.
Example(s)
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Possible Approaches or Libraries to Consider
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points; begin by reviewing the existing query execution and deployment architecture. Define supported large or unbounded query cases, opt-in SQL restrictions, failure and QoS behavior, and error-message expectations before implementation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- data-engineering, distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100