apache / apache/pinot

Superset - Provide a way to disable upsert for query

Open
#7,268 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
1d 21h
Merged PRs (30d)
189

Description

Sometimes we want to get the history of a timeseries from a pinot table which is enabled for upsert.

There doesn't seem to be anyway to toggle option(skipUpsert=true) in superset or ability to modify generated pinot queries.

Looking for a way to configure a new data source connection with upsert disabled ideally through a new option passed in the connection string with the sqlalchemy driver provided with superset[pinot].

Contributor guide

Open the contributing guide

Research direction

Start by tracing how Superset's Pinot SQLAlchemy connection options are passed into generated Pinot queries, focusing on the connection string and query-generation paths mentioned in the issue. Done means a data source can disable upsert handling so queries include the requested skipUpsert=true behavior, with coverage for the new option.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, sqlalchemy
Domain
databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.