stackabletech / stackabletech/superset-operator

Feature: Add connection libraries to the superset instance

Open
#616 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

type/feature-new
Dominant language
Rust
Stars
35
Forks
4
Avg merge
12h 20m
Merged PRs (30d)
10

Description

Current Situation

if a user want's to have e.g. mssql as a database connector present in a superset instance, he'd need to either

  1. Build a custom image using pip install pymssql
  2. kubectl exec -- pip install pymssql
  3. Overrite startup commands to execute pip install pymssql

a list of possible connector options can be found here

Proposal

As a platform provider we should enable a user to be flexible and on the other hand ensure that our images are as lean and secure as possible.

Option 1

Include common connectors in our image.

Upside
  1. User has maintained and out of the box images that "just work" for their purposes
  2. Stackable has full control over versioning and can ensure and guarantee that specific scenarios will work
  3. Low hanging fruit ( up to decision on what include, that might be bigger than it seems )
Downside
  1. We'd need to be responsible for upcoming bugs, CVE's as well as maintaining library versions.
  2. Larger images and delivery of not needed software
Option 2

Allow users to specify python packages to install in crds

Upside
  1. Users can specify the libraries they want to be installed
  2. Lean and secure base images
  3. No maintenance on Stackable end needed
  4. Mechanism might be reusable for Airflow
Downside
  1. Open up the installation to malicious software
  2. Needs to be an Override as we can't take guarantee of user defined packages
  3. Larger development efforts expected

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are identified in the issue. Start by reviewing the Superset image and CRD design to compare common connectors with user-specified Python packages; done means an agreed implementation scope, security model, and versioning behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
kubernetes, python, rust
Domain
devops, infrastructure
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.